We are publishing another response to TrV-Nauka’s questions about the “Corps of Experts” (see TrV-Nauka No. 25(119) dated December 25, 2012 ). Answered by Yuri Ermolaev , Dr. physics and mathematics sciences, head laboratory for solar wind research at the IKI RAS.
— The main result of the project to date . Why was it worth doing this ?
— In my opinion, the main result of the project is that for the first time in the country a list of experts appeared, which was compiled not by the administrative apparatus, but by the scientific community itself, and this list is authoritative for scientists.
— Your main personal experience related to the project. For example, the most counterintuitive fact that you encountered while working on a project.
— The main surprise for me was the very fact that it is possible to combine mutually exclusive approaches to assessing a scientist: formal (based on formal indicators) and expert, when only specialists who have sufficiently strong formal indicators, in particular the citation index, take part in evaluating a scientist.
— How would you like to see the development of the project?
— It seems to me that the project should develop both externally and internally. On the one hand, it is not actively used in solving numerous scientific problems in the country, and its experts need to be more actively promoted to various structures that make decisions on the development of scientific projects in the country.
On the other hand, in addition to the fact that the project does not fully cover all areas of knowledge, there are methodological problems in the areas already covered. Any human activity is described by the rule “10% of people drink 90% of the beer.” Essentially, the project solves the problem of how to find those 10% of people in each scientific discipline. When a certain community of some scientific direction has a sufficiently large number of people distributed in a clear pyramid of their activity, then making a selection using the proposed method is relatively simple. But when the community is small, the technique fails. Roughly speaking, the pyramid of activity distribution of a given community weakly exceeds the background, and in order to find the top, apparently, it is necessary to change the threshold selection criteria, clearly understanding that the reliability of selection decreases. But, in my opinion, it is better to have a less reliable result than none.
Over the past few years, I have been the organizer of the conference “Plasma Physics in the Solar System”, held at the Institute of Space Research. The topic of the conference is quite broad, and the distribution of submitted reports and participants in individual scientific areas allows us to make some assessments. The size of the solar community can be roughly estimated at 300 people, the magnetosphere at 100 people, and the solar wind at several dozen. According to the methodology used in the project, it will not be difficult to find experts for the solar community, but for the magneto-farmers this is much more difficult, and for the solar wind community, in my opinion, it will not be possible to do this.
The situation is even more hopeless in rapidly developing areas, when there is no clearly formed pyramid in the community, and the community consists of local maxima and minima chaotically scattered across the surface. This situation, for example, now exists in a direction called “space weather”. The community consists of specialists from different (related in topic) traditional fields (Sun, cosmic rays, magnetosphere, etc.), whose interests have shifted to this area. As a result, the emerging community has very different ideas about the subject, methodology, and criteria for evaluating research. I don’t know how to select experts in such a situation.
Thus, the project has some successes, but there are many unresolved problems. I would like to wish the project participants success in this difficult task.