Acta Phys. -Chim. Sin. ›› 2023, Vol. 39 ›› Issue (3): 2210029.doi: 10.3866/PKU.WHXB202210029

• EDITORIAL • Previous Articles     Next Articles

On Information Fusion by Fuzzy Sets for Decision Making in Peer Review

Lu Wang1,2, Genzi Li3, Yafei Dai1, Xuefeng Fu1,*()   

  1. 1 National Natural Science Foundation of China, Beijing 100085, China
    2 Institute of Functional Nano & Soft Materials (FUNSOM), Soochow University, Suzhou 215123, Jiangsu Province, China
    3 Yanqi Lake Institute of Basic Manufacturing Technology (Beijing) Co., Ltd., Beijing 101407, China
  • Received:2022-10-21 Accepted:2022-10-24 Published:2022-10-27
  • Contact: Xuefeng Fu E-mail:fuxf@nsfc.gov.cn
  • About author:Xuefeng Fu, Email: fuxf@nsfc.gov.cn

Abstract:

Peer review plays a crucial role in quality insurance of projects, especially for natural science projects, in evaluation or assessment activities. However, the results of assessment by reviewers for a proposal may scatter due to the intrinsic fuzzy attributes in the peer review process. Specifically, it may introduce a review bias with razor-thin margins in the conversion of descriptive opinions into quantified scores. The accumulation of the bias might cause overturning in the results of evaluation, leading proposals toward a twilight zone between approval and rejection. Here, a novel approach to handling scores in evaluation is presented to address the ambiguity of brink in a tight competition, whereby correlation information from multiple sources could be merged to improve the degree of consensus among reviewers for each proposal according to its essential value. This method may provide an alternate evaluation mechanism for proposal reviews and help tackle the challenges in decision intelligence.

Key words: Peer review, Fuzzy sets, Consensus