What makes a successful rebuttal in computer science conferences?: A perspective on social interaction

doi:10.1016/j.joi.2023.101427

	What makes a successful rebuttal in computer science conferences?: A perspective on social interaction
	Huang, Junjie 1,2; Huang, Win-bin 3; Bu, Yi 3; Cao, Qi 1,2; Shen, Huawei 1,2; Cheng, Xueqi 4
	2023-08-01
发表期刊	JOURNAL OF INFORMETRICS
ISSN	1751-1577
卷号	17 期号:3 页码:14
摘要	With an exponential increase in submissionsto top-tier Computer Science (CS) conferences, more and more conferences have introduced a rebuttal stage to the conference peer review process. The rebuttal stage can be modeled as social interactions between authors and reviewers. A successful rebuttal often results in an increased review score after the rebuttal stage. In this paper, we con-duct an empirical study to determine the factors contributing to a successful rebuttal using over 3000 papers and 13,000 reviews from ICLR2022, one of the most prestigious computer science conferences. First, we observe a significant difference in review scores before and after the re-buttal stage, which is crucial for paper acceptance. Furthermore, we investigate factors from the reviewer's perspective using signed social network analysis. A notable finding is the increase in balanced network structure after the rebuttal stage. Subsequently, we evaluate several quantifi-able author rebuttal strategies and their effects on review scores. These strategies can help authors in improving their review scores. Finally, we used machine learning models to predict rebuttal success and validated the impact of potential factors analyzed in this paper. Our experiments demonstrate that the utilization of all features proposed in this study can aid in predicting the success of the rebuttal. In summary, this work presents a study on the impact factors of successful rebuttals from both reviewers' and authors' perspectives and lays the foundation for analyzing rebuttals with social network analysis.
关键词	Peer review Rebuttal analysis Social network analysis Social interaction Rebuttal strategy Rebuttal success prediction
DOI	10.1016/j.joi.2023.101427
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62102402] ; National Natural Science Foundation of China[U21B2046] ; National Key Ramp;D Program of China[2020AAA0105200] ; Beijing Academy of Artificial Intelligence (BAAI)
WOS研究方向	Computer Science ; Information Science & Library Science
WOS类目	Computer Science, Interdisciplinary Applications ; Information Science & Library Science
WOS记录号	WOS:001040011200001
出版者	ELSEVIER
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21308
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Huang, Junjie
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Data Intelligence Syst Res Ctr, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Beijing, Peoples R China 3.Peking Univ, Dept Informat Management, Beijing, Peoples R China 4.Chinese Acad Sci, Inst Comp Technol, CAS Key Lab Network Data Sci & Technol, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Huang, Junjie,Huang, Win-bin,Bu, Yi,et al. What makes a successful rebuttal in computer science conferences?: A perspective on social interaction[J]. JOURNAL OF INFORMETRICS,2023,17(3):14.
APA	Huang, Junjie,Huang, Win-bin,Bu, Yi,Cao, Qi,Shen, Huawei,&Cheng, Xueqi.(2023).What makes a successful rebuttal in computer science conferences?: A perspective on social interaction.JOURNAL OF INFORMETRICS,17(3),14.
MLA	Huang, Junjie,et al."What makes a successful rebuttal in computer science conferences?: A perspective on social interaction".JOURNAL OF INFORMETRICS 17.3(2023):14.