
5 CONCLUSION AND FUTURE
PLANS
In conclusion, the process of assigning reviewers to
papers is, without question, the most time-consuming
task for the organizers of a conference. Therefore,
it is absolutely necessary to use an automated sys-
tem that completes this task and achieves high per-
formance and quality assignments. We strongly be-
lieve that a web Conference Management System that
solves RAP, is required in order to upgrade a confer-
ence quality, by upgrading the peer-review process.
In this work, we propose such a system which ex-
ploits the power of LLMs by incorporating them into
Recommendation Systems. Regarding our plans for
future work:
• We will put our system to online access, in the
near future.
• We currently work on the front-end to improve
UX-UI issues.
• We will make our system available to all academic
personnel organizing a conference.
• We plan to continue running experiments on the
performance and efficiency of the reviewer as-
signment module using different datasets.
• We are going to perform an extensive evaluation
and calculate a variety of performance metrics for
the reviewer assignment module.
ACKNOWLEDGEMENTS
The work of M. Vassilakopoulos and A. Cor-
ral was funded by the Spanish Government
MCIN/AEI/10.13039/501100011033 and the "ERDF
A way of making Europe" under the Grant PID2021-
124124OB-I00.
REFERENCES
Aksoy, M., Yanik, S., and Amasyali, M. F. (2023). Re-
viewer assignment problem: A systematic review of
the literature.
Bouanane, K., Medakene, A. N., Benbelghit, A., and Bel-
haouari, S. B. (2024). Faircolor: An efficient algo-
rithm for the balanced and fair reviewer assignment
problem. Inf. Proc. & Management, 61(6):103865.
Charlin, L. and Zemel, R. S. (2013). The toronto paper
matching system: An automated paper-reviewer as-
signment system. In ICML workshop on peer review-
ing and publishing models.
Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K.
(2019). BERT: Pre-training of deep bidirectional
transformers for language understanding. In Burstein,
J., Doran, C., and Solorio, T., editors, Proc. 2019
Conf. of the North American Chapter of the ACL: Hu-
man Language Technologies, Volume 1 (Long & Short
Papers), pages 4171–4186, Minneapolis, MN. ACL.
Latypova, V. (2023). Reviewer assignment decision support
in an academic journal based on multicriteria assess-
ment and text mining. In 2023 IX Int. Conf. on Inf.
Technology and Nanotechnology (ITNT), pages 1–4.
Leyton-Brown, K., Mausam, Nandwani, Y., Zarkoob, H.,
Cameron, C., Newman, N., and Raghu, D. (2024).
Matching papers and reviewers at large conferences.
Artificial Intelligence, 331:104119.
Maleszka, M., Maleszka, B., Król, D., Hernes, M., Mar-
tins, D. M. L., Homann, L., and Vossen, G. (2020). A
Modular Diversity Based Reviewer Recommendation
System, page 550–561. Springer Singapore.
Ribeiro, A. C., Sizo, A., and Reis, L. P. (2023). Investigat-
ing the reviewer assignment problem: A systematic
literature review. Journal of Information Science.
Stelmakh, I., Wieting, J., Neubig, G., and Shah, N. B.
(2023). A gold standard dataset for the reviewer as-
signment problem.
Stergiopoulos, V., Tsianaka, T., and Tousidou, E. (2022).
Aminer citation-data preprocessing for recommender
systems on scientific publications. In Proc. 25th Pan-
Hellenic Conf. on Informatics, PCI ’21, page 23–27,
New York, NY. ACM.
Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W.,
and Jiang, P. (2019). Bert4rec: Sequential recom-
mendation with bidirectional encoder representations
from transformer. In Proc. 28th ACM Int. Conf. on
Inf. and Knowledge Management, CIKM ’19, page
1441–1450, New York, NY. ACM.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones,
L., Gomez, A. N., Kaiser, L. u., and Polosukhin,
I. (2017). Attention is all you need. In Guyon,
I., Luxburg, U. V., Bengio, S., Wallach, H., Fer-
gus, R., Vishwanathan, S., and Garnett, R., editors,
Advances in Neural Information Processing Systems,
volume 30. Curran Associates, Inc.
Wu, C., Wu, F., Qi, T., and Huang, Y. (2021). Empower-
ing news recommendation with pre-trained language
models. In Proc. 44th Int. ACM SIGIR Conf. on Re-
search and Development in Inf. Retrieval, SIGIR ’21,
page 1652–1656, New York, NY. ACM.
Yujian, L. and Bo, L. (2007). A normalized levenshtein dis-
tance metric. IEEE Transactions on Pattern Analysis
and Machine Intelligence, 29(6):1091–1095.
Zhang, Y., Shen, Y., Kang, S., Chen, X., Jin, B., and Han, J.
(2024). Chain-of-factors paper-reviewer matching.
Zhao, X. and Zhang, Y. (2022). Reviewer assignment al-
gorithms for peer review automation: A survey. Inf.
Proc. & Management, 59(5):103028.
Conference Management System Utilizing an LLM-Based Recommendation System for the Reviewer Assignment Problem
1011