Research Progress: Evaluating Model Editing for Natural Language Generation
September 23, 2023: Embarking on Model Editing Evaluation Research Leadership This research is spearheaded by Domenic Rosati. Domenic is pivotal in bringing this project to completion and bringing the team up to speed. Collaborating closely with him on this initiative are Yahya(Me), Melis, and Deepika. Research Objective The primary aim of this project is to establish a framework for assessing paragraph-length generations from edited large language models. As the capabilities of large language models grow, so does the importance of understanding their behavior, especially when edited....