Large Language Models Evaluation

The Bruno Kessler Foundation is a research and innovation institution based in Trento. The Foundation operates in a plurality of disciplinary fields and aims to achieve excellence in science and technology through 2 science clusters, one dedicated to technology and innovation and one to humanities and social sciences, organized in 12 Research Centers, and with more than 450 researchers. For more information visit .
In this context, the Intelligent Digital Agents Unit focuses on the study and development of flexible technologies and prototypes of digital assistants in the sector of prevention and mental well-being.
More information about IDA at .
Planned activities
The IDA Unit of the Digital Health and Well Being Center is looking for a young recent graduate interested in pursuing an internship experience in performing qualitative evaluation of Large Language Models output. The ideal candidate is a proactive and dynamic young person with good organizational and interpersonal skills, with a propensity for teamwork, motivated to undertake a training experience in an international context.
The intern, working alongside the Research Unit staff, will mainly contribute to the development of the following activities: deployment and usage of the major open LL Ms available; definition of qualitative metrics to evaluate LL Ms output; creation and/or refinement of existing benchmarks to use for LL Ms evaluation; assessing LL Ms output on specific use cases and contexts; The opportunity to join the team in other active and developing projects during the internship period and to gain experience in a dynamic and challenging environment such as FBK will also be offered.
Requirements To be enrolled at least in the third year of a Computer Science or Linguistic faculty or equivalent. The possession of Master's degree in Computer Science or Linguistic or equivalent is a plus, but not mandatory; knowledge of prompting techniques; basic knowledge of qualitative evaluation procedures in Natural Language Processing fluent knowledge of written and spoken Italian and English (min. level B1); relational and teamwork skills; good adaptability, flexibility and initiative skills;
Internship Information Internship start date: as soon as the ideal candidate is found Internship experience duration: 6 months The internship experience will take place at the FBK venue at the Povo location We offer support in finding accommodation at affiliated facilities, in the case of off-site candidates We offer the possibility to use the internal canteen service Possibility of linking the internship with bachelor or master thesis
How to Apply
All interested parties are asked to fill out the online form by clicking on " Apply Online" in the " Internship opportunities" section, attaching the following documents in . pdf format: curriculum vitae motivational letter
For any details about the internship activity, please contact: Leonardo Sanna (lsanna@fbk. eu)
For any further information, please contact the Human Resources Department at: jobs@fbk. eu

Application deadline: the notice will be withdrawn when the desired applications are reached.