{"id":651,"date":"2026-07-14T13:39:27","date_gmt":"2026-07-14T12:39:27","guid":{"rendered":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/?page_id=651"},"modified":"2026-07-14T13:39:27","modified_gmt":"2026-07-14T12:39:27","slug":"large-language-models-for-scientific-question-answering-an-extensive-analysis-of-the-sciqa-benchmarkthis-event-took-place-on-tuesday-23-july-2024-at-1130","status":"publish","type":"page","link":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/large-language-models-for-scientific-question-answering-an-extensive-analysis-of-the-sciqa-benchmarkthis-event-took-place-on-tuesday-23-july-2024-at-1130\/","title":{"rendered":"Large Language Models for Scientific Question Answering: an Extensive Analysis of the SciQA BenchmarkThis event took place on Tuesday 23 July 2024 at 11:30"},"content":{"rendered":"\n
\n
\"Mr<\/figure>\n\n\n\n

Mr Antonello Meloni – Department of Mathematics and Computer Science, University of Cagliari, IT
This event took place on Tuesday 23 July 2024 at 11:30<\/small><\/p>\n<\/div>\n\n\n\n


The SciQA benchmark for scientific question answering presents a challenging task for next-generation question-answering systems, where standard large language models often fall short. In this seminar, we will analyze the performance of language models on this benchmark, exploring both prompting and fine-tuning techniques to enhance their adaptability to the SciQA task. Our findings demonstrate that intelligent few-shot selection in prompting and targeted fine-tuning can lead to excellent results on the SciQA benchmark. We will also discuss valuable insights gained, common error categories encountered, and their implications for optimizing large language models for question answering over knowledge graphs.<\/p>\n\n\n\n

Watch the webcast replay >><\/a><\/p>\n\n\n\n

View all past events<\/a><\/p>\n\n\n\n

\n
\"Maven<\/figure>\n\n\n\n
\n

Maven of the Month<\/a><\/h3>\n\n\n\n

We are also inviting top experts in AI and Knowledge Technologies to discuss major socio-technological topics with an audience that comprises both members of the Knowledge Media Institute, as well as the wider staff at The Open University. Differently from our seminar series, these events follow a Q&A format.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Mr Antonello Meloni – Department of Mathematics and Computer Science, University of Cagliari, ITThis event took place on Tuesday 23 July 2024 at 11:30 The SciQA benchmark for scientific question answering presents a challenging task for next-generation question-answering systems, where standard large language models often fall short. In this seminar, we will analyze the performance […]<\/p>\n","protected":false},"author":13,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"unity_related_person":[],"unity_sdg":[],"unity_research_theme":[],"unity_strategic_priority":[],"unity_enabler":[],"unity_general_category":[],"unity_stem_unit":[],"unity_related_project":[],"unity_related_archived_project":[],"unity_related_event":[],"class_list":["post-651","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/651","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/comments?post=651"}],"version-history":[{"count":1,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/651\/revisions"}],"predecessor-version":[{"id":652,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/651\/revisions\/652"}],"wp:attachment":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/media?parent=651"}],"wp:term":[{"taxonomy":"unity_related_person","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_person?post=651"},{"taxonomy":"unity_sdg","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_sdg?post=651"},{"taxonomy":"unity_research_theme","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_research_theme?post=651"},{"taxonomy":"unity_strategic_priority","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_strategic_priority?post=651"},{"taxonomy":"unity_enabler","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_enabler?post=651"},{"taxonomy":"unity_general_category","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_general_category?post=651"},{"taxonomy":"unity_stem_unit","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_stem_unit?post=651"},{"taxonomy":"unity_related_project","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_project?post=651"},{"taxonomy":"unity_related_archived_project","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_archived_project?post=651"},{"taxonomy":"unity_related_event","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_event?post=651"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}