{"id":825,"date":"2026-07-14T15:10:46","date_gmt":"2026-07-14T14:10:46","guid":{"rendered":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/?page_id=825"},"modified":"2026-07-14T15:10:46","modified_gmt":"2026-07-14T14:10:46","slug":"bias-in-system-evaluation","status":"publish","type":"page","link":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/bias-in-system-evaluation\/","title":{"rendered":"Bias in System Evaluation"},"content":{"rendered":"\n
\n
\"<\/figure>\n\n\n\n

Julio Gonzalo – National Distance Education University
This event took place on Thursday 24 October 2019 at 14:00<\/small><\/p>\n<\/div>\n\n\n\n


“Bias” is a trending topic in the context of Artificial Intelligence and Data Science, and for a good reason: more and more decision making processes in our lives (such as getting a loan or being interviewed by a job) are mediated by Machine Learning systems; and both the research community and the society at large are increasingly aware that Machine Learning happens to be as prone to bias as human cognition. Most research on system bias currently focus on biases introduced by the algorithms and\/or the data used by the algorithms to learn. But state-of-the-art systems are usually the result of a “natural selection” process where iterative evaluation, both inside and outside the lab, plays a key role. Consequently, biases in our evaluation methodologies may have a substantial impact on systems. In the talk I will discuss the many sources of bias in current evaluation practices, how they may impact research in the fields of Information Retrieval, Natural Language Processing and Recommender Systems, and what are the challenges to eliminate them.<\/p>\n\n\n\n

Watch the webcast replay >><\/a><\/p>\n\n\n\n

View all past events<\/a><\/p>\n\n\n\n

\n
\"Maven<\/figure>\n\n\n\n
\n

Maven of the Month<\/a><\/h3>\n\n\n\n

We are also inviting top experts in AI and Knowledge Technologies to discuss major socio-technological topics with an audience that comprises both members of the Knowledge Media Institute, as well as the wider staff at The Open University. Differently from our seminar series, these events follow a Q&A format.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Julio Gonzalo – National Distance Education UniversityThis event took place on Thursday 24 October 2019 at 14:00 “Bias” is a trending topic in the context of Artificial Intelligence and Data Science, and for a good reason: more and more decision making processes in our lives (such as getting a loan or being interviewed by a […]<\/p>\n","protected":false},"author":13,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"unity_related_person":[],"unity_sdg":[],"unity_research_theme":[],"unity_strategic_priority":[],"unity_enabler":[],"unity_general_category":[],"unity_stem_unit":[],"unity_related_project":[],"unity_related_archived_project":[],"unity_related_event":[],"class_list":["post-825","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/825","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/comments?post=825"}],"version-history":[{"count":1,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/825\/revisions"}],"predecessor-version":[{"id":826,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/825\/revisions\/826"}],"wp:attachment":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/media?parent=825"}],"wp:term":[{"taxonomy":"unity_related_person","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_person?post=825"},{"taxonomy":"unity_sdg","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_sdg?post=825"},{"taxonomy":"unity_research_theme","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_research_theme?post=825"},{"taxonomy":"unity_strategic_priority","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_strategic_priority?post=825"},{"taxonomy":"unity_enabler","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_enabler?post=825"},{"taxonomy":"unity_general_category","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_general_category?post=825"},{"taxonomy":"unity_stem_unit","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_stem_unit?post=825"},{"taxonomy":"unity_related_project","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_project?post=825"},{"taxonomy":"unity_related_archived_project","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_archived_project?post=825"},{"taxonomy":"unity_related_event","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_event?post=825"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}