{"id":1310,"date":"2026-07-16T13:02:18","date_gmt":"2026-07-16T12:02:18","guid":{"rendered":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/?page_id=1310"},"modified":"2026-07-16T13:02:18","modified_gmt":"2026-07-16T12:02:18","slug":"big-data-opportunities-and-challenges-for-ir-text-mining-and-nlp","status":"publish","type":"page","link":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/big-data-opportunities-and-challenges-for-ir-text-mining-and-nlp\/","title":{"rendered":"Big Data Opportunities and Challenges for IR, Text Mining, and NLP"},"content":{"rendered":"\n
\n
\"Professor<\/figure>\n\n\n\n

Professor Beth Plale – Director, Data to Insight Center Managing Director, Pervasive Technology Institute Professor of Informatics and Computing at Indiana University
This event took place on Thursday 12 December 2013 at 10:30<\/small><\/p>\n<\/div>\n\n\n\n


HTRC is a collaborative effort of Indiana University and the University of Illinois at Urbana-Champaign, along with the HathiTrust, to provide a new mode of access to the content of research libraries. That is, HTRC enables computational exploration of the digitized volumes that make up the HathiTrust digital library.
Initially launched in 2011, Phase I of the HTRC initiative was dedicated to construction of underlying software and services. Spring 2013 marks Phase II, focused on engaging with the research community to support and showcase computational research on the public domain corpus alongside ongoing technical development.   

In this talk, I will talk about a couple of recent developments to HTRC:

Community Contributed Analytics in Secure Capsule. Through funding from the Alfred P. Sloan Foundation, HTRC is developing secure software through which researchers can submit their own analytics algorithms to run against the full corpus of 11 M volumes, including both public domain and copyrighted content. Researchers with smaller scale needs obtain a dedicated virtual machine (VM) that is pre-configured but can be customized by the researcher with his or her own software. The VM runs on HTRC compute resources. When running, the VM has limited access to the network to ensure the safety of the data. HTRC is working on expanding access to statistical information about the entire 11M volume corpus, working with community members to identify particularly useful information like page-level token counts.
Metadata Enhancement.  Going beyond MARC, the HTRC team is adding more metadata fields to better serve the diverse needs of the community. Our indexing service has separated the full text index from the metadata index, making it more convenient to add additional metadata fields without interfering with the OCR content. So far, \u201cgender\u201d and \u201ctoken count\u201d fields have been added with plans to investigate and implement additional attributes.
See more details at http:\/\/www.hathitrust.org\/htrc<\/p>\n\n\n\n

Watch the webcast replay >><\/a><\/p>\n\n\n\n

\n

View all past events<\/a><\/p>\n\n\n\n

\n
\"Maven<\/figure>\n\n\n\n
\n

Maven of the Month<\/a><\/h3>\n\n\n\n

We are also inviting top experts in AI and Knowledge Technologies to discuss major socio-technological topics with an audience that comprises both members of the Knowledge Media Institute, as well as the wider staff at The Open University. Differently from our seminar series, these events follow a Q&A format.<\/p>\n<\/div>\n<\/div>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"

Professor Beth Plale – Director, Data to Insight Center Managing Director, Pervasive Technology Institute Professor of Informatics and Computing at Indiana UniversityThis event took place on Thursday 12 December 2013 at 10:30 HTRC is a collaborative effort of Indiana University and the University of Illinois at Urbana-Champaign, along with the HathiTrust, to provide a new […]<\/p>\n","protected":false},"author":13,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"unity_related_person":[],"unity_sdg":[],"unity_research_theme":[],"unity_strategic_priority":[],"unity_enabler":[],"unity_general_category":[],"unity_stem_unit":[],"unity_related_project":[],"unity_related_archived_project":[],"unity_related_event":[],"class_list":["post-1310","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/1310","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/comments?post=1310"}],"version-history":[{"count":1,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/1310\/revisions"}],"predecessor-version":[{"id":1311,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/pages\/1310\/revisions\/1311"}],"wp:attachment":[{"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/media?parent=1310"}],"wp:term":[{"taxonomy":"unity_related_person","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_person?post=1310"},{"taxonomy":"unity_sdg","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_sdg?post=1310"},{"taxonomy":"unity_research_theme","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_research_theme?post=1310"},{"taxonomy":"unity_strategic_priority","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_strategic_priority?post=1310"},{"taxonomy":"unity_enabler","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_enabler?post=1310"},{"taxonomy":"unity_general_category","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_general_category?post=1310"},{"taxonomy":"unity_stem_unit","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_stem_unit?post=1310"},{"taxonomy":"unity_related_project","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_project?post=1310"},{"taxonomy":"unity_related_archived_project","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_archived_project?post=1310"},{"taxonomy":"unity_related_event","embeddable":true,"href":"https:\/\/schools.stem.open.ac.uk\/knowledge-media-institute\/wp-json\/wp\/v2\/unity_related_event?post=1310"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}