News:New Veridian collection launched for Yale University Veridian’s Diary: Transliteration and Stemming
Hello friend of Veridian,
This month we cover the application of transliteration and stemming to assist with search function effectiveness, and the launch of a new Veridian collection with Yale University.
New Veridian collection launched for Yale University
We have recently completed an exciting new Veridian collection for Yale University, specifically for the historic Yale Daily News.
The Yale Daily News was founded on January 28, 1878, and is the oldest college daily newspaper published in the United States. Since its inception, it has been the primary source of news and debate for the students of Yale, and many of its contributors have gone on to prominent careers in journalism and public life.
The Veridian team are pleased to have played a part in preserving such a
historic archive.
In the past few years, we've worked on a few projects with data in languages other than English. For some of these collections, we've applied transliteration and stemming to assist with the effectiveness of the search
function for particular languages.
In this diary post, we briefly explain what these processes are, and also record the technical challenges that we have encountered when implementing these two language transformation techniques into Veridian.