Automatic parallel corpora and bilingual terminology extraction from parallel WebSites

In our days, the notion, the importance and the significance of parallel corpora is so big that needs no special introduction. Unfortunately, public available parallel corpora is somewhat limited in range. There are big corpora about politics or legislation, about medicine and other specific areas,...

Full description

Bibliographic Details
Main Author: Almeida, J. J. (author)
Other Authors: Simões, Alberto (author)
Format: conferencePaper
Language:eng
Published: 2010
Subjects:
Online Access:http://hdl.handle.net/1822/16442
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/16442
Description
Summary:In our days, the notion, the importance and the significance of parallel corpora is so big that needs no special introduction. Unfortunately, public available parallel corpora is somewhat limited in range. There are big corpora about politics or legislation, about medicine and other specific areas, but we miss corpora for other different areas. Currently there is a huge investment on using the Web as a corpus. This article uncovers GWB, a tool that aims automatic construction of parallel corpora from the web. We defend that it is possible to build high quality terminological corpora in an automatic fashion, just by specifying a sensible Internet domain and using an appropriate set of seed keywords. GWB is a web-spider that works in conjunction with a set of other Open-Source tools, defining a pipeline that includes the documents retrieval from the web, alignment at sentence level and its quality analysis, bilingual dictionaries and terminology extraction and construction of off-line dictionaries.