oai:www.ldc.upenn.edu:LDC2020T17
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2020T17 |
| Metadata | ||
| Title: | LORELEI Vietnamese Representative Language Pack | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Tracey, Jennifer, et al. LORELEI Vietnamese Representative Language Pack LDC2020T17. Web Download. Philadelphia: Linguistic Data Consortium, 2020 | |
| Contributor: | Tracey, Jennifer | |
| Strassel, Stephanie | ||
| Graff, David | ||
| Wright, Jonathan | ||
| Chen, Song | ||
| Ryant, Neville | ||
| Kulick, Seth | ||
| Griffitt, Kira | ||
| Delgado, Dana | ||
| Arrigo, Michael | ||
| Date (W3CDTF): | 2020 | |
| Date Issued (W3CDTF): | 2020-08-17 | |
| Description: | *Introduction* LORELEI Vietnamese Representative Language Pack consists of Vietnamese monolingual text, Vietnamese-English parallel text, annotations, supplemental resources and related software tools developed by the Linguistic Data Consortium for the DARPA LORELEI program. The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. *Data* Vietnamese is spoken mainly in Vietnam, as well as in Guangxi Province in southern China, Cambodia and Laos. Data was collected in the following genres: discussion forum, news, reference, social network, and weblogs. Both monolingual text collection and parallel text creation involved a combination of manual and automatic methods. Data volumes are as follows: * Over 172 million words of Vietnamese monolingual text, approximately 325,000 words of which were translated into English * 106,000 Vietnamese words translated from English data * 1.9 million words of found parallel text Approximately 75,000 words were annotated for named entities and up to 25,000 words contain additional annotation, including situation frames (identifying entities, needs and issues) and entity linking and detection. Lexical resources and software tools are also included in this release. The tools recreate original source data from the processed XML material and condition text data users download from Twitter. Monolingual and parallel text are presented in XML with associated dtds. Annotation data is presented as tab delimited files. All text is UTF-8 encoded. The knowledge base for entity linking annotation for this corpus and all LORELEI Representative Language and Incident Language Packs is available separately as LORELEI Entity Detection and Linking Knowledge Base (LDC2020T10). *Acknowledgement* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA. *Samples* Please view the following samples: * Vietnamese LTF XML * Vietnamese PSM XML * English LTF XML * English PSM XML * Simple Named Entity Annotation (XML) * Full Named Entity Annotation (XML) * Simple Semantic Annotation (XML) * Situation Frame Annotation (TXT) * Noun Phrase Chunking Annotation (XML) *Updates* None at this time. | |
| Extent: | Corpus size: 3808030 KB | |
| Identifier: | LDC2020T17 | |
| https://catalog.ldc.upenn.edu/LDC2020T17 | ||
| ISBN: 1-58563-933-8 | ||
| ISLRN: 257-294-146-794-3 | ||
| DOI: 10.35111/B7KZ-9804 | ||
| Language: | Vietnamese | |
| English | ||
| Language (ISO639): | vie | |
| eng | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2020T17 | |
| Rights Holder: | Portions © 2002-2007, 2009-2010 Agence France Presse, © 2015 AloBacsi, © 2000 American Broadcasting Company, © 2015-2016 ASIANET, © 2015 BAN BIÊN TẬP TIN KINH TẾ, TTXVN, © 2015 Báo Bắc Giang, © 2015 Báo Bắc Ninh & Trung tâm Tin học Hành chính, © 2013 Báo Bình Định, © 2014-2016 BaoCalitoday.com, © 2015 Báo Dân Việt, © 2007-2016 Báo Diễn Đàn Doanh Nghiệp điện tử, © 2013 Báo điện tử Dân Việt, © 2014-2015 Báo điện tử Pháp Luật thành phố Hồ Chí Minh, © 2011 BÁO DOANH NHÂN SÀI GÒN ĐIỆN TỬ - DNSG Online, © 2015-2016 Báo Đời sống và Pháp luật, © 2013, 2015 Báo Lao Động - Cơ quan của Tổng Liên đoàn Lao động Việt Nam, © 2015 Báo Mới, © 2014-2016 Báo Nhân Dân thiết kế và giữ bản quyền, © 2016 Báo Phú Yên Online, © 2014 BÁO QUẢNG TRỊ ĐIỆN TỬ, © 2013 Báo SÀI GÒN GIẢI PHÓNG, © 2015 Báo Tài Nguyên và Môi trường, © 2014 Baotinnhanh.vn, © 2013 Báo Tin tức - TTXVN, © 2011, 2016 Báo VietNamNet, © 2013-2016 Báo Thanh Niên, © 2015 Baoxaydung.com.vn, © 2011-2016 BBC, © 2013, 2015-2016 BizLIVE.vn, © 2000 Cable News Network LP, LLLP, © 2008 Central News Agency (Taiwan), © 2013 Cơ quan chủ quản: Ủy ban nhân dân Tỉnh Quảng Ninh, © 2015 Công an TPHCM, © 2010-2016 Công ty Cổ phần VCCorp, © 2013 Công Ty Cổ Phần Kết Nối Y Tế , © 2015 Đại Kỷ Nguyên, © 2014 KHÁM PHÁ, © 2015-2016 Đài Tiếng nói nhân dân Thành phố Hồ Chí Minh, © 2016 Dantri.com.vn, © 1989 Dow Jones & Company, Inc., © 2016 Duong Bo, © 2011 Enternews.vn, © 2015 Gio Bao, © 2014 go.vn, © 2014-2016 Infonet, © 2005-2016 KhoaHoc.tv, © 2012-2015 Kieu.com, © 2008-2016 Lac Viet Computing Corporation, © 2005 Los Angeles Times - Washington Post News Service, Inc., © 2016 Microsoft, © 2000 National Broadcasting Company, Inc., © 1999, 2005, 2006, 2010 New York Times, © 2015 Người Việt Daily News, © 2012-2016 nguoiduatin.vn, © 2011 Nhan Hieu Viet, © 2008 Nongnghiep.vn, © 2014-2016 Nuathegioi.com, © 2015 Phương Đông Times, © 2000 Public Radio International, © 2008 SaigonTimesGroup, © 2015 Saigon Tin, © 2016 SNH, © 2015 SongKhoe.vn, © 2015 Sống Mới, © 2012 Sputnik, © 2015-2016 SVHUAF, © 2013 Tạp chí Nhịp Cầu Đầu Tư, © 2015 Tạp Chí Thực Phẩm Chức Năng Health+, © 2014 Tây Ninh Online, © 2013-2016 Thanh Nien News, © 2003, 2005-2008, 2010 The Associated Press, © 2011, 2015 The Voice of Vietnam Online, © 2015 THST.vn, © 2016 Thời Báo Inc., © 2013, 2015 ThoitietVietnam.vn, © 2013-2016 Tiền Phong, © 2007, 2015-2016 Tin 247, © 2015 Tin Tuc Viet Nam, © 2015-2016 Trang Tin Tức Người Thanh Hóa, © 2012, 2015 Tin tức VTC News, © 2012-2016 Tinmoi, © 2013 Tri Thức Thời Đại,© 2012-2016 Trương Tấn Sang, © 2005, 2013-2016 TUOITRE.VN, © 2015 VGT Media Co, Ltd., © 2006-2016 VIỄN ĐÔNG DAILY NEWS, © 2013 VIỆN SỐT RÉT - KÝ SINH TRÙNG - CÔN TRÙNG TRUNG ƯƠNG, © 2007, 2013, 2014 Viet Bao, © 2016 Vietbao.com, © 2001 Vietbao.vn, © 2015 VietNamNet, © 2015 VietnamPlus, TTXVN, © 2014 Viet Times, © 2010 Vinanet, © 2001, 2014 VnExpress.net, © 2014 Xaluan.com, © 2003, 2005-2008 Xinhua News Agency, © 2011-2016 Zing.vn, © 2016, 2020 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Software | |
| Text | ||
| Type (OLAC): | lexicon | |
| primary_text | ||
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2020T17 | |
| DateStamp: | 2023-01-27 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Tracey, Jennifer; Strassel, Stephanie; Graff, David; Wright, Jonathan; Chen, Song; Ryant, Neville; Kulick, Seth; Griffitt, Kira; Delgado, Dana; Arrigo, Michael. 2020. Linguistic Data Consortium. | |
| Terms: | area_Asia area_Europe country_GB country_VN dcmi_Software dcmi_Text iso639_eng iso639_vie olac_lexicon olac_primary_text | |