Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell

Abstract

We introduce the first treebank for a romanized user-generated content variety of Algerian, a North-African Arabic dialect. Made of 1500 sentences, fully annotated in morpho-syntax and Universal Dependency syntax, with full translation at both the word and the sentence levels, this treebank is made freely available. It is supplemented with 50k. unlabeled sentences collected from Common Crawl and web-crawled data using intensive data-mining techniques. Preliminary experiments demonstrate its usefulness for POS tagging and dependency parsing.

Publication
In The 58th Annual Meeting of the Association for Computational Linguistics
Pedro Ortiz Suarez
Pedro Ortiz Suarez
Researcher

I’m a researcher at the Speech and Language Technology Team at DFKI GmbH Berlin.