Introduction

The 1997 HUB5 Arabic Transcripts corpus was produced by the Linguistic Data Consortium (LDC), catalog number LDC2002T39 and ISBN 1-58563-245-7.

This publication contains transcripts for twenty CALLHOME Egyptian Arabic telephone conversations. These 20 conversations were used in NIST's 1997 HUB5 Non-English evaluation, and are published as 1997 HUB5 Arabic Evaluation LDC2002S22.

Data

There are 40 data files. Each of the 20 calls has transcripts in two formats: .txt and .scr.

The .txt files are transcript files containing the Romanized orthographic forms that were used in the original transcription process. These forms also serve as the head-words in the associated Egyptian Colloquial Arabic Lexicon LDC99L22.

The .scr files are transcript files rendered in Arabic script orthography, using the ISO 8859-6 character set; these files were derived from the .txt files by replacing each word token with its Arabic script counterpart (which is also provided in the CALLHOME Arabic Lexicon). These files have been formatted to avoid problems of bi-directional text: line-feed characters are used to separate ASCII content from Arabic script content in each utterance.