Agha Ali Raza

Publications/Natural Language Processing & LLMs for Low-Resource Languages

Conference · 2024

UQA: Corpus for Urdu Question Answering

Samee Arif, Sualeha Farid, Awais Athar, Agha Ali Raza

LREC-COLING 2024, Torino, Italy

Summary

Question-answering systems need large training sets, which Urdu lacked. UQA is created by translating the Stanford Question Answering Dataset (SQuAD2.0) into Urdu with a technique we call EATS (Enclose to Anchor, Translate, Seek), which preserves the position of each answer inside its translated paragraph. We select the better of two candidate translation systems and benchmark multilingual models on the result; the best, XLM-RoBERTa-XL, achieves an F1 score of 85.99. The dataset and code are public, and the same technique can create question-answering data for other languages.

Cite this paper

Samee Arif, Sualeha Farid, Awais Athar, Agha Ali Raza. UQA: Corpus for Urdu Question Answering. LREC-COLING 2024, Torino, Italy.

@inproceedings{arif2024uqa,
  author = {Samee Arif and Sualeha Farid and Awais Athar and Agha Ali Raza},
  title = {{UQA: Corpus for Urdu Question Answering}},
  booktitle = {LREC-COLING 2024, Torino, Italy},
  year = {2024},
  url = {https://aghaaliraza.com/publications/2024--LREC-COLING--UQA_Corpus_for_Urdu_Question_Answering.pdf}
}

More on this theme

All 18 works on this theme →