GCCLA: Graph-Conditioned Cross-Lingual Adaptation of Large Language Models Under Extreme Data Scarcity (A Case Study in Tigrigna)

Résumé

Adapting large language models (LLMs) to extremely low-resource languages remains challenging due to severe data scarcity and the lack of structured linguistic supervision.We introduce GCCLA, a graph-conditioned crosslingual adaptation framework that integrates multilingual knowledge graphs into parameterefficient LLM adaptation, conditioning a frozen multilingual LLM on structured semantic and typological relations to provide a strong inductive bias for data-efficient transfer.We instantiate and evaluate the framework through a focused case study on English-to-Amharic-to-Tigrinya transfer, where labeled data is extremely limited.By separating knowledge representation from language modeling, GCCLA stabilizes learning and improves sample efficiency in few-shot regimes.We evaluate the approach on five tasks, sentiment analysis, named entity recognition, natural language inference, question answering, and extractive summarization, under extreme data scarcity, with as few as 0-1000 labeled Tigrinya examples.Experimental results show that GCCLA consistently outperforms multilingual, translation-based, and parameterefficient baselines, achieves competitive performance with as few as 100 labeled examples, and degrades gracefully under partial graph coverage.These findings demonstrate that graph conditioning is an effective principle for data-efficient cross-lingual adaptation of LLMs advancing equitable NLP.

Citer ce document

Accès au document

Texte intégral en lecture en ligne, réservé aux abonnés SPHAERO et aux membres de l'institution. Se connecter

Auteur(s)

Statistiques

Consultations : 1

Téléchargements : 0