GoLLIE
A large language model fine-tuned to follow annotation guidelines, improving zero-shot Information Extraction on schemas it has never seen. Built with HiTZ.
01
About Me
I am a postdoctoral researcher at the University of the Basque Country in the HiTZ center and IXA group. My research interests are focused on low-resource scenarios and particularly on low-resource Information Extraction.
I obtained my PhD at the University of the Basque Country in 2024, where I worked on zero and few-shot Information Extraction using entailment models and making LLMs learn to follow annotation guidelines.
Research Interests
02
Activities
- Invited talk at (ENLIGHT) AI & Law: Technical and Legal Challenges - How do we make LLMs speak low-resource languages?
- Co-organizer of The First Data Contamination Workshop (CONDA)
- 4 months visiting researcher (Sep-Dec 2023) at LMU Munich with Prof. Dr. Hinrich Schütze
- Active Reviewer and Area Chair for ML and NLP conferences: ICLR, *ACL (ARR), EMNLP, LREC, COLING since 2021
03
Open-Source Projects
For more, visit my GitHub or Hugging Face page.
Latxa
An open family of language models for Basque (7B-70B), with its pretraining corpus and evaluation suite. Best Resource Paper, ACL 2024.
Ask2Transformers
A framework for zero-shot text classification built on textual entailment models - the basis for much of my early work on zero-shot Information Extraction.
Code
150+ stars
04
Awards
- Young Researcher in Informatics by SCIE-BBVA Foundation, 2026
- Outstanding Area Chair Award at AACL, 2026
- Best Thesis Award by AEPIA (Asociación Española para la Inteligencia Artificial), 2025
- Best Resource Paper Award at ACL 2024
- Outstanding Reviewer Award at EMNLP, 2023
05
Students & Interns
PhD Students
-
Mikel Zubillaga2024 - present
Master's Students
-
Aimar Sagasti2026
Assessing Tool-Usage Capabilities of Basque Agentic RAG Systems
-
Ignacio Talavera2025
Synthetic Data Generation for Sentence-level and Paragraph-level Closed Information Extraction
Undergraduate Students
-
Yago Molina2026
Modelando las preferencias humanas en euskera, entrenamiento y evaluación
-
Aitziber Cibrian2026
Evaluación de LLMs para lenguas de pocos recursos: el caso del occitano
-
Mikel Zubillaga2023
Hizkuntzen arteko transferentzia analisia Euskarazko Informazio-Erauzketan
Interns
-
Yago Molina2025
-
Neil de la Fuente2024
06
Featured Publications
For more, visit my Google Scholar or Semantic Scholar page.
Loading publications...