Publications

2022

• Tsvetomila Mihaylova, Vlad Niculae, André F. T. Martins.
  "Modeling Structure with Undirected Neural Networks."
  International Conference on Machine Learning (ICML'22), Baltimore, USA, July 2022.
  [pdf]

• Patrick Fernandes, António Farinhas, Ricardo Rei, José G. C. Souza, Perez Ogayo, Graham Neubig, André F. T. Martins.
  "Quality-Aware Decoding for Neural Machine Translation."
  Annual Meeting of the North-American Chapter of the Association for Computational Linguistics (NAACL'22), Seattle, USA, July 2022.
  [pdf]

• Ben Peters, André F. T. Martins.
  "Beyond characters: Subword-level morpheme segmentation."
  NAACL Workshop on Computational Research in Phonetics, Phonology, and Morphology (SIGMORPHON'22), Seattle, USA, July 2022.
  [pdf]

• Ricardo Rei, Ana C. Farinha, José G. C. Souza, P. G. Ramos, André F. T. Martins, Luisa Coheur, Alon Lavie.
  "Searching for COMETINHO: The Little Metric That Could."
  Annual Conference of the European Association for Machine Translation (EAMT'22), Ghent, Belgium, June 2022.
  Best Paper Award
  [pdf]

• Pedro Martins, Zita Marinho, André F. T. Martins.
  "∞-former: Infinite Memory Transformer."
  Annual Meeting of the Association for Computational Linguistics (ACL'22), Dublin, Ireland, May 2022.
  [pdf]

• Pedro H. Martins, Zita Marinho, André F. T. Martins.
  "Efficient Machine Translation Domain Adaptation."
  ACL Workshop on Semiparametric Methods in NLP: Decoupling Logic from Knowledge, Dublin, Ireland, May 2022.
  [pdf]

• Marcos Treviso, António Góis, Patrick Fernandes, Erick Fonseca, André F. T. Martins.
  "Predicting attention sparsity in transformers."
  ACL Workshop on Structured Prediction for Natural Language Processing (SPNLP'22), Dublin, Ireland, May 2022.
  [pdf]

• António Farinhas, Wilker Aziz, Vlad Niculae, André F. T. Martins.
  "Sparse Communication via Mixed Distributions."
  International Conference on Learning Representations (ICLR'22; selected for oral presentation), May 2022.
  [pdf]

• Gonçalo R. A. Faria, André F. T. Martins, Mário A. T. Figueiredo.
  "Differentiable Causal Discovery Under Latent Interventions."
  1st conference on Causal Learning and Reasoning (CLeaR'22), Eureka, USA, April 2022.
  [pdf]

• André F. T. Martins, Marcos Treviso, António Farinhas, Pedro M. Q. Aguiar, Mário A. T. Figueiredo, Mathieu Blondel, Vlad Niculae. "Sparse Continuous Distributions and Fenchel-Young Losses"
  Journal of Machine Learning Research, 2022 (to appear).
  [pdf]

2021

• Taisiya Glushkova, Chrysoula Zerva, Ricardo Rei, André F. T. Martins.
  "Uncertainty-Aware Machine Translation Evaluation"
  Findings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'21), November 2021.
  [pdf]

• Nuno M. Guerreiro, André F. T. Martins.
  "SPECTRA: Sparse Structured Text Rationalization"
  Conference on Empirical Methods in Natural Language Processing (EMNLP'21), November 2021.
  [pdf]

• Lucia Specia, Frédéric Blain, Marina Fomicheva, Chrysoula Zerva, Zhenhao Li, Vishrav Chaudhary and André F. T. Martins.
  "Findings of the WMT 2021 Shared Task on Quality Estimation" Conference of Machine Translation (WMT'21), November 2021.
  [pdf]

• Chrysoula Zerva, Daan van Stigt, Ricardo Rei, Catarina Farinha, Pedro Ramos, José G. C. Souza, Taisiya Glushkova, Miguel Vera, Fábio Kepler and André F. T. Martins.
  "IST-Unbabel 2021 Submission for the QE Shared Task"
  Conference of Machine Translation (WMT'21), November 2021.
  [pdf]

• Ricardo Rei, Catarina Farinha, Chrysoula Zerva, Dann van Stigt, Craig Stewart, Pedro Ramos, Taisiya Glushkova, André F. T. Martins and Alon Lavie.
  "Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared Task"
  Conference of Machine Translation (WMT'21), November 2021.
  [pdf]

• Marcos V. Treviso, Nuno M. Guerreiro, Ricardo Rei, André F. T. Martins.
  "IST-Unbabel 2021 Submission for the Explainable Quality Estimation Shared Task"
  Workshop on "Evaluation & Comparison of NLP Systems" (Eval4NLP), November 2021.
  Best Explainability Approach Award.
  [pdf]

• António Farinhas, André F. T. Martins, Pedro M. Q. Aguiar.
  "Multimodal Continuous Visual Attention Mechanisms"
  ICCV 2021 Visual Inductive Priors for Data-Efficient Deep Learning Workshop, October 2021.
  [pdf]

• Pedro H. Martins, Vlad Niculae, Zita Marinho, André F. T. Martins.
  "Sparse and Structured Visual Attention"
  IEEE International Conference on Image Processing (ICIP'21), Anchorage, United States, September 2021.
  [pdf]

• Patrick Fernandes, Kayo Yin, Graham Neubig, André F. T. Martins.
  "Measuring and Increasing Context Usage in Context-Aware Machine Translation"
  Conference of the Association for Computational Linguistics (ACL'21), August 2021.
  [pdf]

• Kayo Yin, Patrick Fernandes, Danish Pruthi, Aditi Chaudhary, André F. T. Martins, Graham Neubig.
  "Do Context-Aware Translation Models Pay the Right Attention?"
  Conference of the Association for Computational Linguistics (ACL'21), August 2021.
  [pdf]

• Ben Peters and André F. T. Martins.
  "Smoothing and Shrinking the Sparse Seq2Seq Search Space (S7)."
  Conference of the North American Chapter of the Association for Computational Linguistics (NAACL'21), June 2021.
  [pdf]

2020

• André F. T. Martins, António Farinhas, Marcos Treviso, Vlad Niculae, Pedro M. Q. Aguiar, and Mário A. T. Figueiredo.
  "Sparse and Continuous Attention Mechanisms."
  Neural Information Processing Systems (NeurIPS'20, spotlight), December 2020.
  [pdf]

• Gonçalo M. Correia, Vlad Niculae, Wilker Aziz, and André F. T. Martins.
  "Efficient Marginalization of Discrete and Structured Latent Variables via Sparsity."
  Neural Information Processing Systems (NeurIPS'20, spotlight), December 2020.
  [pdf]

• Pedro Martins, Zita Marinho, and André F. T. Martins.
  "Sparse Text Generation."
  Conference on Empirical Methods in Natural Language Processing (EMNLP'20), November 2020.
  [pdf]

• Tsvetomila Mihaylova, Vlad Niculae, and André F. T. Martins.
  "Understanding the mechanics of SPIGOT: Surrogate gradients for latent structure learning."
  Conference on Empirical Methods in Natural Language Processing (EMNLP'20), November 2020.
  [pdf]

• Marcos Treviso and André F. T. Martins.
  "The Explanation Game: Towards Prediction Explainability through Sparse Communication."
  EMNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP'20), November 2020.
  [pdf]

• M. Amin Farajian, António V. Lopes, André F. T. Martins, Sameen Maruf and Gholamreza Haffari.
  "Findings of the WMT 2020 Shared Task on Chat Translation."
  Conference on Machine Translation (WMT'20), November 2020.
  [pdf]

• Lucia Specia, Frédéric Blain, Marina Fomicheva, Erick Fonseca, Vishrav Chaudhary, Francisco Guzmán and André F. T. Martins.
  "Findings of the WMT 2020 Shared Task on Quality Estimation."
  Conference on Machine Translation (WMT'20), November 2020.
  [pdf]

• João Moura, Miguel Vera, Daan van Stigt, Fabio Kepler and André F. T. Martins.
  "IST-Unbabel Participation in the WMT20 Quality Estimation Shared Task."
  Conference on Machine Translation (WMT'20), November 2020.
  [pdf]

• Vlad Niculae and André F. T. Martins.
  "LP-SparseMAP: Differentiable Relaxed Optimization for Sparse Structured Prediction."
  International Conference on Machine Learning (ICML'20), July 2020.
  [pdf]

• Erick Fonseca and André F. T. Martins.
  "Revisiting Higher-Order Dependency Parsers."
  Annual Meeting of the Association for Computational Linguistics (ACL'20), July 2020.
  [pdf]

• Ben Peters and André F. T. Martins.
  "DeepSPIN at SIGMORPHON 2020: One-Size-Fits-All Multilingual Models."
  ACL Workshop on Computational Research in Phonetics, Phonology, and Morphology (SIGMORPHON'20), July 2020.
  [pdf]

• António Góis, Kyunghyun Cho, and André F. T. Martins.
  "Learning Non-Monotonic Automatic Post-Editing of Translations from Human Orderings."
  Annual Conference of the European Association for Machine Translation (EAMT'20), November 2020.
  [pdf]

• António Lopes, M. Amin Farajian, Rachel Bawden, Michael Zhang and André F. T. Martins.
  "Document-level Neural MT: A Systematic Comparison."
  Annual Conference of the European Association for Machine Translation (EAMT'20), November 2020.
  [pdf]

• Mathieu Blondel, André F. T. Martins, and Vlad Niculae.
  "Learning with Fenchel-Young losses."
  Journal of Machine Learning Research, 21 (2020) 1--69.
  [pdf]

2019

• Gonçalo M. Correia, Vlad Niculae, and André F. T. Martins.
  "Adaptively Sparse Transformers."
  Conference on Empirical Methods in Natural Language Processing (EMNLP'19), Hong-Kong, China, November 2019.
  [pdf]

• Erick Fonseca, Lisa Yankovskaya, André F. T. Martins, Mark Fishel, Christian Federmann.
  "Findings of the WMT 2019 Shared Tasks on Quality Estimation."
  Conference on Machine Translation (WMT 2019), Florence, Italy, August 2019.
  [pdf]

• Fabio Kepler, Jonay Trénous, Marcos Treviso, Miguel Vera, António Góis, M. Amin Farajian, António V. Lopes, André F. T. Martins.
  "Unbabel's Participation in the WMT19 Translation Quality Estimation Shared Task."
  Conference on Machine Translation (WMT 2019), Florence, Italy, August 2019.
  Best results in the shared task.
  [pdf]

• António V. Lopes, M. Amin Farajian, Gonçalo M. Correia, Jonay Trénous, and André F. T. Martins.
  "Unbabel's Submission to the WMT2019 APE Shared Task: BERT-Based Encoder-Decoder for Automatic Post-Editing."
  Conference on Machine Translation (WMT 2019), Florence, Italy, August 2019.
  Best results in the shared task.
  [pdf]

• António Góis and André F. T. Martins.
  "Translator2Vec: Understanding and Representing Human Post-Editors."
  Proceedings of Machine Translation Summit XVII Volume 1: Research Track (MT Summit 2019), Dublin, Ireland, August 2019.
  [pdf] [dataset]

• Ben Peters, Vlad Niculae, and André F. T. Martins.
  "Sparse Sequence-to-Sequence Models."
  Annual Meeting of the Association for Computational Linguistics (ACL'19), Florence, Italy, July 2019.
  [pdf]

• Gonçalo M. Correia and André F. T. Martins.
  "A Simple and Effective Approach to Automatic Post-Editing with Transfer Learning."
  Annual Meeting of the Association for Computational Linguistics (ACL'19), Florence, Italy, July 2019.
  [pdf]

• Fábio Kepler, Jonay Trénous, Marcos Treviso, Miguel Vera, and André F. T. Martins.
  "Openkiwi: An open source framework for quality estimation."
  Annual Meeting of the Association for Computational Linguistics (ACL'19), System Demonstrations, Florence, Italy, July 2019.
  Best system demo paper award.
  [pdf]

• Ben Peters and André F. T. Martins.
  "IT–IST at the SIGMORPHON 2019 Shared Task: Sparse Two-headed Models for Inflection."
  ACL Workshop on Computational Research in Phonetics, Phonology, and Morphology (SIGMORPHON'19), Florence, Italy, July 2019.
  Interpretability Prize.
  [pdf]

• Tsvetomila Mihaylova and André F. T. Martins.
  "Scheduled Sampling for Transformers."
  Annual Meeting of the Association for Computational Linguistics (ACL'19), Student Research Workshop, Florence, Italy, July 2019.
  [pdf]

• Pedro Henrique Martins, Zita Marinho, and André F. T. Martins.
  "Joint Learning of Named Entity Recognition and Entity Linking."
  Annual Meeting of the Association for Computational Linguistics (ACL'19), Student Research Workshop, Florence, Italy, July 2019.
  [pdf]

• Sameen Maruf, André F. T. Martins, and Gholamreza Haffari.
  "Selective attention for context-aware neural machine translation."
  Conference of the North American Chapter of the Association for Computational Linguistics (NAACL'19), Minneapolis, USA, June 2019.
  [pdf]

• Afonso Mendes, Shashi Narayan, Sebastião Miranda, Zita Marinho, André F. T. Martins, and Shay B. Cohen.
  "Jointly extracting and compressing documents with summary state representations."
  Conference of the North American Chapter of the Association for Computational Linguistics (NAACL'19), Minneapolis, USA, June 2019.
  [pdf]

• Mathieu Blondel, André F. T. Martins, and Vlad Niculae.
  "Learning classifiers with Fenchel-Young losses: Generalized entropies, margins, and algorithms."
  International Conference on Artificial Intelligence and Statistics (AISTATS'19), Okinawa, Japan.
  In Kamalika Chaudhuri and Masashi Sugiyama, editors, Proceedings of Machine Learning Research, volume 89 of Proceedings of Machine Learning Research, pages 606–615. PMLR, 16–18 Apr 2019.
  [pdf]

2018

• Vlad Niculae, André F. T. Martins, and Claire Cardie.
  "Towards Dynamic Computation Graphs via Sparse Latent Structure."
  Conference on Empirical Methods in Natural Language Processing (EMNLP'18), Brussels, Belgium, November 2018.
  [pdf]

• Sameen Maruf, André F. T. Martins, and Gholamreza Haffari.
  "Contextual Neural Model for Translating Bilingual Multi-Speaker Conversations."
  Conference on Machine Translation (WMT'18), Brussels, Belgium, November 2018.
  [pdf]

• Lucia Specia, Frédéric Blain, Varvara Logacheva, Ramón Astudillo, and André F. T. Martins.
  "Findings of the WMT 2018 Shared Task on Quality Estimation." Conference on Machine Translation (WMT'18), Brussels, Belgium, November 2018.
  [pdf]

• Ben Peters, Vlad Niculae, and André F. T. Martins.
  "Interpretable Structure Induction Via Sparse Attention."
  EMNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP'18), Brussels, Belgium, November 2018.
  [pdf]

• Vlad Niculae, André F. T. Martins, Mathieu Blondel, and Claire Cardie.
  "SparseMAP: Differentiable Sparse Structured Inference."
  International Conference on Machine Learning (ICML'18), Stockholm, Sweden, July 2018.
  [pdf]

• Chaitanya Malaviya, Pedro Ferreira, and André F. T. Martins.
  "Sparse and Constrained Attention for Neural Machine Translation."
  Annual Meeting of the Association for Computational Linguistics (ACL'18), Melbourne, Australia, July 2018.
  [pdf]

• Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, André F. T. Martins, and Alexandra Birch.
  "Marian: Fast neural machine translation in C++."
  Annual Meeting of the Association for Computational Linguistics (ACL'18), System Demonstrations, Melbourne, Australia, July 2018. [pdf]

2017

• André F. T. Martins and Julia Kreutzer.
  "Learning What’s Easy: Fully Differentiable Neural Easy-First Taggers."
  Conference on Empirical Methods in Natural Language Processing (EMNLP'17), Copenhagen, Denmark, September 2017.
  [pdf]

• André F. T. Martins, Fábio N. Kepler and José L. Monteiro.
  "Unbabel's Participation in the WMT17 Translation Quality Estimation Shared Task."
  Conference on Machine Translation (WMT 2017), Copenhagen, Denmark, September 2017.
  [draft pdf]

• André F. T. Martins, Marcin Junczys-Dowmunt, Fábio Kepler, Ramon Astudillo, Chris Hokamp and Roman Grundkiewicz.
  "Pushing the Limits of Translation Quality Estimation."
  Transactions of the Association for Computational Linguistics, 5: 205--218, 2017.
  [pdf]

2016

• Zita Marinho, André F. T. Martins, Shay Cohen and Noah A. Smith.
  "Semi-Supervised Learning of Sequence Models with Method of Moments."
  Conference on Empirical Methods in Natural Language Processing (EMNLP'16), Austin, USA, November 2016.
  [pdf]

• André F. T. Martins, Ramon Astudillo, Chris Hokamp and Fábio Kepler.
  "Unbabel's Participation in the WMT16 Word-Level Translation Quality Estimation Shared Task."
  Conference on Machine Translation (WMT 2016), Berlin, Germany, August 2016.
  Best results in the shared task.
  pdf

• Daniel C. Ferreira, André F. T. Martins, and Mariana S. C. Almeida.
  "Jointly Learning to Embed and Predict with Multiple Languages."
  Annual Meeting of the Association for Computational Linguistics (ACL'16), Berlin, Germany, August 2016.
  [pdf]

• André F. T. Martins and Ramon Astudillo.
  "From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification."
  International Conference on Machine Learning (ICML'16), New York, USA, June 2016.
  [pdf]

2015

• Daniel Fernández-González and André F. T. Martins.
  "Parsing as Reduction."
  Annual Meeting of the Association for Computational Linguistics (ACL'15), Beijing, China, July 2015.
  [pdf] | [code]

• Mariana S. C. Almeida, Cláudia Pinto, Helena Figueira, Pedro Mendes, and André F. T. Martins.
  "Aligning Opinions: Cross-Lingual Opinion Mining with Dependencies."
  Annual Meeting of the Association for Computational Linguistics (ACL'15), Beijing, China, July 2015.
  [pdf]

• André F. T. Martins.
  "Transferring Coreference Resolvers with Posterior Regularization."
  Annual Meeting of the Association for Computational Linguistics (ACL'15), Beijing, China, July 2015.
  [pdf]

• André F. T. Martins, Mário A. T. Figueiredo, Pedro M. Q. Aguiar, Noah A. Smith, Eric P. Xing.
  "AD3: Alternating Directions Dual Decomposition for MAP Inference in Graphical Models."
  Journal of Machine Learning Research, 16(Mar): 495--545, 2015.
  [pdf] | [code]

• Mariana S. C. Almeida and André F. T. Martins.
  "Lisbon: Evaluating TurboSemanticParser on Multiple Languages and Out-of-Domain Data."
  Proceedings of International Workshop on Semantic Evaluation (SemEval'15), task 18: Broad Coverage Semantic Dependency Parsing, Denver, USA, June 2015.
  [pdf] | [code]

2014

• Renato Negrinho and André F. T. Martins.
  "Orbit Regularization."
  Neural Information Processing Systems (NIPS'14), Montreal, Canada, December 2014.
  [pdf] | [supplementary material]

• André F. T. Martins.
  "AD3: A Fast Decoder for Structured Prediction."
  In Advanced Structured Prediction, Sebastian Nowozin, Peter V. Gehler, Jeremy Jancsary, and Christoph H. Lampert, Eds.
  The MIT Press, 2014.
  [pdf] | [code]

• André F. T. Martins and Mariana S. C. Almeida.
  "Priberam: A Turbo Semantic Parser with Second Order Features."
  Proceedings of International Workshop on Semantic Evaluation (SemEval'14), task 8: Broad Coverage Semantic Dependency Parsing, Dublin, Ireland, August 2014.
  [pdf] | [code]

• Mariana S. C. Almeida, Miguel B. Almeida, and André F. T. Martins.
  "A Joint Model For Quotation Attribution and Coreference Resolution."
  Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL'14), Gothenburg, Sweden, April 2014.
  [pdf]

• Miguel B. Almeida, Mariana S. C. Almeida, André F. T. Martins, Helena Figueira, Pedro Mendes, and Cláudia Pinto.
  "A New Multi-Document Summarization Corpus for European Portuguese."
  Proceedings of the Language Resources and Evaluation Conference (LREC'14), Reykjavik, Iceland, May 2014.
  [pdf]

• Dipanjan Das, Desai Chen, André F. T. Martins, Nathan Schneider, and Noah A. Smith.
  "Frame-Semantic Parsing."
  Computational Linguistics 40:1, pages 9-56, 2014.
  [pdf]

2013

• André F. T. Martins, Miguel B. Almeida, and Noah A. Smith.
  "Turning on the Turbo: Fast Third-Order Non-Projective Turbo Parsers."
  Annual Meeting of the Association for Computational Linguistics (ACL'13), Sofia, Bulgaria, August 2013.
  [pdf] | [code]

• Miguel B. Almeida and André F. T. Martins.
  "Fast and Robust Compressive Summarization with Dual Decomposition and Multi-Task Learning."
  Annual Meeting of the Association for Computational Linguistics (ACL'13), Sofia, Bulgaria, August 2013.
  [pdf]