AMTA 2022 Highlights
I highlight and sum up the AMTA 2022 papers that I found the most original and interesting. I picked papers from the users (see the proceedings) and the research (see…
compare-mt: Because Scoring Your Systems Is Not Enough
I present compare-mt. A very simple tool that gives the user a high-level and coherent view of the salient differences between systems. It exploits statistics usually computed by automatic metrics such…
Comparing the Uncomparable to Claim the State of the Art: A Concerning Trend
I describe how uncomparable numbers happen to be compared in scientific papers. Then, I review some concrete examples of flawed comparisons from very well-known and recent work, namely, Open AI’s…