AI Won’t Replace Translators
Machine translation has seen many breakthroughs in its 70 years of existence. The concept of machines replacing human translators has been a topic of prediction and discussion from the inception…
Translate with ChatGPT
A very robust machine translation system.
How Good Is Google PaLM at Translation?
But how good is PaLM at translation compared to the standard machine translation encoder-decoder approach?
AACL-IJCNLP 2022 Highlights
The AACL 2022 was held jointly with the IJCNLP from the 20th to the 23rd of November. This was the second edition of the AACL, the Asian chapter of the Association for…
Why the Evaluation of OpenAI Whisper Is Not Entirely Credible
Whisper is evaluated on 6 tasks (section 3 of the research paper). I demonstrate that the conclusions drawn from 3 of these evaluation tasks are flawed ❌ or misleading ❌.
COLING 2022 Highlights
More robust evaluation metrics, language models that don’t understand anything, and better evaluation for grammatical error correction COLING 2022 was held in mid-October in Gyeongju (Republic of Korea). This natural language…
Comparing the Uncomparable to Claim the State of the Art: A Concerning Trend
I describe how uncomparable numbers happen to be compared in scientific papers. Then, I review some concrete examples of flawed comparisons from very well-known and recent work, namely, Open AI’s…