Cohere Technologies' Command Beta model made a significant achievement by securing the top position in Stanford University's HELM (Holistic Evaluation of Language Models) competition earlier this month. Among the participants, Cohere's model stood out among 36 large language models (LLMs), such as Meta's Galactica, OpenAI's Davinci, Google's Flan, Bloom, and more.
Despite the accolade, Ed Grefenstette, the Head of Machine Learning at Cohere, remained admirably modest, considering the achievement a "nice marketing moment" rather than a definitive success.
“Leaderboards are always things that you should take with a grain of salt. We do not want to be complacent and imagine that just because we topped this leaderboard, we will be better than other models close behind us,” said Grefe
Navigating the AI Landscape: Ed Grefenstette on Cohere’s Milestone Achievement and the Quest for AGI
- By 재은
- Published on
Cohere Technologies’ Command Beta model made a significant achievement by securing the top position in Stanford University’s HELM (Holistic Evaluation of Language Models) competition earlier this month. Among the participants, Cohere’s model stood out among 36 large language models (LLMs), such as Meta’s Galactica, OpenAI’s Davinci, Google’s Flan, Bloom, and more. Despite the accolade, Ed […]
