Baidu’s Ernie Bot Outperforms OpenAI’s ChatGPT in Crucial Assessments
Chinese search engine Baidu announced on Tuesday that its chatbot, powered by an artificial intelligence model called Ernie, surpassed OpenAI’s ChatGPT in several significant areas.
Baidu has been conducting public tests of the Ernie Bot in China since its unveiling in March. Ernie Bot is built upon Baidu’s foundational AI model, Ernie, and the latest iteration is known as Ernie 3.5.
Ernie 3.5 Prevails Over OpenAI’s GPT 3.5 and GPT 4 in Chinese Language Tests
Citing the China Science Daily journal, Baidu revealed that Ernie 3.5 outperformed OpenAI’s GPT 3.5 and even the more advanced GPT 4 in Chinese language benchmark tests.
The competition between Baidu and OpenAI showcases the escalating race in generative AI, as technology giants from the United States and China strive to make significant advancements in the field.
Ernie 3.5’s Success in College Admission and Qualification Exams
One of the tests highlighted by the Chinese science journal was based on standard admission and qualification exams, including those required for college admission or to qualify as a lawyer. Ernie 3.5 surpassed both ChatGPT and GPT 4 in the Chinese language segment of the test.
However, in the English language portion, it lagged behind GPT 4 while remaining ahead of ChatGPT. This particular test was released by Microsoft.
Ernie 3.5’s Superiority in Chinese Multiple-Choice Questions
Another evaluation focused on Chinese language skills and encompassed over 13,000 multiple-choice questions across more than 50 subjects. Ernie 3.5 demonstrated superiority over ChatGPT and GPT 4 in this comprehensive assessment.
The results highlight Baidu’s advancements in generative AI and its commitment to leading the technology race, particularly against competitors like Alibaba.
Ernie 3.5’s Performance in General Knowledge Tests
In a third test developed by a group of U.S. universities, covering various subjects such as science and humanities, Ernie 3.5 fell behind both ChatGPT and GPT 4. This test assessed the AI models’ understanding of diverse topics beyond language and showcased areas where Baidu’s technology is still evolving.
Baidu’s Focus on Advancements and Integration of Plugins
Baidu emphasized its progress in AI as it strives to establish a leading position in the field, competing against companies like Alibaba. Notably, Baidu’s latest model, Ernie 3.5, boasts the ability to access “plugins,” enabling the integration of applications within the Ernie Bot ecosystem.
For instance, Baidu’s search feature has been incorporated as a plugin, further expanding the capabilities and functionalities of Ernie Bot.