While generative artificial intelligence (AI) models backed by centralized cloud infrastructure — such as ChatGPT — currently lead on overall performance, new research shows that open-source competitors are catching up.
The current market leaders of generative AI, such as Google and OpenAI, took a centralized approach to building their infrastructure — effectively limiting public access to various information, including the data sources used for the training model.
This could change, the research team at Cathy Wood’s ARK Invest claims, suggesting the possibility of open-source AI models outperforming their centralized counterparts by 2024.
MMLU performance of open-source and private AI models. Source: AKR Invest
The above graph shows the progress made by open-source AI models since 2022, a few of which ended up performing better than private models. OpenAI, Google and its parent company, Alphabet, dominate the centralized AI space with popular models like ChatGPT-4 and Gemini Ultra. On the other hand, Meta (formerly Facebook), Mistral and a few Chinese AI models opted for an open-source approach.
Check out @ARKInvest’s update of the performance of open source vs closed #AI models. Open source LLM models still are gaining ground, though the dispersion is increasing. Thanks @downingARK and @JozefARK for keeping us up to date on the most important tech race in history! https://t.co/hiikHFJYwr
— Cathie Wood (@CathieDWood) December 14, 2023
In 2023, Yi 34B, Falcon 180B and Mixtral 8x7B emerged as some of the top open-source AI that showcased comparable performance to market leaders. ARK Invest researcher Jozef Soja noted that Mixtral beat GPT 3.5 on absolute log error of performance on Massive Multitask Language Understanding (MMLU) benchmarking while highlighting “just how far ahead of the pack GPT-4 is currently”.
Additionally, Meta’s foundational model, LLaMA, also recorded a significant improvement in its 2023 iterations. The need for performance in open-source AI models stems from the importance of democratizing access to generative AI, said AI engineer Brian Roemmele.
Related: ChatGPT passes neurology exam for first time
The current AI market leaders — Google’s Gemini and OpenAI’s ChatGPT-4 — were recently put to the test. Cointelegraph asked the free versions of Gemini (via Bard) and ChatGPT-4 several questions about cryptocurrencies and compared the answers.
In both cases, the AI took a similar approach in warning users when asked about investment advice and recommended seeking a professional financial adviser for more “personalized advice.” Additionally, both AI models provided answers that highlighted similar points of consideration despite offering different details in some cases.
Magazine: Terrorism & Israel-Gaza war weaponized to destroy crypto
