Despite the generative artificial intelligence (AI) race just beginning, Sam Altman says that the research strategy that birthed chatbot technology is played out. π€
The CEO of OpenAI, which created ChatGPT, noted that progress over the last few years has been created by taking existing machine-learning algorithms and scaling them up to massive size. For example, GPT-4 was trained using trillions of words of text and thousands of computer chips, costing over $100 million. π°
However, Altman says further progress won’t come from making bigger models, as his estimates suggest there are diminishing returns. That could suggest that GPT-4 could be the last product of the company’s strategy of making bigger models and feeding them more data. However, he didn’t specify what other methods the company could use to further progress.
That could throw the many well-funded startups that are spending tons of resources on building larger algorithms for a loop. π¬
Regardless, generative AI news continues to flow these days. π°
For example, Alphabet shares fell nearly 3% on news that Samsung is reportedly considering using Bing’s search engine for its products instead. Meanwhile, in a CBS “60 Minutes” interview, Google CEO Sundar Pichai suggested that society isn’t prepared for the rapid advancement of AI. He noted that regulators are behind the curve and that laws for AI advancements are “not for a company to decide” alone. Ultimately, he warned that AI will impact “every product of every company.” β οΈ
Elon Musk seems to agree, jumping into the competition with a new company called X.AI Corporation, which will focus on developing AI solutions.
And lastly, a new Drake x The Weeknd track blew up over the weekend, amassing millions of views. The only catch is that it’s actually an AI fake. The viral moment is a stark reminder of the vast application of AI to a variety of tasks, as well as the fact that the “rules of the AI game” are still very gray. π€