https://www.theverge.com/2023/7/10/23790132/google-memo-moat-ai-leak-demis-hassabis
In this link this discussion:
The memo, which was obtained by SemiAnalysis from a public Discord server, says that neither Google nor OpenAI have what they need to succeed in the AI industry. Instead, the researcher claims “a third faction has been quietly eating our lunch”: open-source AI models that the researcher says are “faster, more customizable, more private, and pound-for-pound more capable.”
WHO IS THE THIRD FACTION?
Go a level deeper, beyond this news about news, and read the moat memo.
The third faction is the open source community.
The memo has an entire timeline section, dedicated to showing the speed at which the open source community absorbed and iterated on the leaked facebook model, LaMMa.
The memo puts a lot of emphasis on how google and co are building new models from scratch, over months, with millions of dollars - and yet open source is building patches, in days, with only a few hundred dollars - and the patches stack, and are easily shareable.
The open source models, through these patches, are getting better faster than google can re-architect and re-train new models from scratch.
The main point of the memo is that google needs to change their strategy, if they want to stay “ahead” (some would argue they’re already behind) of the competition.