but back to the topic: I’m quite shocked that PaLM gets outclassed by much smaller models on a regular basis. I would have thought that Google, despite not having a moat, at least had enough talent and focus to get LLMs right. But what I’m observing is that startups like ClosedAI, Anthrophic, etc. constantly beat big players like Google in their own game.
this is for investors. while some companies actually build useful models, some like inflection are still catching up with palm-2, an old, forgotten, measly model.
I have absolutely no inside info or actual knowledge to back up this hunch, but part of me thinks Google released PaLM2 just to get something out the door that was somewhat comparable to OpenAI's models.
That way they can say they put something out and that they're "competing", but internally, maybe they're really looking forward to (and working on) their next-gen AI models. Something to compete with a hypothetical future GPT-5, but maybe they're looking to get their version out faster than OpenAI can. I feel like Google is really going to give it their all on the next-gen model they release (not PaLM 2, but whatever they're working on after it).
Yes, PaLM and Bard have existed internally for years but Google just didn't release them. Imagen, which is better than Midjourney or Stable Diffusion, also hasn't been released.
reply