One of many largest bulletins of Google I/O was the disclosing of PaLM 2, Google’s newest and most superior massive language mannequin (LLM). With the transition to PaLM 2, Google claimed Bard would have enhanced logic, math, and coding capabilities.
At present, it was time to place these skills to the take a look at.
Additionally: I examined Google Bard’s latest coding abilities. It did not go effectively…once more
Since Google Bard not has a waitlist, to get entry, all it’s a must to do is go to Google Bard’s web page and signal into your private Gmail account.
As soon as I did that, I used to be prepared to begin asking away.
The primary noticeable change was that the Bard had the choice of darkish mode, one of many options Google revealed at I/O meant to assist cut back eyestrain when utilizing the chatbot. This was a constructive signal.
Additionally: Learn how to use Google Bard now
Subsequent up, it was time to verify the chatbot’s largest improve, PaLM 2. To confirm the upgrades for myself, I requested the chatbot “What LLM are you working below?”. The response was surpising.
Regardless of Google’s announcement at Google I/O, Bard informed me it was nonetheless working on LaMDA.
I’m working below the Google AI LaMDA language mannequin. LaMDA stands for “Language Mannequin for Dialogue Purposes”.
Screenshot by Sabrina Ortiz/ZDNET
After I adopted up that response by asking, “I assumed you have been working on PaLM 2”, I used to be met with an identical response.
I apologize for the confusion. I’m nonetheless below improvement, and I’m not but capable of run on PaLM 2.
Screenshot by Sabrina Ortiz/ZDNET
Is the chatbot hallucinating and offering incorrect responses because it has previously? Or may the chatbot not been switched to PaLM 2 but, as Google declared yesterday? I reached out to Google for some readability, however the response left me with as many questions as I needed to start with.
“LLMs (Bard included) can hallucinate and current inaccurate info as factual,” mentioned the Google spokesperson.
Additionally: Each main AI function introduced at Google I/O 2023
Bard’s incapacity to precisely say what LLM it’s working on may merely be a hallucination. Nonetheless, one of many largest objectives of utilizing a extra superior LLM for Bard was to lower the variety of hallucinations that occurred.
Regardless of how superior Google claims PaLM 2 is, to date, Bard appears to proceed to be affected by the issues of the previous together with restricted coding skills. Maybe Google overestimated PaLM 2’s capabilities.