Welcome to the future! Story here (paywall skip)
It's honestly worth reading, every paragraph is a new list of Bad Stuff! Here's an example of doubling down on hallucinations:
The chatbot responded quickly, stating that Funiciello was alleged to have received money from a lobbying group financed by pharmaceutical companies in order to advocate for the legalization of cannabis products. But the entire corruption allegation against Funiciello was an AI hallucination. To “back up” its baseless allegations, the chatbot linked to five different websites including Funiciello’s own website, her Wikipedia page, a news article where the lawmaker highlights the problem of femicide in Switzerland, and an interview she gave with a mainstream Swiss broadcaster about the issue of consent.
And in its (ineffective) race to protect from the Bad Stuff, it isn't even good at the easy stuff:
In their study, the researchers concluded that a third of the answers given by Copilot contained factual errors and that the tool was “an unreliable source of information for voters.” In 31 percent of the smaller subset of recorded conversations, they found that Copilot offered inaccurate answers, some of which were made up entirely.