Anthropic warns AI may soon speed up its own research, $17bn quarter
Anthropic's warning about AI building AI and its quarterly revenue, Google letting schools switch off AI, Apple's age limit on AI companions, Goldman, Canva and AMD.
Anthropic says it may soon hit its threshold for self-improving AI Its updated IPO filing, put out on Monday, says its own forecasts point to soon reaching the point where AI is dramatically speeding up its research, though no current model has crossed that line yet. It says it doesn’t expect Claude to safely build future generations of itself on its own, and is looking at changing its safety rules to keep people in control. Source
Anthropic made $17bn in three months, up from $11.5bn The same filing shows compute ate 58 per cent of that revenue, up from 48 per cent the quarter before, a bill of about $10bn for Anthropic. There’s still no price range for the listing. Source
Google will let schools switch off AI, but Search goes too From next year, Gemini, NotebookLM and Google’s other AI tools will be off for school students unless administrators turn them on. Because AI is now built into Search, schools that block it lose Search as well. Google announced the change on Tuesday. Source
Apple is making AI companion and dating apps 18-plus Any app with dating or romantic features has to carry an 18+ rating, which could catch AI companions like Character.AI and Replika. Apple told developers on Monday, and they have to add the new content labels from 16 November. Source
Goldman Sachs took Claude Code off its traders and bankers Bloomberg reported on Monday that only engineers can use Claude Code and GitHub Copilot now, after months of bankers using them to build their own tools. Goldman’s tech chief was praising vibe coding by non-technical staff as recently as July. The bank says the tools belong with the people best suited to use them. Source
Canva is cutting 1,271 jobs, about 22 per cent of staff Canva told staff on Wednesday, after its growth slowed for the first time in a decade. In August it cut this year’s growth forecast to about 20 per cent, saying the cost of running AI had got ahead of it. Source
AMD’s data centre sales nearly doubled to $8.5bn Its results came out on Tuesday. The new MI450 AI chips launched in the quarter, and total revenue was $13.4bn, up 45 per cent. AMD expects about $17bn next quarter. Source