Observe ZDNET: Add us as a most popular supply on Google.
ZDNET’s key takeaways
- Fable 5 accelerates AI’s success fee on distant duties to 16%.
- AI capabilities stay everywhere in the map.
- Nonetheless, agent expertise have “quadrupled in below eight months,” mentioned CAIS.
After a short hiatus, Anthropic’s lauded Fable 5 mannequin is again, and it is resetting the bar for automating work.
The US authorities re-authorized the mannequin — which Anthropic mentioned shares functionality similarities with Mythos 5, nonetheless solely obtainable for choose organizations’ use — on June 30. However earlier than it was pulled, the Middle for AI Security (CAIS) examined Fable 5 on its Distant Labor Index (RLI), launched in October 2025. It blew Anthropic’s Opus 4.8 and OpenAI’s GPT-5.5, every comparatively new and regarded spectacular, out of the water.
Additionally: The right way to beat the AI algorithm and get the job of your desires
RLI measures “how usually AI brokers can full actual, economically useful freelance tasks […] at a top quality a paying consumer would truly settle for,” CAIS defined within the examine. These can embody computer-assisted and graphic design, knowledge evaluation, video work, and extra. As in different comparable human capacity assessments, every deliverable the fashions create is evaluated by people towards knowledgeable commonplace deliverable. The ensuing automation fee displays the distribution of tasks the place evaluators discovered what the AI produced to be pretty much as good as or higher than human skilled work.
CAIS requested Fable 5, GPT-5.5, and Opus 4.8 to design a 3D mockup of an engagement ring, create a video advert, and map a ground plan, amongst different assessments. Researchers gave every mannequin human-generated enter recordsdata to get began, equally to the way you’d prep a human freelancer with related paperwork and knowledge for a job.
Additionally: Anthropic’s Mythos is evolving sooner than anticipated, experiences AI security company
Fable 5 hit an automation fee of 16.1%, a file for the benchmark — and double Opus 4.8, which scored 8.3%. GPT‑5.5 got here in third at 6.3%, however CAIS famous that each one three fashions scored increased than each mannequin it is evaluated to date.
“For context, the earlier printed chief sat at 4.17% (Opus 4.6 with the Claude Cowork scaffold), and the sector topped out at 2.5% when RLI was launched,” CAIS mentioned. “The frontier has greater than quadrupled in below eight months, a concrete sign of how rapidly economically succesful AI brokers are advancing.”
Automation charges measured by CAIS towards its RLI benchmark.
CAIS
CAIS famous that its testing was lower brief by the federal government shutting down Fable 5 in mid-June, however that even these partial outcomes set the mannequin aside.
“Even below the worst-case assumption that Fable 5 failed each lacking undertaking, its automation fee would nonetheless be 14.6%, increased than some other mannequin,” the researchers mentioned.
What this implies for freelancers
Whereas the speed of AI mannequin acceleration is critical in only a few months, that does not robotically translate to freelance job substitute or loss throughout the board. Sixteen % is not anyplace near 100% but. Past that, regardless of demonstrable positive factors, AI is not a flawlessly interesting remedy for each group; safety considerations and different adoption roadblocks usually make integrating AI instruments gradual, multi-step processes for many firms, no less than to start out. With the intention to totally exchange human freelancers, organizations would possible want a community of brokers to examine parts like work high quality, funds, and timeline; the tradeoff is not one-to-one.
Additionally: I had Gemini and Claude write my electronic mail replies – however just one seems like me
CAIS tried to switch the human evaluator with an “LLM choose,” ostensibly to see how far-off from human-in-the-loop this experiment might fairly get, however the mannequin failed.
“Evaluating an RLI deliverable is itself a demanding, agentic activity,” CAIS defined. “Doing it correctly means opening the undertaking’s recordsdata in the best skilled functions, working these functions competently, and forming a judgment the way in which a consumer would, the very computer-use expertise that right this moment’s brokers are nonetheless weakest at.”
Additionally: How I set OpenAI API utilization limits to cease agent overspending and different AI billing nightmares
That mentioned, enhancing skills might shrink some freelance alternatives for particular firms already efficiently integrating AI. As well as, if computer-use expertise are the present limitation and poised to enhance primarily based on the trade’s funding in more and more agentic fashions, that roadblock might finally disappear. On the fee fashions have been enhancing on different benchmarks that measure agentic talent, that will arrive before we will think about.
Talking of time: CAIS additionally discovered that when a activity takes longer for a human, that does not essentially imply it will likely be tougher for AI to finish. That point-horizon evaluation holds true for coding, for instance, however not the broader array of distant duties RLI measures for. Proper now, it is laborious to attract conclusions from that for the long run.
“Some work that’s fast for a talented skilled stays out of attain [for AI], comparable to transcribing music or playtesting a real-time recreation, whereas different work that may take an individual hours, comparable to digital artwork or coding, is completed by present fashions in minutes,” CAIS wrote.
