ShopSimulator: most agent BuyNow errors skip confirmation
- BuyNow errors: nearly 80%
ShopSimulator: most agent BuyNow errors skip confirmation
Researchers released ShopSimulator, a benchmark that tests LLM shopping agents across full shopping sessions. Nearly 80% of BuyNow errors were purchases made without confirming details or after the user had explicitly rejected the item.
Related essays and timeline events
Hello shoppers, welcome to the world of harness
Everyday shoppers will need a harness for their AI shopping agents. Why confirming every purchase won't work, and why payment, marketplace and agent each own part of it.
Visa benchmark finds AI models failed 42.8% of shopping test runs
Visa released the Visa Agentic Commerce Benchmark, which tested 22 AI models from 12 labs on 15 shopping challenges.
Google rolls out UCP-powered direct checkout to shoppers in Canada
Google began rolling out direct checkout powered by the Universal Commerce Protocol to Canadian shoppers in AI Mode.
Shopify brings Shop Pay checkout into Muse, Claude Duet and Instinct
Shopify's Fall '26 Edition added Shop Pay checkout inside third-party personal AI agents, starting with Meta's Muse, Anthropic's Claude Duet and Instinct, without sharing the card with the agent.
Meta launches Muse in Singapore with Shopee, Grab and six other partners
Meta made its Muse personal agent available in Singapore with eight early local connector partners: Shopee, Grab, Singapore Airlines, Agoda, ShopBack, Klook, Trip.com and Lazada.
Get the next one by email
Original essays on Hard-to-Keyword demand and agentic commerce, plus key protocol milestones. No spam.