Anthropic's extravagant tokenizer complicates AI pricing

The Register
Jul 14, 2026, 2:28 am181 ptsTrendingTop
Claude looks substantially more token-hungry than OpenAI's GPT-5.x, thanks to the new tokenizer that Anthropic shipped with recent releases. Large language models (LLMs) use tokenizers to handle the mapping of text into tokens. There's no set definition of a token, but they're typically a set of three or four…

Read Article Share
Share Article
- email
- x.com
- facebook
- pocket
- reddit
- tumblr
- linkedin
- pinterest

Trending Today on Tech News Tube

Microsoft is losing the battle to protect license lucre. It better get used to the feeling

The Register

Microsoft is losing the battle to protect license lucre. It better get used to the feeling 130

The American Dream is killing me — until I see Billie Joe Armstrong's new Marshall guitar amp (and then I'm as consumerist as they come)

TechRadar

The American Dream is killing me — until I see Billie Joe Armstrong's new Marshall guitar amp (and then I'm as consumerist as they come) 124

Over 200 Economists Say 'We Must Act Now' On AI's Economic Impact

Slashdot

Over 200 Economists Say 'We Must Act Now' On AI's Economic Impact 122

Bosch starts sample production at its first US chip plant after securing up to US$225 million

Digitimes

Bosch starts sample production at its first US chip plant after securing up to US$225 million 121

Roborock Saros 20 Review: Jack of All Trades, Master of Most

Gizmodo

Roborock Saros 20 Review: Jack of All Trades, Master of Most 120

Rambus unveils DDR5 9600 chipset for next-generation AI servers

Digitimes

Rambus unveils DDR5 9600 chipset for next-generation AI servers 119

Commentary: AI computing power map reshapes ASEAN, with Singapore still central

Digitimes

Commentary: AI computing power map reshapes ASEAN, with Singapore still central 119

Intel challenges HBM leaders with XBM and ZAM in a bid to reshape AI memory

Digitimes

Intel challenges HBM leaders with XBM and ZAM in a bid to reshape AI memory 114

About Tech News Tube

Tech News Tube is a real time news feed of the latest technology news headlines.

Follow all of the top tech sites in one place, on the web or your mobile device.

Featured

Tesla makes the cut on California’s…

Tesla makes the cut on California’s newest EV Rebate program

Anthropic's extravagant tokenizer…

Anthropic's extravagant tokenizer complicates AI pricing

Huatian Technology guides first-half…

Huatian Technology guides first-half 2026 net profit up 231-275%, lifted by IC…

Commentary: Terafab and DRAM reveal…

Commentary: Terafab and DRAM reveal Tan's long-term vision for Intel

Apple supplier Lingyi iTech bets big on…

Apple supplier Lingyi iTech bets big on AI with US$590M bid for assets of…

AI demand pushes global ABF substrate…

AI demand pushes global ABF substrate market into shortage, with pressure seen…

Chinese AI glasses startups gain…

Chinese AI glasses startups gain momentum, raising pressure on Taiwan's supply…

GigaDevice director maps memory's next…

GigaDevice director maps memory's next three years: capacity, AI demand, and the…

Flock Says ‘We Hope to Resume’ Work…

Flock Says ‘We Hope to Resume’ Work With LAPD After Getting Dropped

Uber’s product chief on hotels,…

Uber’s product chief on hotels, robotaxis, and why the company doesn’t want…