Meta’s benchmarks for its new AI models are a bit misleading

TechCrunch
By Kyle WiggersApr 6, 2025, 5:16 pm221 ptsTop
One of the new flagship AI models Meta released on Saturday, Maverick, ranks second on LM Arena, a test that has human raters compare the outputs of models and choose which they prefer. But it seems the version of Maverick that Meta deployed to LM Arena differs from the version that’s widely available to…

Read Article Share
Share Article
- email
- twitter
- facebook
- pocket
- reddit
- tumblr
- linkedin
- pinterest

Trending Today on Tech News Tube

Wyden blocks Trump's CISA boss nominee, blames cyber agency for 'actively hiding info' about telecom insecurity

The Register

Wyden blocks Trump's CISA boss nominee, blames cyber agency for 'actively hiding info' about telecom insecurity 128

Whistleblower Sarah Wynn-Williams accuses Meta of colluding with China

TechCrunch

Whistleblower Sarah Wynn-Williams accuses Meta of colluding with China 120

Anthropic Launches Its Own $200 Monthly Plan

Slashdot

Anthropic Launches Its Own $200 Monthly Plan 116

Slashdot

Bank of England Says AI Software Could Create Market Crisis For Profit 115

TechCrunch

AI models still struggle to debug software, Microsoft study shows 108

Framework’s entry-level modular Laptop 12 starts at £499

The Verge

Framework’s entry-level modular Laptop 12 starts at £499 107

Sonos appoints software veteran Hugo Barra to its board after app troubles

The Verge

Sonos appoints software veteran Hugo Barra to its board after app troubles 106

Auto tariffs take effect, components supply chain hit hardest

Digitimes

Auto tariffs take effect, components supply chain hit hardest 105

About Tech News Tube

Tech News Tube is a real time news feed of the latest technology news headlines.

Follow all of the top tech sites in one place, on the web or your mobile device.

Featured

OK great, UK is building loads of AI…

OK great, UK is building loads of AI datacenters. How are we going to power…

Meta's AI, built on ill-gotten content,…

Meta's AI, built on ill-gotten content, can probably build a digital you