Advanced AI Models Fail Math Tests
This is a news story, published by Live Science, that relates primarily to AI news.
News about Ai research
For more Ai research news, you can click here:
more Ai research newsLive Science news
For more news from Live Science, you can click here:
more news from Live ScienceAbout the Otherweb
Otherweb, Inc is a public benefit corporation, dedicated to improving the quality of news people consume. We are non-partisan, junk-free, and ad-free. We use artificial intelligence (AI) to remove junk from your news feed, and allow you to select the best tech news, business news, entertainment news, and much more. If you like this article about Ai research, you might also like this article about
AI tests. We are dedicated to bringing you the highest-quality news, junk-free and ad-free, about your favorite topics. Please come every day to read the latest research institute Epoch AI news, benchmark tests news, news about Ai research, and other high-quality news about any topic that interests you. We are working hard to create the best news aggregator on the web, and to put you in control of your news feed - whether you choose to read the latest news through our website, our news app, or our daily newsletter - all free!
Epoch AILive Science
•Mathematicians have devised new problems to challenge the most advanced AI systems' reasoning capabilities — and they failed almost every test
78% Informative
The most advanced AI models on the market got correct answers on less than 2% of these problems.
The new set of benchmarks, called FrontierMath , aims for a higher level of reasoning.
The findings show that right now, AI models don't possess research-level math reasoning.
VR Score
90
Informative language
98
Neutral language
13
Article tone
formal
Language
English
Language complexity
58
Offensive language
not offensive
Hate speech
not hateful
Attention-grabbing headline
not detected
Known propaganda techniques
not detected
Time-value
long-living
External references
4
Source diversity
3