A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure “general intelligence”.
On December 20, OpenAI’s o3 system scored 85% on the ARC-AGI benchmark, well above the previous AI best score of 55% and on par with the average human score. It also scored well on a very difficult mathematics test.
Creating artificial general intelligence, or AGI, is the stated goal of all the major AI research labs. At first glance, OpenAI appears to have at least made a significant step towards this goal.
While scepticism remains, many AI researchers and developers feel something just changed. For many, the prospect of AGI now seems more real, urgent and closer than anticipated. Are they right?
Generalisation and intelligence
To understand what the o3 result means, you need to understand what the ARC-AGI test is all about. In technical terms, it’s a test of an AI system’s “sample efficiency” in adapting to something new – how many examples of a novel situation the system needs to see to figure out how it works.
An AI system like ChatGPT (GPT-4) is not very sample efficient. It was “trained” on millions of examples of human text, constructing probabilistic “rules” about which combinations of words are most likely.
The result is pretty good at common tasks. It is bad at uncommon tasks, because it has less data (fewer samples) about those tasks.
Until AI systems can learn from small numbers of examples and adapt with more sample efficiency, they will only be used for very repetitive jobs and ones where the occasional failure is tolerable.
The ability to accurately solve previously unknown or novel problems from limited samples of data is known as the capacity to generalise. It is widely considered a necessary, even fundamental, element of intelligence.
Grids and patterns
The ARC-AGI benchmark tests for sample efficient adaptation using little grid square problems like the one below. The AI needs to figure out the pattern that turns the grid on the left into the grid on the right.
ARC Prize
Each question gives three examples to learn from. The AI system then needs to figure out the rules that “generalise” from the three examples to the fourth.
These are a lot like the IQ tests sometimes you might remember from school.
Weak rules and adaptation
We don’t know exactly how OpenAI has done it, but the results suggest the o3 model is highly adaptable. From just a few examples, it finds rules that can be generalised.
To figure out a pattern, we shouldn’t make any unnecessary assumptions, or be more specific than we really have to be. In theory, if you can identify the “weakest” rules that do what you want, then you have maximised your ability to adapt to new situations.
What do we mean by the weakest rules? The technical definition is complicated, but weaker rules are usually ones that can be described in simpler statements.
In the example above, a plain English expression of the rule might be something like: “Any shape with a protruding line will move to the end of that line and ‘cover up’ any other shapes it overlaps with.”
Searching chains of thought?
While we don’t know how OpenAI achieved this result just yet, it seems unlikely they deliberately optimised the o3 system to find weak rules. However, to succeed at the ARC-AGI tasks it must be finding them.
We do know that OpenAI started with a general-purpose version of the o3 model (which differs from most other models, because it can spend more time “thinking” about difficult questions) and then trained it specifically for the ARC-AGI test.
French AI researcher Francois Chollet, who designed the benchmark, believes o3 searches through different “chains of thought” describing steps to solve the task. It would then choose the “best” according to some loosely defined rule, or “heuristic”.
This would be “not dissimilar” to how Google’s AlphaGo system searched through different possible sequences of moves to beat the world Go champion.
You can think of these chains of thought like programs that fit the examples. Of course, if it is like the Go-playing AI, then it needs a heuristic, or loose rule, to decide which program is best.
There could be thousands of different seemingly equally valid programs generated. That heuristic could be “choose the weakest” or “choose the simplest”.
However, if it is like AlphaGo then they simply had an AI create a heuristic. This was the process for AlphaGo. Google trained a model to rate different sequences of moves as better or worse than others.
What we still don’t know
The question then is, is this really closer to AGI? If that is how o3 works, then the underlying model might not be much better than previous models.
The concepts the model learns from language might not be any more suitable for generalisation than before. Instead, we may just be seeing a more generalisable “chain of thought” found through the extra steps of training a heuristic specialised to this test. The proof, as always, will be in the pudding.
Almost everything about o3 remains unknown. OpenAI has limited disclosure to a few media presentations and early testing to a handful of researchers, laboratories and AI safety institutions.
Truly understanding the potential of o3 will require extensive work, including evaluations, an understanding of the distribution of its capacities, how often it fails and how often it succeeds.
When o3 is finally released, we’ll have a much better idea of whether it is approximately as adaptable as an average human.
If so, it could have a huge, revolutionary, economic impact, ushering in a new era of self-improving accelerated intelligence. We will require new benchmarks for AGI itself and serious consideration of how it ought to be governed.
If not, then this will still be an impressive result. However, everyday life will remain much the same.
Michael Timothy Bennett, PhD Student, School of Computing, Australian National University and Elija Perrier, Research Fellow, Stanford Center for Responsible Quantum Technology, Stanford University
This article is republished from The Conversation under a Creative Commons license. Read the original article.
ADVERTISEMENT:
Informasi mengenai KING SLOT, Segera Daftar Bersama king selot terbaik dan terpercaya no satu di Indonesia. Boleh mendaftar melalui sini king slot serta memberikan hasil kembali yang paling tinggi saat sekarang ini hanyalah KING SLOT paling gacor, gilak dan gaco saat sekarang di Indonesia melalui program return tinggi di kingselot serta pg king slot
suara88 permainan paling top dan garansi imbal balik hasil besar bersama https://suara88.biz/
sumo7777 permainan paling top dan garansi imbal balik hasil besar bersama https://sumo7777.com/
supermoney888 permainan paling top dan garansi imbal balik hasil besar bersama https://supermoney888.biz/
teratai88 permainan paling top dan garansi imbal balik hasil besar bersama https://teratai88.biz/
thor88 permainan paling top dan garansi imbal balik hasil besar bersama https://thor88.biz/
togelhk88 permainan paling top dan garansi imbal balik hasil besar bersama https://togelhk88.net/
topjitu88 permainan paling top dan garansi imbal balik hasil besar bersama https://topjitu88.net/
totosloto88 permainan paling top dan garansi imbal balik hasil besar bersama https://totosloto88.com/
trisula888 permainan paling top dan garansi imbal balik hasil besar bersama https://trisula888.biz/
udangbet88 permainan paling top dan garansi imbal balik hasil besar bersama https://udangbet88.net/
via88 permainan paling top dan garansi imbal balik hasil besar bersama https://via88.biz/
virusjp88 permainan paling top dan garansi imbal balik hasil besar bersama https://virusjp88.net/
warga888 permainan paling top dan garansi imbal balik hasil besar bersama https://warga888.biz/
waw88 permainan paling top dan garansi imbal balik hasil besar bersama https://waw88.biz/
winjitu88 permainan paling top dan garansi imbal balik hasil besar bersama https://winjitu88.net/
wisdom88 permainan paling top dan garansi imbal balik hasil besar bersama https://wisdom88.biz/
wnitogel88 permainan paling top dan garansi imbal balik hasil besar bersama https://wnitogel88.com/
yoyo888 permainan paling top dan garansi imbal balik hasil besar bersama https://yoyo888.biz/
validtoto88 permainan paling top dan garansi imbal balik hasil besar bersama https://validtoto88.com/
sule999 permainan paling top dan garansi imbal balik hasil besar bersama https://sule999.com/
sule88 permainan paling top dan garansi imbal balik hasil besar bersama https://sule88.org/
ss888bet permainan paling top dan garansi imbal balik hasil besar bersama https://ss888bet.com/
sia77 permainan paling top dan garansi imbal balik hasil besar bersama https://sia77.info/
seluang88 permainan paling top dan garansi imbal balik hasil besar bersama https://seluang88.com/
satu88 permainan paling top dan garansi imbal balik hasil besar bersama https://satu88.biz/
satu777 permainan paling top dan garansi imbal balik hasil besar bersama https://satu777.asia/
rp88 permainan paling top dan garansi imbal balik hasil besar bersama https://rp88.biz/
rp88 permainan paling top dan garansi imbal balik hasil besar bersama https://rp88.asia/
rp88 permainan paling top dan garansi imbal balik hasil besar bersama https://rp77.live/
qiuqiu88 permainan paling top dan garansi imbal balik hasil besar bersama https://qiuqiu88.biz/
pt88 permainan paling top dan garansi imbal balik hasil besar bersama https://pt88.org/
pt77 permainan paling top dan garansi imbal balik hasil besar bersama https://pt77.info/
produk88 permainan paling top dan garansi imbal balik hasil besar bersama https://produk88.asia/
mt88 permainan paling top dan garansi imbal balik hasil besar bersama https://mt88.org/
mt77 permainan paling top dan garansi imbal balik hasil besar bersama https://mt77.biz/
menang66 permainan paling top dan garansi imbal balik hasil besar bersama https://menang66.biz/
latobet888 permainan paling top dan garansi imbal balik hasil besar bersama https://latobet888.org/
kedai96 permainan paling top dan garansi imbal balik hasil besar bersama https://kedai96.org/
kedai188 permainan paling top dan garansi imbal balik hasil besar bersama https://kedai188.biz/
ids88 permainan paling top dan garansi imbal balik hasil besar bersama https://ids88.biz/
hp88 permainan paling top dan garansi imbal balik hasil besar bersama https://hp88.org/
hp77 permainan paling top dan garansi imbal balik hasil besar bersama https://hp77.org/
gm88 permainan paling top dan garansi imbal balik hasil besar bersama https://gm88.asia/
gm77 permainan paling top dan garansi imbal balik hasil besar bersama https://gm77.net/
final888 permainan paling top dan garansi imbal balik hasil besar bersama https://final888.org/
duit88 permainan paling top dan garansi imbal balik hasil besar bersama https://duit88.asia/
duit168 permainan paling top dan garansi imbal balik hasil besar bersama https://duit168.biz/
divisi88 permainan paling top dan garansi imbal balik hasil besar bersama https://divisi88.org/
dewi500 permainan paling top dan garansi imbal balik hasil besar bersama https://dewi500.biz/
devil88 permainan paling top dan garansi imbal balik hasil besar bersama https://devil88.info/
cuputoto88 permainan paling top dan garansi imbal balik hasil besar bersama https://cuputoto88.com/
cukongbet88 permainan paling top dan garansi imbal balik hasil besar bersama https://cukongbet88.asia/
bom888 permainan paling top dan garansi imbal balik hasil besar bersama https://bom888.biz/
bintaro888 permainan paling top dan garansi imbal balik hasil besar bersama https://bintaro888.info/
askasino88 permainan paling top dan garansi imbal balik hasil besar bersama https://askasino88.org/
999aset permainan paling top dan garansi imbal balik hasil besar bersama https://999aset.com/
afb77 permainan paling top dan garansi imbal balik hasil besar bersama https://afb77.biz/
aset99 permainan paling top dan garansi imbal balik hasil besar bersama https://aset99.biz/
bendera77 permainan paling top dan garansi imbal balik hasil besar bersama https://bendera77.biz/
bendera888 permainan paling top dan garansi imbal balik hasil besar bersama https://bendera888.com/
coco88 permainan paling top dan garansi imbal balik hasil besar bersama https://coco88.org/
cuma77 permainan paling top dan garansi imbal balik hasil besar bersama https://cuma77.biz/
cuma88 permainan paling top dan garansi imbal balik hasil besar bersama https://cuma88.org/
dwv88 permainan paling top dan garansi imbal balik hasil besar bersama https://dwv88.org/
fafajp88 permainan paling top dan garansi imbal balik hasil besar bersama https://fafajp88.com/
gemar88 permainan paling top dan garansi imbal balik hasil besar bersama https://gemar88.biz/
gocap88 permainan paling top dan garansi imbal balik hasil besar bersama https://gocap88.info/
gocaptoto permainan paling top dan garansi imbal balik hasil besar bersama https://gocaptoto.asia/
hakabet88 permainan paling top dan garansi imbal balik hasil besar bersama https://hakabet88.com/
hwtoto88 permainan paling top dan garansi imbal balik hasil besar bersama https://hwtoto88.org/
ina77 permainan paling top dan garansi imbal balik hasil besar bersama https://ina77.biz/
ina88 permainan paling top dan garansi imbal balik hasil besar bersama https://ina88.info/
jingga8888 permainan paling top dan garansi imbal balik hasil besar bersama https://jingga8888.com/
juragan777 permainan paling top dan garansi imbal balik hasil besar bersama https://juragan777.asia/
kastil77 permainan paling top dan garansi imbal balik hasil besar bersama https://kastil77.info/
kebo888 permainan paling top dan garansi imbal balik hasil besar bersama https://kebo888.biz/
kkwin77 permainan paling top dan garansi imbal balik hasil besar bersama https://kkwin77.com/
kokoslot88 permainan paling top dan garansi imbal balik hasil besar bersama https://kokoslot88.asia/
luckydf88 permainan paling top dan garansi imbal balik hasil besar bersama https://luckydf88.org/
microstar888 permainan paling top dan garansi imbal balik hasil besar bersama https://microstar888.biz/
monperatoto88 permainan paling top dan garansi imbal balik hasil besar bersama https://monperatoto88.com/
mpo1122 permainan paling top dan garansi imbal balik hasil besar bersama https://mpo1122.biz/
mpo122 permainan paling top dan garansi imbal balik hasil besar bersama https://mpo122.biz/
mpopelangi88 permainan paling top dan garansi imbal balik hasil besar bersama https://mpopelangi88.com/
pamanslot88 permainan paling top dan garansi imbal balik hasil besar bersama https://pamanslot88.biz/
panel88 permainan paling top dan garansi imbal balik hasil besar bersama https://panel88.org/
paragon77 permainan paling top dan garansi imbal balik hasil besar bersama https://paragon77.biz/
paragon888 permainan paling top dan garansi imbal balik hasil besar bersama https://paragon888.info/
pion77 permainan paling top dan garansi imbal balik hasil besar bersama https://pion77.biz/
prada88 permainan paling top dan garansi imbal balik hasil besar bersama https://prada88.asia/
prada888 permainan paling top dan garansi imbal balik hasil besar bersama https://prada888.com/
qqslot88slot permainan paling top dan garansi imbal balik hasil besar bersama https://qqslot88slot.com/
rejekibet88 permainan paling top dan garansi imbal balik hasil besar bersama https://rejekibet88.com/
rezekibet88 permainan paling top dan garansi imbal balik hasil besar bersama https://rezekibet88.org/
sensa77 permainan paling top dan garansi imbal balik hasil besar bersama https://sensa77.biz/
sensa888 permainan paling top dan garansi imbal balik hasil besar bersama https://sensa888.biz/
singajp88 permainan paling top dan garansi imbal balik hasil besar bersama https://singajp88.com/
sr77 permainan paling top dan garansi imbal balik hasil besar bersama https://sr77.org/
sr88 permainan paling top dan garansi imbal balik hasil besar bersama https://sr88.org/
surya77 permainan paling top dan garansi imbal balik hasil besar bersama https://surya77.biz/
surya88 permainan paling top dan garansi imbal balik hasil besar bersama https://surya88.asia/
tajir77 permainan paling top dan garansi imbal balik hasil besar bersama https://tajir77.info/
tajir88 permainan paling top dan garansi imbal balik hasil besar bersama https://tajir88.biz/
toto122 permainan paling top dan garansi imbal balik hasil besar bersama https://toto122.com/
toto123 permainan paling top dan garansi imbal balik hasil besar bersama https://toto123.biz/
uangvip88 permainan paling top dan garansi imbal balik hasil besar bersama https://uangvip88.com/
wajik77 permainan paling top dan garansi imbal balik hasil besar bersama https://wajik77.asia/
777neko permainan paling top dan garansi imbal balik hasil besar bersama https://777neko.org/
88judi permainan paling top dan garansi imbal balik hasil besar bersama https://88judi.net/
99judi permainan paling top dan garansi imbal balik hasil besar bersama https://99judi.org/
abcslot88 permainan paling top dan garansi imbal balik hasil besar bersama https://abcslot88.asia/
slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
akun demo slot gacor permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
akun slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
akun demo slot pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
akun slot demo pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
akun slot demo permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
akun demo slot permainan paling top dan garansi imbal balik hasil besar bersama https://kdwapp.com/
slot demo gacor
akun demo slot gacor
akun slot demo gacor
akun demo slot pragmatic
akun slot demo pragmatic
akun slot demo
akun demo slot
slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
akun demo slot gacor permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
akun slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
akun demo slot pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
akun slot demo pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
akun slot demo permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
akun demo slot permainan paling top dan garansi imbal balik hasil besar bersama https://jebswagstore.com
slot demo gacor
akun demo slot gacor
akun slot demo gacor
akun demo slot pragmatic
akun slot demo pragmatic
akun slot demo
akun demo slot
slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
akun demo slot gacor permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
akun slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
akun demo slot pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
akun slot demo pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
akun slot demo permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
akun demo slot permainan paling top dan garansi imbal balik hasil besar bersama https://demoslotgacor.pro
slot demo gacor
akun demo slot gacor
akun slot demo gacor
akun demo slot pragmatic
akun slot demo pragmatic
akun slot demo
akun demo slot
slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
akun demo slot gacor permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
akun slot demo gacor permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
akun demo slot pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
akun slot demo pragmatic permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
akun slot demo permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
akun demo slot permainan paling top dan garansi imbal balik hasil besar bersama https://situsslotterbaru.net
slot demo gacor
akun demo slot gacor
akun slot demo gacor
akun demo slot pragmatic
akun slot demo pragmatic
akun slot demo
akun demo slot
situs slot terbaru
slot terbaru
