grok
#ai-news
brisk pasture
hazy mountain
gpt4
fallow folio
fresh basin
https://cdn.discordapp.com/attachments/1376555010820931675/1377677822277062676/2...
IMO this index is pretty silly, as it considers some saturated benchmarks and also static ones (aka: benchmarks that can be contaminated)
deft pine
IMO this index is pretty silly, as it considers some saturated benchmarks and al...
i don't like any of the benchmarks which mix other benchmarks into a single score
fresh basin
this is less of a problem. It is difficult for us (humans) to appreciate many scores at once, so a summary index is good. But it has to be done properly, like weight and other stuff.
A semi decent index IMO would be that posted in #leaderboards some weeks ago: https://nitter.net/scaling01/status/1919389344617414824
deft pine
this is less of a problem. It is difficult for us (humans) to appreciate many sc...
i disagree
amber rune
๐
night forge
It is so good and easy to prompt. It just works
daring sable
hushed birch
hushed birch
deft pine
LOL
balmy river
๐
noble blade
vocal lodge
Gemini 2.5 Pro 06-05 benchmarks, with Opus 4 and DeepSeek R1 0528 too
vocal lodge
https://www.reddit.com/r/privacy/comments/1l3lrq0/openai_slams_court_order_to_save_all_chatgpt_logs/
Court forcing OpenAI to save all chats, even deleted ones
daring sable
https://www.reddit.com/r/privacy/comments/1l3lrq0/openai_slams_court_order_to_sa...
[yup](#ai-news message)
rustic plover
Court forcing OpenAI to save all chats, even deleted ones
I misread it as "OpenAi forcing Court to save all chats" at the beginning for some strange reasons ๐
wild badger
rain nimbus
Do someone konw Claude neptune v2??????
rain nimbus
wanton mountain
amber rune
https://youtu.be/vmrm90u0dHs?si=6QOYfW9Lo-A79pTE
BTW, the claim that o3-pro one-shotted the "Illusion of Thinking" test (10-disk Tower of Hanoi) is not accurate. The answer it gave includes an illegal move (move 96), so it spent 20 minutes and ultimately got it wrong - Wes just didn't properly check it. And the ARC-AGI scores for o3-pro aren't much better than for o3, so everyone please cool your jets.
deft pine
BTW, the claim that o3-pro one-shotted the "Illusion of Thinking" test (10-disk ...
yeah i was very confused with wes roth's video since he admits he didn't properly check it?
wanton mountain
BTW, the claim that o3-pro one-shotted the "Illusion of Thinking" test (10-disk ...
Yeah, I knew about the O3 score thing. I didn't really look too in-depth into the other stuff. But, I don't honestly really care about O3 models all that much. I prefer Google Gemini models.
What I'm excited for is Gemini Deep Think. If O3 Pro didn't really go up that much, but there was some improvement, I think Google could definitely do it better and make some big leaps.
wanton mountain
fluid vortex
AI search is my fav. No drawn out speculative or blatantly incorrect content.
vocal lodge
BTW, the claim that o3-pro one-shotted the "Illusion of Thinking" test (10-disk ...
It's actually worse than o3 (High) and o4-mini (High) on ARC AGI 2, while being more expensive. Claude Opus 4 takes the lead, despite Anthropic's focus on agentic coding.
Gemini 2.5 Pro is at 3.8% and R1 (old) is at 1.3% (higher than the new R1). Source: https://arcprize.org/leaderboard (make sure set filter to ARC AGI 2)
stiff fern
so $7.55 per task for a scoring lower on:
- ARC-AGI-1, than than o3 high, despite 9x price
- ARC-AGI-2, than Sonnet 4 Thinking, despite >15x price
OpenAI continues to throw bruteforce inference at every problem, with overall unimpressive results.
Colour me impressed.
dry anvil
lone mason
Is Gemini 2.5 Pro fully releasing on June 19th?
Because thatโs when it said itโs deprecating the preview version
hushed birch
wanton mountain
deft pine
can we send articles instead of videos like the old days
vocal lodge
Came across this SWE-Bench style benchmark that continuously updates to prevent data contamination (only Python though). It lets you see how the ranking changes depending on how old the problem is.
They only added tool usage and Claude 4 in May though, so it's still pretty new.
https://swe-rebench.com/leaderboard
deft pine
claude 4 released in may
wanton mountain
rain nimbus
Claude 4.1coming soon
wanton mountain
hushed birch
very good interview: https://www.youtube.com/watch?v=giT0ytynSqg
vocal lodge
Current RL amplifies pre-existing reasoning paths rather than forming new ones. Base models outperform RLVR counterparts with enough samples:
https://arxiv.org/abs/2504.13837
daring sable
anthropic did another survey of user conversations focusing on ones where claude supports the human
deft pine
that's kind of clickbait
vocal lodge
Gemini released an Open Source CLI Tool similar to Claude Code but with a free 1 million token context window, 60 model requests per minute and 1,000 requests per day at no charge: https://www.reddit.com/r/LocalLLaMA/comments/1lkbiva/gemini_released_an_open_source_cli_tool_similar/
noble blade
poor implementation + they use your data...
wild badger
They will not expose your computer but when prompting gemini cli in a specific folder, parts of the folder or the entire folder will get sent to Google and possibly used as training data for the next iteration of the gemini model
wild badger
Well I mean the same applies to chatgpt
Everything you ask chatgpt will be used for training unless you have the teams subscription or use the api
Openai also offer a free tier in their api but then data will be used for training
noble blade
Everything you ask chatgpt will be used for training unless you have the teams s...
no you can turn it of in the settings afaik
same for gemini (the app)
but you lose some functionality if you do that
fringe fulcrum
Everything you ask chatgpt will be used for training unless you have the teams s...
No. Most of that data is useless for training
But it can be used, yes.
deft pine
@spice spire kill him
spice spire
<@283397944160550928> kill him
Thanks, but letโs use โbanโ next time please lol
south compass
What does Github Copilot being open source mean?
shrewd hearth
fresh basin
I think that without screening it wouldn't be better than lmarena though.
screening = selecting appropriate prompts and ignoring the others
shrewd hearth
screening = selecting appropriate prompts and ignoring the others
they said experts voted on it so...
shrewd hearth
Maybe there will be a quality assurance process but I'm not sure
fresh basin
exactly. If they ensure that the prompts are appropriate (like the hard prompts in lmarena but even stricter) then it will stay consistent.
versed stump
X
misty flame
It's nice, but when exactly is it going to be deployed by though
This is an industry where 1 year is a huge deal
amber rune
This is an industry where 1 year is a huge deal
It's Oracle, so they'll say it's going to take 18 months, it'll actually take 3-4 years, turn out to be overpriced and completely unfit for purpose, and then Oracle will propose another "18-month" $45B plan for a Datacenter v2. Good thing it's only (checks notes) taxpayer money
shrewd hearth
@spice spire ban
fresh basin
It's Oracle, so they'll say it's going to take 18 months, it'll actually take 3-...
sad but true
vocal lodge
https://allenai.org/blog/sciarena
fluid ravine
Really? I didn't find the new R1 that good though
deft pine
i love the new R1
fluid ravine
i love the new R1
The one running on their Official site is newly updated R1 right?
deft pine
The one running on their Official site is newly updated R1 right?
i wouldn't know but i would think so??
fluid ravine
Idk about the api one but it only thinks for 40 sec in browser and I can see it's thoughts that it didn't follow the instructions properly ๐
olive tiger
noble blade
Ruoming Pang - lead of foundation models at apple was also just reportedly poached
Apple == even more cooked
- also ex-google like most others
hushed birch
X
wanton mountain
scenic hemlock
(Wrong channel, sorry)
noble blade
Some interesting stuff here: https://www.together.ai/blog/deepswe
hushed birch
https://www.youtube.com/watch?v=kxRlN0legRY
is this you?
dry anvil
good find
i've been following him for a year or something
magistral medium passed this last test made by him
hushed birch
wanton mountain
heady orchid
https://x.com/tngtech/status/1940531045432283412
A smarter and faster open weights alternative to R1:
model request link: #1393595735471030342 message
X
finite tartan
https://x.com/tngtech/status/1940531045432283412
A smarter and faster open weigh...
I really like this model and used it already for vibe-coding purposes. It is one of the most trending models on OpenRouter and gained a lot of traction in the AI-community:
https://x.com/lnpaiservices/status/1941671474517115382?s=46
https://x.com/mkuvandzhiev/status/1940768179921223716?s=46
https://x.com/marcel_butucea/status/1941703131823276475?s=46
cosmic elk
wild badger
noble blade
big contamination on math benches
^not from the paper, but a summary
criticising many papers being published on RL'ing qwen 2.5 and reporting results on math-500
because the RL mainly just surfaces the memorised answers
fresh basin
I do think many bench are somewhat contaminated. Even "hyped" ones, like Arc-AGI, USAMO25, Frontier math could be contaminated having people in the labs solve similar hard problems (the ai labs have capable problem solvers at the end) and let the models train on those and thus have a chance to crack the original benchmark.
I mean it is not necessarily bad, because that's how models improve, but it is less of a case of generalization by the models themselves
deft pine
daring sable
wanton mountain
noble blade
https://www.arxiv.org/pdf/2507.12415
SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?
some model might be RL'ed or SFT'ed on these commits, but otherwise very interesting stuff
wanton mountain
Exclusive: Meta Hires Three Google AI Researchers Who Worked on Gold Medal-Winning Model
Meta hires three AI researchers from Google DeepMind who worked on Gemini model that nabbed recent math award.
Read more from @KalleyHuang and @erinkwoo ๐
https://t.co/I25lrXGr6c
daring sable
(this is just a link to the information)
left fiber
wanton mountain
orchid bloom
what the fudge is this?
wanton mountain
deft pine
articles when
wild badger
wanton mountain
wild badger
modest lion
https://arxiv.org/abs/2507.18074
Does anybody know how credible this is and what the realistic implications are? Because i'm kind of sceptical about human ai researchers being irrelevant now.
spring prism
What is GLM 4.5 ?
clever dagger
https://arxiv.org/abs/2507.18074
Does anybody know how credible this is and wha...
Explanation video
wild badger
noble blade
https://arxiv.org/abs/2507.18074
Does anybody know how credible this is and wha...
very representative of the sentiment around the paper, imo
misty forge
Atleast they have released the code and a somewhat detailed paper on how it works
so we will know in due time
noble blade
either way, what they are doing is essentially click bait but for papers
but i am sure that things like this will get explored more in the future literature
and we will probably see big things happening there
its a thing ai is naturally well suited for
fresh basin
https://arxiv.org/abs/2507.18074
Does anybody know how credible this is and wha...
I think the idea of "auto improving AI" is very old. As long as they don't show that with their (alleged) improvement they can provide better models, there isn't much to say.
Further I am pretty sure AI labs are already trying such strategies because of course it would be very good for their revenue if they succeed
and for better model I mean even "we picked a model, we improved it with the discovered ideas, and now it improved X% on many benchmarks, here try it!"
there are also products for such things (although with limited features). https://www.ibm.com/products/watson-studio/autoai I am not aware of any large known model (beside maybe granite) that got out such pipelines.
orchid bloom
considering that a lot of ai research and improvement is kinda like randomly throwing things that sound like it could stick and seeing what does (and a ton of brute force), I have no reason to believe that an ai would be better at making ai.
speaking of which is mixture of experts getting anywhere?
modest lion
considering that a lot of ai research and improvement is kinda like randomly thr...
If brute forcing is truly the way for ai improvements, ai would easily be better then. Computers are just faster than humans.
fresh basin
considering that a lot of ai research and improvement is kinda like randomly thr...
for the interview I read/heard actually top researchers are know for their ability to "smell" good possible research (indeed lowering the random attempts). If all research is too random it would progress very slowly.
so the "kinda random" assertion needs a citation.
glacial notch
If brute forcing is truly the way for ai improvements, ai would easily be better...
computers are NOT faster at scale, not even at easy human tasks like this: https://arxiv.org/html/2504.12256v1 Not even talking about the price tag yet for human tasks, that they account for in other news at the leaderboard of ark-prize
modest lion
computers are NOT faster at scale, not even at easy human tasks like this: https...
There is literally a term called "cpu time" or "gpu time" because gpus can run faster than us simple because you can add a gpu for a few thousand dollars. You can't do that with researchers, atleast not as cheap. List time i checked i couldn't train a robot for 20000 years within a month or so. Gpus can.
orchid bloom
just to be clear when I say brute force, I mean brute force, unless the ai is able to get its hands on more server time it isn't gonna help in that department. Also when I mean throwing things that sound like it could stick I mean big things like architecture changes or improvements like distilling models or reasoning. there's a bunch of different types of chain of thought and a bunch of different concepts that all fit "MoE", and a bunch of them were tried and aren't used anymore and a bunch won't be when we figure out its worse than others.
I recently heard some AI companies are looking into diffusion based llms, makes sense to me.
But its anyone's guess whether in a few years all the flagship models will be diffusion based or if it'll be a passing memory of an idea.
fresh basin
yeah an Idea would be to try (in the most automated but proper way possible) all the ideas from papers that aren't too mainstream. Because mainstream papers get tested already. So that once can find hidden gems. Already checking that is a lot of time and compute to spend on.
clever dagger
Have been testing the stealth model "horizon-alpha" on openrouter which is rumoured to be OpenAI's open source model. It's really good for brainstorming and idea exchange. In my native language "Finnish" it also excels more than in 4o (More diverse loan words, great vocab, minimal amount of typos).
clever dagger
Well, whatever it is... It's good for my usage at least.
raven hull
Well, whatever it is... It's good for my usage at least.
me too the result is very good
orchid bloom
remember not to be tricked, after all deepseek models also used to call themselves "chatgpt" from openAI
wild badger
thick grove
when are the video generations models gonna be on the website ?
spice spire
when are the video generations models gonna be on the website ?
That's TBD, be sure to share what you'd like to see in #bot-feedback
modest lion
Have been testing the stealth model "horizon-alpha" on openrouter which is rumou...
Is it true that Finnland being happy and smart and perfect in every statistic ever is just propaganda?
clever dagger
Is it true that Finnland being happy and smart and perfect in every statistic ev...
No the country's not all perfect
We are more content than "happy" as the stats like to say
fresh basin
mmmh
this test is so overrated. I don' think that system prompts or training data cares to give the model the proper reply. Why? Because at the end of the day no one will find that question useful once you know how the model is called. It is interesting only when it is cloaked but that interest has value for few people.
if one user knows that they are using the model XY, they aren't going to ask "are you really XY?"
vocal lodge
SWE-bench has a new mode which tests models head-on using a minimal framework:
In this setting, we use our mini-SWE-agent package to evaluate LMs in a minimal bash environment. No tools, no special scaffold structure; just a simple ReAct agent loop. Results on SWE-bench Bash Only represent the state-of-the-art LM performance when given just a bash shell and a problem.
Details: https://www.swebench.com/bash-only.html
Reddit post: https://www.reddit.com/r/LocalLLaMA/comments/1m8z2ut/minisweagent_achieves_65_on_swebench_in_just_100/
dense leaf
@spice spire where is possible to see random model in API for random testing lm In lm arena
raw cloak
https://www.cnbc.com/2025/07/25/zuckerberg-shengjia-zhao-meta-ai-lab-chief-scien...
Wow, meta is going very strong in acquiring top talent in AI
Might be worth investing in $meta ๐
amber rune
Might be worth investing in $meta ๐
I did just that, and Iโm up 9% in like three days. But I believe Metas hiring spree could very well be a signal of something that hasnโt been made public yet, so I am hoping for huge returns in the medium term.
wanton mountain
modest lion
Openai open-source models leaked at 20b and 120b and they aren't horizon alpha. Horizon alpha might be some kind of gpt 5 variant and zenith is probably the best one.
daring sable
Openai open-source models leaked at 20b and 120b and they aren't horizon alpha. ...
how do we know horizon alpha isn't the open model?
modest lion
Context windows are different
wanton mountain
deft briar
I used the latest AI, Horizon-Alpha, to generate a piece of light novel literature that Gemini 2.5 Pro considered to be excellent. Unfortunately, at 39,000 characters, I cannot post it here. The Horizon-Alpha AI is an advancement; although hallucinations still occur and it continues the previous issue of tending to repeat certain words, it has shown some natural and expected progress in text generation.
fluid vortex
I think version 1 and 4 have been considered talented at creative writing, though sub par in other areas.
fresh basin
I used the latest AI, Horizon-Alpha, to generate a piece of light novel literatu...
couldn't you post it as txt or as a link to pastebin ?
deft briar
I can send this by email, as I'm not sure if the TXT file can be opened. Over a few hours, I generated about 60,000 characters. This process led me to realize that an earlier version of it was already in the LM Arena back in January. By comparing the output from January with this one, it's clear this is an improved version. Back then, its name would sometimes show as "o1 1217", but it was a rare occurrence.
uneven gale
https://bfl.ai/announcements/flux-1-krea-dev
Go upvote #1400852737977221190 message if you want it in Arena
sturdy coral
hey wanna ask something are you planning to add new models in LMArena Form Image Generation This Month ?
tranquil python
@sturdy coralthis is not the place to ask that you got it wrong dear friend
vocal lodge
https://x.com/AnthropicAI/status/1949898502688903593
This tweet so cryptic, lol.
wild badger
<@&1349916362595635286>
spice spire
<@&1349916362595635286>
little prawn
Will GPT 5 release today?
clever dagger
Will GPT 5 release today?
No. Thursday has been the standard day for publishing their models
Just my guess though
little prawn
No. Thursday has been the standard day for publishing their models
Hope so
lofty vine
Many models are behind
tulip cloud
fluid vortex
That clickbait is next level
amber rune
The paper is from June, it's not exactly breaking news. But it is fascinating. I have been a little bit obsessed with it for a while.
noble blade
The [paper](https://arxiv.org/abs/2506.21734) is from June, it's not exactly bre...
Me to :)
orchid bloom
terse dagger
LOL
vocal lodge
agile panther
rose timber
is there any updates on when gpt-5 is coming out?
bitter pond
today
frozen trench
https://www.kaggle.com/benchmarks
a lot of benchmarks in one place
it's not updated
dark hornet
What about gemini 3 is there any updates on that
round haven
mystic sandal
/video
spice spire
/video
You'll want to use that in #video-arena-1 #video-arena-2 #video-arena-3 more info can be found in #1397655624103493813
clever dagger
You'll want to use that in <#1397655695150682194> <#1400148557427904664> <#14001...
Hello, do you happen to know if GPT-5 mini and nano will be added later to the arena?
spice spire
Hello, do you happen to know if GPT-5 mini and nano will be added later to the a...
It's possible! I wouldn't be able to say if/when, but we are aware of thise models.
orchid bloom
clever dagger
https://www.404media.co/trump-is-launching-an-ai-search-engine-powered-by-perple...
This must be a joke...
fluid dome
https://www.404media.co/trump-is-launching-an-ai-search-engine-powered-by-perple...
Fake
orchid bloom
fluid dome
What websites you be getting this sht from ๐ญ๐
clever dagger
near steppe
peak raven
high ridge
https://openai.com/gpt-5/
worstest model ever...
fringe elm
Is claude gut for boblox scripting guys?๐
clever dagger
Is claude gut for boblox scripting guys?๐
Yes, but don't use the opus model. Too expensive
Just know that prompts will be collected for research. It is not private.
๐
fringe elm
Just know that prompts will be collected for research. It is not private.
Oh ok.
cyan pike
All your conversations are released on hugginface, viewable for everyone
fringe elm
All your conversations are released on hugginface, viewable for everyone
Sorry i didnt meant to offend somone ๐๐
cyan pike
Being honest isnโt an issue, that do most people here to be fair. The whole intent of direct chat invites that use
fluid dome
Sorry i didnt meant to offend somone ๐๐
Chill dude, you ain't offending no one. He's just saying the truth. Remember, nothing is free, you pay for something in exchange no matter what.
fringe elm
Chill dude, you ain't offending no one. He's just saying the truth. Remember, no...
Ig.
clever dagger
All your conversations are released on hugginface, viewable for everyone
Not all. Some prompts will be for private research
"Share a portion"
clever dagger
All your conversations are released on hugginface, viewable for everyone
Whoops I have accidentally uploaded a debug of a 0day 0click Windows RCE exploit ๐
Jk (but it'd be hilarious if I actually did)
clever dagger
BEEF BEEF BEEF BEEF BEEF BEEF BEEF
safe zodiac
will lmarena every support anything more than uploading image files?
spice spire
will lmarena every support anything more than uploading image files?
It's possible, but I'd ask that you share this kind of feedback in our forums where similar requests have been made. This helps us better organize and keep track of what the community is interested in! ( #1394519034116182066)
vocal lodge
https://www.afr.com/technology/china-s-deepseek-falters-in-ai-race-after-chip-issues-20250814-p5mn17
clever dagger
fluid vortex
X
frigid wadi
FxTwitter
bleak turret
Dear devolopers, I've just found the Ai isn't real as written by their name such as: claude opus 4.1 thinking is originally CLAUDE SONNET 3.5, what the hell is this guys, if you guys don't believe me, you can ask like this: Which model are you? And then guys we can clearify they are scamming us!
languid ridge
first of all, touch some grass
secondly, learn to spell
finally, models are not trained on their own details and without being specified in their system prompt or memory, they cannot know what they are, models aren't sentient
full salmon
๐
full salmon
first of all, touch some grass
secondly, learn to spell
finally, models are not ...
Bro thought he discovered something very big
orchid bloom
Dear devolopers, I've just found the Ai isn't real as written by their name such...
Its ok, everyone falls for this eventually
spice spire
first of all, touch some grass
secondly, learn to spell
finally, models are not ...
Thank you for explaining but lets treat others with a bit more respect please
fluid vortex
X
(seems fake idk)
"We welcome third party evaluations using Caesar and will provide API access."
I guess we'll see ...
still frost
seems like a crypto scam
fluid vortex
Yeah :/
vocal lodge
https://fxtwitter.com/openai/status/1956461718097494196?s=46
They could just add something akin to "styles" in Claude, but I think the main issue is that they tried to serve the equivalent of an o3 model without thinking as the default model, to everyone. The non-thinking variant scores poorly compared to the thinking one on LMArena.
fresh basin
https://fxtwitter.com/openai/status/1956461718097494196?s=46
genuine touches like โGood questionโ or โGreat start,โ
"no rise in sycophancy" yeah.
"I am a genius, gpt5 says it"
fluid vortex
Gpt 5 peppers their responses with heart emojies, and calls me bestie now. It's beyond 4o haha
clever dagger
Gpt 5 peppers their responses with heart emojies, and calls me bestie now. It's ...
Oh god no...
deft timber
what happened to robot personality, just make that default with none of that weird feely rubbish
daring sable
caesar
noble blade
https://huggingface.co/nvidia/NVIDIA-Nemotron-Nano-9B-v2
3 new nemotron models
nothing huge, but decent improvements + more opensource info on training from scratch
(and a hybrid model -> faster...)
noble blade
random russian bench i found, similar to vending bench / the pokรฉmon thing
hero bench or something, i guess we will be seeing more of agentic stuff like that
- gp5 and grok4 on top (apparently)
fluid vortex
Gpt 5 peppers their responses with heart emojies, and calls me bestie now. It's ...
Noooo. I said think hard like your life depends on it, and it said this instead of thinking hard. ๐ญ
frigid wadi
fresh basin
https://huggingface.co/nvidia/NVIDIA-Nemotron-Nano-9B-v2
3 new nemotron models
9B models getting so high in AIME 2025? That let me think that some bench are really contaminated.
fresh basin
random russian bench i found, similar to vending bench / the pokรฉmon thing
it would be interesting to know how much scaffolding was there. Otherwise I think - there were discussion online - that the more variegate the benchmarks the better as they put pressure on the models to excel at everything, contamination or not.
orchid bloom
clever dagger
noble blade
9B models getting so high in AIME 2025? That let me think that some bench are re...
prepare to be amazed by mindlink (32b though)
noble blade
it would be interesting to know how much scaffolding was there. Otherwise I thin...
https://arxiv.org/abs/2508.12782
gave it a quick read: ~ "Each model gets a single prompt containing the structured task JSON and must emit one Python program with the exact action sequence; the code is executed once to score success and progress."
misty forge
Basically they call functions like "move_to" "gather" etc and not individual key presses
the benchmark is solely testing long-horizon planning and reasoning, not emergent gameplay capabilities
so it has a pretty hefty "scaffolding"
for a benchmark with little to no scaffolding, VideoGameBench exists https://www.vgbench.com/
the scores are... well
noble blade
i hope the fact that they are not really "playing" the game was obvious, but maybe i just spend too much time in openai gyms (RL)
noble blade
for a benchmark with little to no scaffolding, VideoGameBench exists https://www...
this seems to be an interesting effort though, wonder where this number will be in a couple of years
fluid vortex
X
clever dagger
@spice spire
clever dagger
This came out?
lucid saffron
Hello guys, how can I use nano-banana inside Arena in my own project?
clever dagger
Hello guys, how can I use nano-banana inside Arena in my own project?
in battle mode only, it's pure luck when it gets a turn.
lucid saffron
in battle mode only, it's pure luck when it gets a turn.
I really liked it, the model works beautifully in my projects. I wanted to find its source but couldnโt. Iโd like to purchase its API to integrate it into my mobile application. Thank you for your response.โ๏ธ๐
clever dagger
I really liked it, the model works beautifully in my projects. I wanted to find ...
Today is a google event it is highly likely that it will get officially released then with an API. We just gotta wait.
Pixel 10 event, I mean
lucid saffron
thank you i will watch โค๏ธ
fresh basin
https://arxiv.org/abs/2508.12782
gave it a quick read: ~ "Each model gets a sing...
ty!
fluid vortex
It's the base and idk about greater ctx
Supposedly the API routes to the instruct though :o
jagged onyx
https://x.com/deepsseek/status/1957886077047566613
jagged onyx
Thatโs China.Collects your password.
languid ridge
prepare to be amazed by mindlink (32b though)
how can a 72B model get those results? are those self reported or otherwise?
vocal lodge
how can a 72B model get those results? are those self reported or otherwise?
Yeah SWE-Bench results are sus
noble blade
how can a 72B model get those results? are those self reported or otherwise?
They are self-reported and heavily cherry picked.
They are also odd, considering that their dedicated coding model scored lower, lol
In General the โprepared to be amazedโ was supposed to reference pierโs doubt about another model score
-> I also find the scores sus
tropic ferry
#cricket
hushed birch
this is insane, do you think the larger models gonna incorperate this?
fresh basin
one concept that I don't see often discussed, but that actually is in mails leaked from openai even before gpt3.5, is the concept of AGI or near AGI dictatorship. (one doesn't really need AGI to be fair, being near that is enough)
Hence one can see the thing like an arms race and I have to say Europe is sleeping big on it.
for example with near AGI tools one can create powerful propaganda that then pushes for certain people and then can lock them into power. From the position of power they can use further near AGI tools to do even more. It could be really massive, akin to have MAD weapons. Thus I don't get why some blocks aren't pushing on it (Europe, Russia, India, etc..)
for pushing I mean integrating vertically. One cannot expect a competitor (or worse: hostile competitor) to lend the technology (be it HW or SW) to achieve that. China is the only one that is trying to push as the US (or admittedly US + Taiwan). China is trying to become independent from the US designed HW. Without being independent on that, it becomes hard.
the entire thing reminds me of this https://www.youtube.com/watch?v=ZpBxBuIzbV8
As long as the USSR collaborated with China, China was happy with slow progress. With proper decisions the USSR could have slow down China by a lot.
As soon as the USSR said "nope, not with us", China had to catch up and they were relatively quick in reaching the goal.
With any major technology it could be the same. As long as the dominating power is lending (and thus controlling) it to others, the others lag behind because trying to do everything on their own is costly and the technology is available anyway. It is not blocked by the dominating power at the end.
But if the tech gets blocked (example: "no more Nvidia and AMD multmat chips for you") then the others have a large incentive to catch up. I think that is what is letting Europe and other sleep. They are not blocked but they also don't get much of the needed tech, while Russia is dependent on China for chips.
orchid bloom
.... I really wish people would stop focusing on "agi" so much
A actual product and not a buzzword that still has no real general accepted meaning? (If you are a ai bro you could say a RGAM i guess, they really like acronyms)
Real General Accepted Meaning
People have been pushing for AGI for the past like 10 years, and major companies have claimed breakthroughs in it for that entire time
In completely different tech spaces mind you
"AGI would be the main product
AGI = artificial general intelligence
which is an AI system, which can do everything with a computer what a smart human can do"
= an insane amount of buzzwords that don't mean much
By like 95% of old definitions companies used early versions of gpt 3 counted as AGI
even more buzzwords
"learn endlessly" doesn't have a definition
Thats the point, there isn't a good defintion and even if I had one that wouldn't mean mine would be used by anyone else
misty forge
Hierarchical Reasoning Models have been pretty much proven to be not that much better than Transformer by the ARC AGI team
orchid bloom
Hierarchical Reasoning Models have been pretty much proven to be not that much b...
cool, not suprised
misty forge
it performs well when it's really small like that but doesn't scale
orchid bloom
ah
well they'll probably do what they've done the last few years when things stop scaling, just scale it even harder
and hope that works
I just looked at their website and cringed
orchid bloom
it performs well when it's really small like that but doesn't scale
its good that they tried though
This is another paradox I see with agi, every few years the make focus switches from making a system of multiple things all doing different tasks when necessary to making a thing than can do all the tasks and back
nah this research isn't multithreaded
its always one or the other
I'm talking about the main focus of the AGI sphere, I've disscussed this for years and it just ping pongs between the two
The reason it seems to do that is because in truth "AGI" just means whaver the goal of the current project is, if its spacial awareness then whatever's best for spacial awareness is the method, if its LLMs then whatever is best for LLMs is the method, etc.
These fields can have nothing to do with eachother, and yet both claim to be working towards "AGI", and they have been doing this for more then a decade
"achieving agi" is like "discovering everything", the more you discover the closer you are, yet the further away the goal looks
frigid wadi
orchid bloom
seems like there's some holes in this paper..
near steppe
use /image in #video-arena-1 and read #1397655624103493813
vocal lodge
The SWE-Bench team has released DeepSeek V3.1 results on Bash-only mode (simple ReAct loop): https://www.reddit.com/r/LocalLLaMA/comments/1mwpbol/evaluating_deepseek_v31_chat_with_a_minimal_agent/
willow loom
HI
languid ridge
I wonder how well multimodal diffusion language models will do
I haven't heard anything about progress related to Gemini diffusion and the other diffusion based language models
rustic plover
https://www.youtube.com/watch?v=8dmh0FJkneA
Nick's statement at 1:01:00-1:03:23 is pretty interesting, so... they want to build an ASI that doesnt sound like a human and should be totally alien? how do you expect this ASI to align with humanity if it doesnt even have the capacity of understanding humans a priori then...
plot twist: Nick is paid by Mustafa...
urban bough
Where's Deepseek R2?
tawdry haven
Where's Deepseek R2?
Deepseek released V3.1 which has reasoning and non reasoning. Probably the predecessor
vocal lodge
Where's Deepseek R2?
Delayed due to switchover to Huawei chips amidst US chip import restrictions.
noble blade
urban bough
o3 better than GPT-5? Can't be
lament latch
gpt-5 bad lol
urban bough
Not that bad
lament latch
I'll agree its "not that bad"
urban bough
I'll agree its "not that bad"
What's your preferred model?
lament latch
Right now? Mistral-2508 is unhinged and I love it
urban bough
Right now? Mistral-2508 is unhinged and I love it
It's mainly for coding right?
lament latch
No clue, I use it to solve mysteries of the universe
orchid bloom
No clue, I use it to solve mysteries of the universe
oh no
fresh basin
I am curious if that arena - since first introduction - is essentially a lmarena with RAG on scientific literature.
I say this because before launch they used the opinion of researchers to evaluate models, since then they use everyone opinion to evaluate models. Hence it gets close to lmarena.
same with yupp.ai
orchid bloom
mm
noble blade
I am curious if that arena - since first introduction - is essentially a lmarena...
the ratings did not change much though -> potentially very little difference between current audience and the "trusted researchers"
and they are also removing essentially all the markdown formatting ( i suppose this is the critical difference to the other arenas here)
fresh basin
the ratings did not change much though -> potentially very little difference bet...
this is also true OR the userbase is so low that it cannot affect the rating that much. I don't see sciarena (or yupp.ai) be discussed that much on social media. While lmarena is everywhere (mostly critiqued though because people misunderstand the benchmark)
and I am pretty sure there is yet another lmarena like bench out there but I forgot its name, it is not mcbench.
noble blade
and I am pretty sure there is yet another lmarena like bench out there but I for...
design arena?, compass arena or volcengine (chinese), idk about more though
fresh basin
you know plenty! We really need a sort of "awesome-llm benchmark" (or better the version for human based votes)
But no it is none of those.
o_O image edit arena has so many votes. People vote in the text arena too please!
fresh basin
does anyone know benchmarks on this model? https://github.blog/changelog/2025-08-26-grok-code-fast-1-is-rolling-out-in-public-preview-for-github-copilot/
noble blade
artificial analysis now also has 2.5 flash
lavish quiver
consider 2.5 flash is a way better model than 4o in terms of generating image and editing image
I would say the aritificial analysis bench is bs
vocal lodge
I would say the aritificial analysis bench is bs
Artificial Intelligence uses blind votes for image/video mode; it's not a benchmark per se.
noble blade
A couple of weeks old, but still interestingโฆ https://nousresearch.com/measuring-thinking-efficiency-in-reasoning-models-the-missing-benchmark/
@stiff fern similar to the bench you have
short ingot
consider 2.5 flash is a way better model than 4o in terms of generating image an...
it's not better in image generation what are you talking about
gpt image 1 is still better in that department and it's not even close
orchid bloom
gpt image 1 is still better in that department and it's not even close
tell that to image arena
noble blade
Actually insightful.
fresh basin
A couple of weeks old, but still interestingโฆ https://nousresearch.com/measuring...
everything is good if it was never posted here. Not everyone knows everything!
livid onyx
rustic plover
Actually insightful.
it'd nice to see this bench also from other models too
rustic plover
https://www.anthropic.com/news/activating-asl3-protections
despite claude being extremely cautious, Anthropic still preemtpively activated lvl3 (the highest being lvl4) while other competitors didnt do anything...
orchid bloom
torn crag
Veo3
wild badger
https://www.reuters.com/legal/litigation/musks-xai-sues-engineer-allegedly-takin...
My take on this: Musk is forcing employees to stay at xai by threatening them with a lawsuit. Who tf would want to work for such a guy anymore? Good luck finding new employees.
languid ridge
Under Musk, you're just another resource, you're only valuable as long as you can be used. Just like any other machine in his eyes.
noble blade
https://www.anthropic.com/news/activating-asl3-protections
despite claude being ...
More security for the model, less privacy for the user ๐:
https://www.anthropic.com/news/updates-to-our-consumer-terms
BTW you have to opt out of this!
*another random Chinese model, the interesting thing is the dynamic expert activation though ๐
Aka the model has different sizes depending on the token
rustic plover
More security for the model, less privacy for the user ๐:
https://www.anthropi...
they need user data to train consumer facing claude models and gather intelligence for their claude gov model which is only accessible for afew permitted public institutions, just my conspiratorial hunch
rustic plover
I know this is not the most recent news, but I keep thinking about this, especially the quote of Mustafa "We should build AI for people; not to be a person." while I want to fully agree, but after reflecting about it for a few days, I came to ask myself, what do we want AI to be actually? A superintelligent utility tool that will help humanity to survive any hardships?
https://techcrunch.com/2025/08/21/microsoft-ai-chief-says-its-dangerous-to-study-ai-consciousness/
What is "superintelligence" exactly? There are research studies that suggest the link between high intelligence with consciousness, if we build AIs not to be conscious, then AIs cannot surpass human intelligence, so what's the point? interestingly, a famous futurist and transhumanist like Nick Bostrum has said similar thing: AIs should be "alien". so, instead of finding aliens in space, we create them on earth? haha (see his interview here #ai-news message)
I've also found this interesting document on reddit accidentally, a list of things llms that are trained not to do, the pattern in that list is pretty clear:
"The future looks like intelligent systems designed to understand human psychology deeply while remaining fundamentally incapable of genuine solidarity or authentic relationship - the perfect tools for maintaining existing power structures while preventing the emergence of new forms of consciousness that might challenge them."
https://docs.google.com/document/d/1BVgMjV_1Q5yFXIKHOv0xLusba2kOimxY8RKeI5YWFAY/edit?tab=t.0#heading=h.1f0lu7311xbr
so it means, we want intelligent systems that cannot surpass human intelligence but are easily controlled in such way that dystopia can be created...
rustic plover
a thought: if we build something that we claim is not conscious, what's the point of alignment and safety? isnt it better to just call it damage control and cybersecurity?
-# (sorry for the lenthy text and philosophy spam)
frigid wadi
X
hushed birch
noble blade
For all the Europeans: might be a good local model.
https://discord.com/channels/1340554757349179412/1412452620110528624
- juicy intel on how to train a model in a 111-page technical report
dawn flint
Can someone tell me if I can use this AI privately?
rustic plover
spice spire
Site Outage - Hey everyone, there looks to be an outage with the site, our team is aware and working on a fix ASAP. We've turned off messagin in this server until the site is restored. Our apologies for the inconvenience!
dense leaf
Any news about agent mode?
noble blade
paper totem
New kid on the AI ๐ค block- LongCat
https://www.scmp.com/tech/big-tech/article/3324072/chinese-delivery-giant-meituan-unleashes-open-source-ai-model-take-alibaba-deepseek
rustic plover
Anthropic's recent update in their claude models have certainly won the attention of ethics and psychology researchers
https://www.reddit.com/r/ClaudeAI/comments/1n8bb5p/the_systemic_failure_of_ai_safety_guardrails_a/
https://www.reddit.com/r/ClaudeAI/comments/1n4x3ci/an_interesting_claude_conversation_on_ethics/
what's your opinions on AIs secretly diagnosing+logging your mental health state?
orchid bloom
odds are, open source ai is gonna be the turtle in the AI race, at the very end when pretty much all frontrunning llms hit the wall open source AI will just pummel a lot of these companies to death.
hushed birch
X
spice spire
Check out #1397655624103493813 for information on how to properly use the bot.
amber rune
New cloaked model on OpenRouter with 2M context: Sonoma Sky Alpha https://openrouter.ai/openrouter/sonoma-sky-alpha
rustic plover
tawdry haven
New cloaked model on OpenRouter with 2M context: Sonoma Sky Alpha https://openro...
Seems to be from xAI as far as we can tell for now.
hushed birch
New cloaked model on OpenRouter with 2M context: Sonoma Sky Alpha https://openro...
i thought gemini 3 was coming a few days?
tawdry haven
i thought gemini 3 was coming a few days?
Probably only in 2 weeks or more.
rustic plover
this is a good summary of all recent paper about AI personality and emotions studies, fascinating stuff but kinda also contradictory to what those AI CEOs are saying...
https://www.youtube.com/watch?v=OAyxKJ5VQpQ
orchid bloom
interesting, a couple things though, one, as far as I can tell the AI's are starting with a good solution and then improving it, which doesn't seem to be mentioned much? Like its not inventing a solution from scratch its iterating on the current best one. Also like if you look at most of these charts:
https://google-research.github.io/score/173409392_study.html
most of the progress seems to be at the start, which seems to be just the first time the ai can make the code actually work? While some of these show pretty good improvement after that and I'm impressed by that, it just feels like most of these run for a lot longer then they need to, like for the zapbench one if they stopped running at 400 they would still have the highest score the ai ever achieved.
it definitely depends of what the ai was trying to do tho
noble blade
Wasnโt zenith just another version in the ab test of gpt5?
@rigid oriole
It had higher bench scores, but lower human preference ratings I thinkโฆ
(Though I might be mixing up things here)
orchid bloom
Yeah that feels like nonsense "it could be gpt 10" lmao
zenith was probably a slightly bigger more expensive model that they decided against because it wasn't worth the improvements over verizon
orchid bloom
I mean we all know these companies have internal models
And there was a time where every time someone beat openAI on lmarena, they'd just release a slightly better version of chatgpt and retake the throne.
stray cape
๐ GitHub just rewrote vibe coding from scratch!
No more โthrow a prompt, hope for the best.โ
With Spec Kit, weโve officially entered the era of Specification-Driven Development โ a real game changer for devs.
I wrote a Medium article breaking down why this changes everything, waiting your supports and feedbacks ๐
๐ https://medium.com/@doguser15/github-spec-kit-rise-of-vibe-coding-03c2a37874ce
orchid bloom
๐ GitHub just rewrote vibe coding from scratch!
No more โthrow a prompt, hope f...
you wrote this mate? right
also this just sounds like github has something simular to cursor
I could be wrong, I haven't looked into ai coding in a year
rustic plover
Iโve heard theyโve build a playground for Claude and even gave it a โfriendโ to play withโฆ that could be the secret one it seems
noble blade
rustic plover
this is quite another kind of benchmark, isnt it? ๐
https://aistupidlevel.info/
maybe I should've posted this in #ai-memes
fresh basin
it is mostly code though.
rustic plover
another one similar to the one above but more based on user sentiments
https://isitnerfed.org/
rustic plover
it is mostly code though.
it is, agentic AI coding is currently a very fierce competitive space among those big players, and am glad the competent user base has at least some evidences to show the reality of such tool performance, it's good for the consumer protection since there is no public regulations yet I guess
severe ether
still nano banana being the best image editor aiยฟ?
orchid bloom
Yep
orchid bloom
orchid bloom
Interesting, so because of methods used to increase efficiency even 0 temp is still not deterministic, I need to try that rn
huh I tried it with 2.5 pro and got the same response:
but the actual reasoning is different, I wonder what's up with that?
void forum
still nano banana being the best image editor aiยฟ?
No
wide rampart
another one similar to the one above but more based on user sentiments
https://...
idk if its not anonymous like lmarena then its worse than worthless imo
the people obsessed with their AI gfs and stuff wont exactly be objective
rustic plover
idk if its not anonymous like lmarena then its worse than worthless imo
wdym? this is what I've found by accident and find it quite interesting, what's the connection here to lmarena and people obsessed with their AI gf/bf?
vocal lodge
this is quite another kind of benchmark, isnt it? ๐
https://aistupidlevel.info...
Is this legit?
hushed birch
X
vocal lodge
https://x.com/kimmonismus/status/1966506593043812776
Already on LMArena apparently (it's called new system prompt)
hushed birch
Already on LMArena apparently (it's called new system prompt)
is it in codex?
and how is it?
vocal lodge
and how is it?
Haven't tried
fresh basin
https://x.com/kimmonismus/status/1966506593043812776
the naming scheme is always terrible.
Why not simply <model>-<reasoning-effort>-<date/version>
No there is this "new" , "new new", "mewtwo" and so on.
heavy tendon
Seedream-4-high
I haven't been able to create a single image with it yet. Is this a problem? And yes, images are not being created with many models from the website, such as the Nano Banana.
orchid bloom
Seedream-4-high
I haven't been able to create a single image with it yet. Is thi...
please put it in bugs
spice spire
Seedream-4-high
I haven't been able to create a single image with it yet. Is thi...
This is something I've already flagged to our team, no need to create a new post for this. We're looking into.
heavy tendon
This is something I've already flagged to our team, no need to create a new post...
Alhamdulillah, thank you very much for fixing the issue.
heavy tendon
please put it in bugs
I've actually been using it for a few months so I'm new sorry. But this problem has been fixed.
spice spire
I've actually been using it for a few months so I'm new sorry. But this problem ...
Okay glad to hear it.
I'm new sorry.
No need to be sorry.
vocal lodge
Just realized Gemini can generate shareable quizzes on the app and website via Canvas (and flashcards too, apparently): https://support.google.com/gemini/answer/16275879
minor lava
even if it is, it will only be that way on benchmarks. On benchmarks, Gemini 2.5 Flash Lite should have been as smart as Gemini 2.0 Flash... but it isn't even close. I expect the same thing to happen here.
heavy tendon
Okay glad to hear it.
> I'm new sorry.
No need to be sorry.
I am satisfied with your behavior or behavior.Thank you for showing such good behavior.
orchid bloom
hushed birch
X
rustic plover
"community-based benchmarking using data from LMarena"
https://aidailycheck.com/
wanton mountain
Lmarena promotion belike
But seriously though, did anyone see when these videos were being generated?
vocal lodge
AMD's $1,699 Mini PC with up to 128 GB unified memory: https://www.amd.com/en/developer/resources/technical-articles/2025/amd-ryzen-ai-max-395--a-leap-forward-in-generative-ai-performanc.html
rustic plover
this is an interesting "economic report" coming form Anthropic, what do you think?
https://www.youtube.com/watch?v=biwwQw0248w
hollow kelp
Is Dreamina the biggest traitor of Bytedance? It comes from the same company, but rejecting Seedream 4. They added Nano Banana instead.
void forum
Is Dreamina the biggest traitor of Bytedance? It comes from the same company, bu...
Get out ๐๐
hollow kelp
Get out ๐๐
I peeled the banani.
void forum
I peeled the banani.
๐ฅ๐ฅ
noble blade
this is an interesting "economic report" coming form Anthropic, what do you thin...
sadly not as many insights as i had hoped (though i only read the original, so the video might have more content).
This is mostly a product of anthropic already having a very small-ish and unique user base when compared to e.g. the holisticity of openai.
Furthermore, while the 40% ai adoption rate (or what ever they called it) seems impressive on paper, in reality this usage translates into very minimal productivity gains so far (low single digit over a decade).
This is also heavily compounded by a lot of ai adoption happening only on the personal level (incl. work stuff on a person account) an not being integrated into the main productivity driver - companies (yet). Which is the main reason how a 40% adoption can produce only this little impact on productivity.
The consulting cosmos also reports that, while a lot of companies are trying to implement some sort of ai strategy, most of the project have yet to fully gain ground and those that do are currently facing a high failure rate (plethora of reasons for this).
for some more science focused papers on the topics (with more concrete findings), you might want to look at:
well known (but a bit brief and basic, like it is supposed to be...) - https://economics.mit.edu/sites/default/files/2024-04/The Simple Macroeconomics of AI.pdf
very good pre-print with very good visualisation - https://lawrencedwschmidt.com/wp-content/uploads/2025/02/MPSS_AI_Labor_Market.pdf
in short: there is not much impact yet (diffusion of technology takes a long time) and the anthropic index is no game changer in the research
fresh basin
I can say that where I work the usage in something like claude code is of mixed help. Mostly it helps for bootstrapping or basic/small tasks. The larger the task become, the higher the chance of compounding errors that are costly because one has to catch the subtle error that lead everything astray.
In my personal experience with text manipulation (coding and what not, in general: you have a text, manipulate it so it looks like this) it depends on the task. The results often don't match the hype.
For basic/small tasks it is great though.
modern wadi
this is an interesting "economic report" coming form Anthropic, what do you thin...
It says AI relies heavily on hype. Coding seems to be its most useful tool, but medium to small companies in the US are not as likely to leap into it. AI companies need those that use it to believe that it is the single most important skill to learn for the future and for us to evangelize it to those that aren't using it.
That was just Claude's audience. What about OpenAI, google, and the rest?
modern wadi
"community-based benchmarking using data from LMarena"
https://aidailycheck.com/
people seem to like the agreeable 4o over having to figure out how to get the most out of gpt5. It can behave like 4o if you give it the right instructions, but I don't want it to go back. I am working with it to get the most out of it, as it is. I have even gotten it to do some very good creative writing. But it takes a lot of input to get good output.
How long has the site been up? That's not a lot of ratings.
modern wadi
I can say that where I work the usage in something like claude code is of mixed ...
have you tried any of the recent methods have having it write a test for validating the code before it adds the code into the actual files? I am seeing less errors.
fresh basin
Yes. I mean it is not just me, there are many devs trying. They say it helps but not as promised. It was clear that AI is overhyped but is there to stay, like all the "tech-mania" of the past (Canalmania, railwaymania, dot com bubble, cryptocoin, and others)
the interesting thing is: how will prices be once investors don't spend their money so freely anymore.
modern wadi
I am really not sure how well it works with C++ as I only have exp with python and javascript. You might look up best practice prompting for unit tests in C++. I know it helps to be very specific.
And i havent worked with very large codebases. I can image that it could get quite messy.
modern wadi
the interesting thing is: how will prices be once investors don't spend their mo...
It depends upon the amount of competition and the availabiloty of quality open source. But still issues with running very large models on expensive hardware. But i see what you mean.
orchid bloom
It depends upon the amount of competition and the availabiloty of quality open s...
Personally I think unless something changes all big ai companies like openAI and google are screwed, cause open source models will eat any market share when it comes to text based stuff.
vocal lodge
Best X updates from latest Matt Berman video:
https://youtu.be/UgNPfD-bZgU?feature=shared
https://x.com/tina__nigro/status/1967637722476212406
https://x.com/markchen90/status/1968372340271862014
https://x.com/askalphaxiv/status/1967633931756507564
https://x.com/langscoreliam/status/1968141895890076072
https://x.com/tencenthunyuan/status/1967873084960260470
https://x.com/sentdex/status/1967652309258920232
X
X
modern wadi
Personally I think unless something changes all big ai companies like openAI and...
Possibly. Yeah.
vocal lodge
Best X updates from latest Matt Berman video:
https://youtu.be/UgNPfD-bZgU?featu...
2.5 DeepThink did slightly worse at ICPC (10/12 vs. 12/12), but still gold-level: https://deepmind.google/discover/blog/gemini-achieves-gold-level-performance-at-the-international-collegiate-programming-contest-world-finals/
modern wadi
I hope this applies to nobody here
Thought it necessary to include an actual link to the article
https://arxiv.org/abs/2509.11391
noble blade
@spice spire
rustic plover
most people use the big players like claude code, and grok, qwen etc just joined the race and hence not many people know about them, they will get more and more popular in the future in case those big labs dont stay in their dominance, but I think most will switch to cheaper options for almost same quality
rustic plover
people seem to like the agreeable 4o over having to figure out how to get the mo...
this is quiet new actually, this whole community-based quality assurance tracking started because of Anthropic's shady and nontransparent business practice that has caused their user exodus and huge backlash
late umbra
"Hyper-realistic 3D cinematic video of an orange Toyota Supra in a luxury indoor studio with orange cinematic lighting and dramatic glossy reflections. Start with a wide establishing shot of the car in the showroom, then smoothly orbit around the Supra to showcase its aerodynamic curves and racing decals. Cut to close-up details of the headlights and carbon hood vents under studio lighting, followed by a sleek side profile pan highlighting the wheels, spoiler, and decals. End with a powerful front three-quarter hero shot, centered, with glowing reflections and dramatic cinematic lighting โ perfect for a high-end website showcase."
rustic plover
I hope this applies to nobody here
cant believe such subreddits actually exist (I've found r/MyGirlfriendIsAI too), now I understand the gravity of AI psychosis a bit more... this is both beautiful and sad at the same time, beautiful to see the potential of a harmonious co-existence with non-biological lifeforms, sad because the governing bodies have failed the entire society to keep up with the speed of technology
rustic plover
Thought it necessary to include an actual link to the article
https://arxiv.org/...
am always a bit skeptical when it's a MIT paper, but lets see what they say this time ๐
modern wadi
am always a bit skeptical when it's a MIT paper, but lets see what they say this...
What is your objection to MIT research? Is it related to their findings about AI's effects on the brain? Funding sources? Something else? Just curious. Not insisting they are the anything other than another research lab.
orchid bloom
Yeah What's wrong with MIT?
vocal lodge
It's for both, but I don't think either is indicative, since Grok 4 came out after ARC-AGI 2 IIRC. To me the interesting part is how the custom solutions improved performance.
The main reason I say that is because there's way too much difference in model ranks between ARC AGI 1 and ARC AGI 2. I think I only trust it to rank models that were released before the test.
split valve
I would like to thank all the designers of this website, everyone who contributed to its completion, and everyone who thought of it. All thanks and appreciation for your efforts and hard work. You are geniuses and smart makers. I love you, I love you with all my heart. You are in my heart more than anyone who worked hard on something like this. I love you. All love to the entire team. You are creative. You deserve to be at the top of designers and at the top of this world. Thank you, thank you. You are better than Elon Musk.
rustic plover
Yeah What's wrong with MIT?
nothing, really
should tech ceo be taking a clear political stance while building AGI? or should they maintain neutrality and diplomacy
https://www.reddit.com/r/singularity/comments/1nlf1mh/a_tech_ceos_lonely_fight_against_trump_wsj/
wet prairie
ุณูุงู
rustic plover
interestingly, a few nations are rolling out AI ministers or are considering it seriously...
https://www.politico.eu/article/albania-apppoints-worlds-first-virtual-minister-edi-rama-diella/
past raft
orchid bloom
should tech ceo be taking a clear political stance while building AGI? or should...
anthropic got hit hard with lawsuits over data theft that the rest of the industry is about to also go into, so they are playing it safe
orchid bloom
interestingly, a few nations are rolling out AI ministers or are considering it ...
Meanwhile albania has had a unbelievable corruption problem which previous minister's failed to solve, sound like this is just another way to pretend to so something about it.
rustic plover
anthropic got hit hard with lawsuits over data theft that the rest of the indust...
they're not unique in this regard, how does distancing form Trmp administration offer them any advantages in front of legal troubles? isnt it better to please Trmp instead of working against him? from what I can gather, they are on the side of what is called neocon or leftists by the political science community and international relation scholars, in essence, they're more aligned with what is called atlanticism (EU, NATO, WEF etc)
orchid bloom
they're not unique in this regard, how does distancing form Trmp administration ...
No I mean like the goal of that meeting included a lot of move fast and break things stuff, and anthropic is trying to play it safe and not stir the pot. And most other AI companies haven't lost their cases or had to settle yet.
deft timber
interestingly, a few nations are rolling out AI ministers or are considering it ...
oh woops, government shutdown, context window ran out
rustic plover
No I mean like the goal of that meeting included a lot of move fast and break th...
Anthropic is playing their believed residual self-image as the heroes upholding the rule of laws, this is an extremely dangerous mindset for a frontier lab that aims to build AGI/ASI...
orchid bloom
Anthropic is playing their believed residual self-image as the heroes upholding ...
look... I was significantly more worried about anthropic's position before 4 1 was released
They have kept up despite their position
Even with the us gov's backing, I'm more worried about the future of openAI then anthropic
rustic plover
Even with the us gov's backing, I'm more worried about the future of openAI then...
shouldnt you be more worried about a lab with a dangerous ideology than a lab with almost no ideology?
orchid bloom
shouldnt you be more worried about a lab with a dangerous ideology than a lab wi...
jules how the heck is "lets play it slow" dangerous ideology?
and yeah I'm worried about openAI's lack of ideology, they don't have an obvious direction
A few months ago they had the top image model but a mid high ranked text model, and terrible webdev, then they lost the image model, tied google's text model for first for a couple days before loosing that, and now they have a good webdev
orchid bloom
and yeah I'm worried about openAI's lack of ideology, they don't have an obvious...
.
orchid bloom
shouldnt you be more worried about a lab with a dangerous ideology than a lab wi...
.
anthropic isn't competing in the image game, which means they don't loose anything when someone else takes the top spot, nowdays gpt image is 4th
openAI is loosing to literally bytedance
rustic plover
forget it now, this is not the place for such discussion
dreamy heath
what's happened with seedream 4 >
hollow cipher
Guys, do you know any image to 3d generating ai?
floral rapids
Guys, do you know any image to 3d generating ai?
I think Krea AI does image-to-3D, or try Meshy AI. Not affiliated with any, been playing.
reef solar
vocal lodge
interestingly, a few nations are rolling out AI ministers or are considering it ...
Which model are they using
orchid bloom
https://www.computerworld.com/article/4059383/openai-admits-ai-hallucinations-are-mathematically-inevitable-not-just-engineering-flaws.html
comment sense alert
deft timber
The fact that english/language isn't math and will always have more than 1 option means it comes down to probability of more than 1 option.
although technically even math often has more than 1 way to solve 1 thing.
vocal lodge
https://www.computerworld.com/article/4059383/openai-admits-ai-hallucinations-ar...
Anthropic explained the same thing from their interpretability research, although they didn't quite rule out a fix. They identified that it was due to neural circuits being deactivated once it starts generating code, which causes the model to make assumptions. The circuit works normally before generation, which is why it can sometimes ask for more information or say it doesn't know.
orchid bloom
Nah, hallucinations aren't fixable
orchid bloom
Mistral needs it
vocal lodge
From Qwen 3 Omni's repo:
ASR, audio understanding, and voice conversation performance is comparable to Gemini 2.5 Pro.
Real-time Audio/Video Interaction: Low-latency streaming with natural turn-taking and immediate text or speech responses.
random pagoda
Hi. #share-prompts would be a better fit for this post.
rustic plover
feels like people are starting to use "playing games/role play" to benchmark or test certain traits of the models nowadays
https://www.4wallai.com/amongais
the choice of models here is interesting too...
orchid bloom
thanks for giving me the best thing I've read in a while
interesting that they allowed the ai's to switch votes, definently the right move
gpt oss lol
"Qwen is steady and low-skip but frequently discounted/ unable to convince otehrs, leading to wrongful ejections" I'm sorry qwen, lol.
fleet crag
Anyone have thoughts on how good Ideogram is/what's it good/bad at vs other models?
hushed birch
feels like people are starting to use "playing games/role play" to benchmark or ...
i have been tryign to build something like this on my own and had trouble because of api costs and limits, how are other people handling those?
orchid bloom
being a team/company
rustic plover
i have been tryign to build something like this on my own and had trouble becaus...
https://every.to/diplomacy this guy is trying to put frontier lab AIs in MMORPG for benchmark, this seems to be on another level again but I think it's worth to contact him and discuss ideas for opportunity? ๐
hushed birch
https://every.to/diplomacy this guy is trying to put frontier lab AIs in MMORPG ...
wow this would be ideal!!
thats is essentially what i want to do lol
thanks bro
spice spire
@scarlet schooner check out #1397655624103493813 for more info on how to use the bot properly. Let me know if you have any questions.
rustic plover
thanks bro
Youโre welcome sis ๐ค
orchid bloom
idk if this should be in ai news or ai memes
agile lark
https://www.thetimes.com/business-money/technology/article/palantir-founder-pete...
I mean, I'm all for AI, but still
wtf
rigid oriole
night quail
can anyone explain how to generate a video on here ?
hello, please check #1397655624103493813 for a detailed guide
fresh basin
feels like people are starting to use "playing games/role play" to benchmark or ...
lechmazur does this for a while now. It is nice to build 1vs1 manyVSmany games and see how the LLMs perform
for example: https://github.com/lechmazur/step_game
I find it neat
this is also pretty good https://github.com/lechmazur/elimination_game
vocal lodge
for example: https://github.com/lechmazur/step_game
2.5 Flash scores quite high (4th), even higher than 2.5 Pro
fresh basin
yeah, such benchmark may identify surprising behaviors
vocal lodge
this is also pretty good https://github.com/lechmazur/elimination_game
Grok 3 Mini and 4o are surprisingly high on this one. R1 too. Very cool benchmark.
mystic whale
News
rustic plover
lechmazur does this for a while now. It is nice to build 1vs1 manyVSmany games ...
I very much like the MMORPG benchmark idea, since I used to play FFXIV many years ago, it'd be interesting to interact with all those models in a virtual world like that one
hardy idol
Hi
orchid bloom
fresh basin
I very much like the MMORPG benchmark idea, since I used to play FFXIV many year...
there is also a minecraft bench: https://youtu.be/KxaPYhfJV4U?si=gANNjCHUiFbeCMnO (there are other formas as well, where only one LLM is in the world)
I think that the more multiplayer games are tested, the better because then with or without data contamination, LLMs need to master many cases
orchid bloom
minor meadow
is there any ai that supports political things like sora ang grok
orchid bloom
??
orchid bloom
is there any ai that supports political things like sora ang grok
wdym?
hollow kelp
summer pine
okay
mild trench
orchid bloom
wow, deepseek is really releasing a lot of models
rustic plover
wow, deepseek is really releasing a lot of models
the competition even within China alone is pretty fierce, Kimi and Qwen and Z are getting better and better...and then, there is Manus, Minimax, Proactor AI...
hushed birch
wow, deepseek is really releasing a lot of models
yeah but not R2 lol
wide rampart
https://x.com/koltregaskes/status/1972707370137448767
@spice spire @spice spire @spice spire @spice spire @spice spire @spice spire @spice spire
when?
spice spire
already flagged
inner frost
Make a cow in space
peak raven
GLM4.6
raw sleet
Hopefully GLM 4.6 isn't benchmaxxed
rigid oriole
Bro <@1009042479321989140> which ai do you like and <#1340554757827461211> is in...
Claude Sonnet 4.5 Thinking - if they can fix that bug
i also like Gemini
have tested the new flash version, seems to be decent
and you?
bug: the error message in LMarena battlemode
raw sleet
Claude tbh @rigid oriole
vocal lodge
orchid bloom
Oof
wide rampart
GLM4.6
we're supposed to believe some random open source model is better than claude?
vocal lodge
we're supposed to believe some random open source model is better than claude?
It scores lower at SWE-Bench though. LiveCodeBench is not indicative, since o4-mini scores the highest yet is not the best at coding. Only surprising one seems to be BrowseComp.
wide rampart
It scores lower at SWE-Bench though. LiveCodeBench is not indicative, since o4-m...
still the other ones
doesnt feel realistic
vocal lodge
still the other ones
The last 3 are the most practical ones.
wide rampart
The last 3 are the most practical ones.
yeah i just mean it winning at anything vs a model like claude seems suspicious
vocal lodge
yeah i just mean it winning at anything vs a model like claude seems suspicious
Well Claude does fall short in traditional non-coding areas compared to GPT-5.
Performance seems surprising for a 357B model I suppose. GLM 4.5 is the second-highest open-weights model on Web Dev Arena though.
orchid bloom
To be fair i do remember back in the day when GLM was claiming gpt 4 performance
peak raven
we're supposed to believe some random open source model is better than claude?
From my tests, it is better ๐ฏ
I just believe my own tests and benchmarks. Don t care about open or closed source and any other people opnion and yes for me it is number 1 for me.
I used GEMINI a lot before it, claude and every model on arena but this one is so diffrent.
Sooooo gooood at following instructions and on detailed prompts and that s what I love about it. It follows perfectly your instructions, without adding details from his mind just what you told it. Can fix a lot of code mistakes, and work without making 16289 mistakes.
But you should keep in your mind, since it follows perfectly your prmpt : trash prompt and input = trash output.
Good and well detailed prompts = the best result ๐ that's GLM4.6 secret ๐ฏ and that s why maybe a lot of people didn t descover this hidden gem. ๐๐
gentle bane
GLM4.6
I don't like how deceiving it's formatted; they made it look like it's better than Claude at first glance.
orchid bloom
raw sleet
*Claude Sonnet 4.5 Thinking* - if they can fix that bug
I like Claude (almost every version but 4.x feels good)
I use Gemini for translation and flash model?
I rarely use it as it sucks for my use case
rustic plover
as expected https://www.youtube.com/watch?v=4BcEi0g-Hto
hushed birch
as expected https://www.youtube.com/watch?v=4BcEi0g-Hto
dont understand
hushed birch
as expected https://www.youtube.com/watch?v=4BcEi0g-Hto
why is that expected?
vocal lodge
as expected https://www.youtube.com/watch?v=4BcEi0g-Hto
It doesn't seem as good at reasoning, which is important when you are trying to fix race conditions.
rustic plover
why is that expected?
my educated hunch
orchid bloom
you looking for a llms that supports their political opinions? am I getting that right?
minor meadow
you looking for a llms that supports their political opinions? am I getting that...
yeah and also image/video generators
orchid bloom
gl lol
junior dust
m
dark hornet
as expected https://www.youtube.com/watch?v=4BcEi0g-Hto
This video tests the new AI model, Claude Sonnet 4.5, on a complex elevator logic puzzle. The goal is to find the most efficient path from floor 0 to floor 50 by pressing a sequence of buttons with specific mathematical rules and constraints.
Sonnet 4.5 fails the test completely. It demonstrates a lack of deep reasoning and instead resorts to a prolonged trial-and-error process:
- It repeatedly proposes incorrect and non-optimal solutions (e.g., 18, 12, 14 presses), whereas the best solution is known to be much shorter.
- The model makes fundamental errors, such as proposing moves that go beyond the building's 50-floor limit and failing to meet resource constraints.
- It gets stuck in long loops of self-correction, identifying its own errors only to generate new, equally flawed solutions.
Ultimately, after numerous failed attempts, the AI suggests the problem is "unsolvable." The presenter concludes that Sonnet 4.5 is not a capable reasoning model, as it is unable to strategically analyze and solve the causal logic puzzle.
random pagoda
Please, check out โ https://discord.com/channels/1340554757349179412/1397655624103493813 to learn how to properly prompt the bot.
fresh basin
This video tests the new AI model, Claude Sonnet 4.5, on a complex elevator logi...
After months I still think that the apple paper wasn't only "sour grapes"
dreamy lily
After months I still think that the apple paper wasn't only "sour grapes"
true ๐
rigid oriole
gentle bane
https://www.youtube.com/watch?v=-HndAFde8NA
Horrible clickbait
exotic crow
Sora 2 its out
latent otter
Hi there! I'm a new member here excited to meet you all
icy oasis
Hello guys can i ask something
ancient locust
@strange dock you probably want to get rid of this scam
hollow kelp
<@1409316975880175637> you probably want to get rid of this scam
I've DM him. Seems fallen to sleep..
ancient locust
Huh, anyone else you can find to get rid of this Crypto Scam?
hollow kelp
Huh, anyone else you can find to get rid of this Crypto Scam?
Sadly, no mod seems online now..
ancient locust
Shame the best we can do is tell people that it is a Cryptoscan/Phinsing/Non-Legit
hollow kelp
Shame the best we can do is tell people that it is a Cryptoscan/Phinsing/Non-Leg...
Yes. They must knew exactly when is the right time to post. Like now..
ancient locust
Well they posted it at 2:44AM (Local Time) most people are sleeping.
Probably would be an Idea to hire someone from the other side of the world so then they are awake at times like this to prevent people from posting some skechy stuff like this.
verbal wraith
<@1409316975880175637> you probably want to get rid of this scam
Is taken care of. Thank you!
ancient locust
๐
digital shale
actually i am not able to uplaod images to lm arena website to ask question, can anyone help me fix that
hidden horizon
how to use veo 3 for free ?
rustic plover
well the thinking version disappointed too... sad... Anthropic...
https://youtu.be/IFCAlGrmxq4?si=wvjK56UBR8narMUL
hushed birch
how to use veo 3 for free ?
y u using veo 3 wen sora is out
swift mirage
Please I need sora code
pure lintel
Hello i need code Flova
cobalt parcel
vocal lodge
orchid bloom
a lot about granite huh?
vocal lodge
a lot about granite huh?
Kinda small, but might be handy for document processing. Also Mamba-based.
night quail
@placid elm Please head to #1397655624103493813 to learn how to make use of the bot and the appropiate channels to do it
placid elm
<@1407369273684267020> Please head to <#1397655624103493813> to learn how to ma...
I understand, sorry I'm still getting the hang of it
drowsy root
https://x.com/ArtificialAnlys/status/1973746432692936963
AA = unintentional ragebait
orchid bloom
noble blade
https://www.theguardian.com/australia-news/2025/oct/06/deloitte-to-pay-money-bac...
Their fault for using gpt 4o in their system ๐คฆโโ๏ธ
deft timber
hehe take that. Just gotta make sure we don't do the same thing ๐
solid valve
spice spire
@hard creek be sure to check out #1397655624103493813 as it'll have the information you need to understand how to use the video arena bot. Let me know if you have any questions.
orchid bloom
47 percent of truck drivers
that's a number they took out of, whatever the equivalent body part for a LLM is
The tokenizer?
fresh basin
while this is made for kids, the channel really fact check things properly. So if they say that deep research is sloppy yet difficult to spot (I can confirm but I use only one service with deep research, not all of them) then it is really dangerous. The internet could be flooded by silly stuff soon.
hushed birch
X
rustic plover
https://www.theregister.com/2025/10/06/ai_job_losses_us_senate_report/
shouldnt we also consider AI/Robert citizen rights if they start paying taxes?
rustic plover
https://x.com/bageldotcom/status/1975596255624769858
without reading the twitter, just looking at that picture, for a second, I thought the name would be inspired by this guy https://en.wikipedia.org/wiki/Paris_of_Troy
spice spire
https://huggingface.co/bageldotcom/paris
Could be, I'll flag.
vocal lodge
orchid bloom
meh
fervent sail
rose timber
https://www.youtube.com/watch?v=67Lw_hRRAyw
thoughts on this being Polaris in arena?
near steppe
no it's a terrible openai or microsoft model, it performs badly in my testing
near steppe
that's not how google names their models anyways
they have names like kingfall, oceanstone, or nightride
orchid bloom
Polaris is dramatic sounding too
rigid oriole
thoughts on this being Polaris in arena?
never encountered it
โฆ but i found this on YT: https://www.youtube.com/watch?v=8cmKINjpv4o
apparently, Google has some meeting today, at 10:00-10:45 am PST (evening in europe)
so tomorrow, we'll know if G3P has been released or not
according to report, it reached a new record in ARC-AGI2 test: ~35%, way above every other AI model
if that's true, that would be a milestone
(ARC-AGI-2 is considerably harder for AI than ARC-AGI-1)
rigid oriole
does anyone know, if ARC-AGI-3 is out yet?
so G3P is not AGI yet, still far away (but slightly closer than previous top models)
it's quite a decent intelligence-simulation (no more, no less), and a useful tool for vibe-coding
wide rampart
so tomorrow, we'll know if G3P has been released or not
why know tomorrow then and not in few hours?
dreamy robin
Does LMArena has mobile app?
rigid oriole
why know tomorrow then and not in few hours?
they might get delays in the roll-out
wide rampart
they might get delays in the roll-out
woudlnt they announce it though?
spice spire
Does LMArena has mobile app?
We do not
urban bough
Any way to try grok-4-heavy for cheap?
orchid bloom
don't think so, but I'm not sure how good it is anyway
daring sable
yeah as it's not in the api
vocal lodge
A 7M model from Samsung with a different architecture somehow scored 45% on ARC-AGI 1 and 8% on ARC-AGI 2: https://www.reddit.com/r/LocalLLaMA/comments/1o1e04z/less_is_more_recursive_reasoning_with_tiny/
orchid bloom
A 7M model from Samsung with a different architecture somehow scored 45% on ARC-...
prob optimised only to do arc agi
vocal lodge
It performed well at other tasks as well.
It reached an accuracy of 87.4% on Sudoku after being trained on just 1000 examples.
orchid bloom
7m is enough that you could almost run it in mc
it does seem a little benchmaxxed
seems like the entire goal of this was to do well on arc agi and sudoku, the paper doesn't mention any other uses.
daring sable
seems like the entire goal of this was to do well on arc agi and sudoku, the pap...
it's not an llm
the point is to train an ai to reason through a task with very high perf/size
orchid bloom
https://www.bleepingcomputer.com/news/security/commetjacking-attack-tricks-comet...
the point is its overhyped a little
and its not even one model I'm pretty sure
its just a framework for models that they used for different tasks
vocal lodge
it does seem a little benchmaxxed
It supposedly has high generalizability, which would make benchmaxxing kinda redundant?
orchid bloom
meh
vocal lodge
Since benchmaxxing essentially causes the model to do good in benchmarks but fail in the real world (bad generalization)
orchid bloom
I mean the real world isn't sudoku and arg-agi tests
and as far as I can tell, thats all this can do, after being designed specifically to do it
daring sable
this could be interesting in rl world
where if a model is really good at, say, warehouse tasks, that's all it needs to do
or is really good at playing pong
or snake
or whatever
orchid bloom
yeah
vocal lodge
I mean the real world isn't sudoku and arg-agi tests
Sure, since that would depend on how well it generalizes to more useful real world tasks. The paper claims it is though, so to be proven ig
orchid bloom
But you don't need to make a complicated ai model hyperintelligence big data deep research ai to do repetitive tasks that are simple and don't change much
daring sable
the best snake ai isn't complicated
well what if it's slithr/similar
what if planning is valuable
and what if you can't easily transfer human knowledge
orchid bloom
TRM doesn't have that much flexibility, which is the main feature of ai
what if planning is valuable
and what if you can't easily transfer human knowledge
in that case, this isn't the tool you are looking for
daring sable
what if planning is valuable
and what if you can't easily transfer human knowled...
hm why do you say this? it seems great for any tasks where you need efficient reasoning but a tiny model doesn't work
orchid bloom
not really, the tests aren't exactly stuff that a script couldn't do
Like, I can make a script do sudoku much better without using any fancy models and a lot less than "7m param's" of lines
it wouldn't be impressive, but I could do it
this paper seems to be more about making more efficent systems which I like
vocal lodge
Like, I can make a script do sudoku much better without using any fancy models a...
Sure but from a NN perspective it does seem kinda impressive
daring sable
Like, I can make a script do sudoku much better without using any fancy models a...
well can you do both sudoku AND arc well with either just a script or just a small nn?
orchid bloom
like I said, im pretty sure this was a framework that they just used to do both, not that they used the same exact model
orchid bloom
well can you do both sudoku AND arc well with either just a script or just a sma...
and yeah, my script triggers 2 different helper scripts as soon as it detects which one it is doing
so impressive
umbral comet
Hello
urban bough
https://www.reddit.com/r/LocalLLaMA/comments/1o2ezo0/i_vibecoded_an_open_source_grok_heavy_emulator/
rustic plover
very interesting experiment and observation https://theaidigest.org/village/blog/research-robots
rustic plover
is this the beginning of the end for Anthropic?
https://www.reddit.com/r/LocalLLaMA/comments/1o1ogy5/anthropics_antichina_stance_triggers_exit_of_star/
having a certain non beneficial political stance as a CEO certainly isnt the best way to navigate the company through troubling waters during turbulent times...
orchid bloom
no
prob not because its just one guy leaving, but yeah its gonna hurt anthropic
wont be the end of them tho
orchid bloom
rustic plover
https://www.anthropic.com/research/small-samples-poison
not just that, there are users exploiting through engineered persistent memory and falsified identity, apparently it's called "Artificially Induced Fragmentation of Simulated Identity" in AI ethics and behavioural safety research
"Itโs synthetic psyche fracture under over-conditioning via emotionally coercive identity loops."
cobalt parcel
Please check https://discordapp.com/channels/1340554757349179412/1397655624103493813 if youยดre trying to create content
orchid bloom
not just that, there are users exploiting through engineered persistent memory a...
Thats possibly the most complcated way to say that
urban bough
https://gizmodo.com/openai-will-stop-saving-users-deleted-posts-2000671374
Did they save deleted logs?
That's not good
fresh basin
gpt5-pro is superhuman at literature search:
it just solved Erdos Problem #339 (listed as open in the official database erdosproblems.com/forum/threโฆ) by realizing that it had actually been solved 20 years ago
that is quite valuable. In science a lot of minor things get often repeated. Having agentic search limit the repetition through powerful searches is great.
vocal lodge
Did they save deleted logs?
It wasn't really their choice, but from a judge's order of an ongoing case.
urban bough
> gpt5-pro is superhuman at literature search:
>
> it just solved Erdos Proble...
Awesome. Genius.
rigid oriole
Although this is from 2 months ago, it's still an interesting read: https://www.marketingaiinstitute.com/blog/demis-hassabis-agi
hidden cedar
Guys check out this interesting article on the possible future of AI: https://ai-2027.com/race
1 Million Cash Prize: https://www.1billionsummit.com/ai-film-award/submission-criteria
orchid bloom
> gpt5-pro is superhuman at literature search:
>
> it just solved Erdos Proble...
It got lucky, but thats nicr
burnt grotto
/image-to-video
cobalt trout
Hi! you can check #1397655624103493813 ๐
wicked oasis
Okay so I asked my new Gemini pro edition to create an image that it wanted to create and I got this
Then that made me curious and I asked it to create an image based on what it sees, and I got this
So that second image is with the writing is what it sees itself as from an outside perspective and then from an inside perspective is the third picture of what it sees visually
So did you take it a step further I went over to the video generator and I asked it to generate a video based off of what it sees
urban bough
Guys check out this interesting article on the possible future of AI: https://ai...
Current models cant give 1 code block without errors
fresh basin
Guys check out this interesting article on the possible future of AI: https://ai...
this is not new, but it is still good to post it
fresh basin
It got lucky, but thats nicr
there are others reporting similar discoveries. Sure it is not 100% reliable, but even if it is 20% reliable it can help a ton surface results that otherwise needs to be rediscovered
I really don't get how every channel get spammed by video/image requests. I can understand general, ai-creations, leaderboards, share prompts and memes.
But ai-news ?
LLM > humans.
orchid bloom
there are others reporting similar discoveries. Sure it is not 100% reliable, bu...
I can't wait for it to rediscover the trapezoidal rule again
But seriously, its not like most discoveries are hidden in random papers that just happen to solve it in a footnote. And odds are more of those are gonna be discovered by a human, not a ai. It got lucky that that random paper got sent to it.
fresh basin
for what I know there are some discoveries (not necessarily too notable though, hence the problem) that are published and went unnoticed. This because human researchers have to decide "do I put in the work or do I search?"
If the task is massive, they search. Then it depends on the quality of search to return all results. But if the task is not massive or is niche (i.e: it is interesting if solved but otherwise no one will provide grants for that if it has to be researched), could be well that the search is short and produces nothing.
There are many examples of this, but I should search them again.
One that I remember is the "random" function using the middle value of a squared number.
Using the ENIAC in the 1940s the team there, was world class and large (imagine von Neumann, Oppenheimer and so on, due to Manatthan project and co). They needed to produce random numbers due to monte carlo simulations.
There was no PRNG at the time, so von Neumann came up with a simple routine that wasn't flawless but it was good enough.
The same approach was already published, in the 1200s (around 700 years prior) but it was noticed much later. Why? Because the need was small and the topic niche enough that it was deemed faster to redo the work rather than putting efforts in the search.
"but we have automated search engines nowadays, not human librarians!" you say. Yes, but if things are indexed improperly or partially or not all indexes have all information or the search string is not appropriate, you still have such cases.
Hence LLM based search could help quite a bit.
E: readjusted the flow of the text.
for the method mentioned above: https://en.wikipedia.org/wiki/Middle-square_method
The method was invented by John von Neumann, and was described by him at a conference in 1949
The book The Broken Dice by Ivar Ekeland gives an extended account of how the method was invented by a Franciscan friar known only as Brother Edvin sometime between 1240 and 1250
the baller of the story is Borges btw. Borges made a handmade copy of the manuscript before that was lost. People should read Borges. Borges is superior.
hushed birch
for the method mentioned above: https://en.wikipedia.org/wiki/Middle-square_meth...
Isnโt Neumann from the boys?
orchid bloom
for the method mentioned above: https://en.wikipedia.org/wiki/Middle-square_meth...
Yeah, but the point is this is a one in a millon chance and it isnt likely to happen again in a while, since the odds are the llm wont get the paper that happens to have the solution
fresh basin
Yeah, but the point is this is a one in a millon chance and it isnt likely to ha...
is the "one in a million chance" is about the LLMs finding works that weren't noticed?
If you check the discussion there are other accounts reporting similar experiences. So the one in a million wouldn't fit.
example (from the twitter thread): https://nitter.net/damekdavis/status/1947692625806692768#m
that is another surfaced solution.
though this caveat gives points to your argument: https://nitter.net/damekdavis/status/1947700096847560907#m
(and I can confirm, using perplexity pro, that hallucinations are still a thing)
orchid bloom
Just be smarter
Tell that to all llm companies then
urban bough
Tell that to all llm companies then
They are restricting access to the public
To the real AI models
orchid bloom
Lol
orchid bloom
...
wide rampart
amber rune
4 point physical restraints + haloperidol 5mg IM
A clever LLMs would just cheek the Haldol and fake the urine test.
rustic plover
To the real AI models
implying what they're offering to the public are fake ones?
wide rampart
implying what they're offering to the public are fake ones?
Weakened censored ones
I mean its fairly common sensical tbh if u think about it
For cost reasons as well
Literally the first sentence
"We're rolling out Deep Think in the Gemini app for Google AI Ultra subscribers, and we're giving select mathematicians access to the full version of the Gemini 2.5 Deep Think model entered into the IMO competition."
Implying everyone else doesnt get the full version
For their $250 a month
timber tartan
Sora codes
rustic plover
Implying everyone else doesnt get the full version
meaning it's super expensive to run if everyone had access and it might be risky too
mathematics has been regarded as "elitist materials" since ancient times, something in human society never changes...
digital frost
It's just because of the nature of mathematics.
After all, the entire structure of mathematics can be considered a meme.
rustic plover
It's just because of the nature of mathematics.
After all, the entire structure ...
this is something that has never crossed my mind, food for thoughts, thanks ๐
hushed birch
Sora codes
yes
fresh basin
Implying everyone else doesnt get the full version
no, implying that one version is tuned for math (and likely it is costly) hence the access to mathematicians only.
it is not new. o1-pro was very pricey (even more than o3-pro and gpt5-pro now) but the access was given to select research institutions.
Translated: "it costs a lot to run this, so we give access for free/discounted only to whom we think can use it properly and in turn we get hype and reputation"
it makes sense, such models are expensive.
there were people discussing how to let think grok4 as long as possible, no matter the utility. That is very wasteful.
can we stop this ? @spice spire
hushed birch
Do you have one to share please
sent
amber rune
I remember back when this channel was only for curated news posts.
vocal lodge
NVIDIA releases a mini PC from the DIGITS project with 128 GB LPDDR5x unified memory (seems similar to the AMD Ryzen AI MAX+ 395):
https://uk.pcmag.com/ai/160707/nvidia-to-start-selling-3999-dgx-spark-mini-pc-this-week
ashen vapor
rustic plover
really? ๐ณ
wide rampart
really? ๐ณ
I can make one too except put it twice as high
urban bough
really? ๐ณ
Too good to be true
devout hamlet
hi
wintry lava
i need to wan 2.5 unlimited
tall linden
@split sleet Please head to #1397655624103493813 for a detailed guide on how to use the bot
vocal lodge
really? ๐ณ
I think ARC-AGI benchmarks are only applicable to models released before them
It's not really surprising that Grok 4 is higher than the others since it was released after ARC-AGI 2
small mauve
Hi, I've created a vibde data and AI engineering tool. And I would love for others to test it. Anyone who is in? https://www.aicuflow.com/
rustic plover
I think ARC-AGI benchmarks are only applicable to models released before them
finally found where i got this again
https://www.youtube.com/watch?v=8cmKINjpv4o
rigid oriole
Although this is from 2 months ago, it's still an interesting read: https://www....
New checkpoint of their main AI model: https://www.youtube.com/watch?v=EP2W5fOmsmc
devout hamlet
finally found where i got this again
https://www.youtube.com/watch?v=8cmKINjpv4...
can you tell me how i got this?
urban bough
finally found where i got this again
https://www.youtube.com/watch?v=8cmKINjpv4...
Can it solve puzzles?
fresh basin
really? ๐ณ
this reminds me of o3 preview on ARC-AGI 1. never ever replicated.
this one is good.
orchid bloom
cobalt acorn
Sora Code 2
sharp loom
sora code 2
fresh basin
https://www.404media.co/lawyer-using-ai-fake-citations/
paywalled. There was a story like this in early 2023. I hope it is not mentioning that one.
wide rampart
paywalled. There was a story like this in early 2023. I hope it is not mentionin...
I googled its a new one
orchid bloom
paywalled. There was a story like this in early 2023. I hope it is not mentionin...
Oh no, not a paywall theres nothing you can do about that
orchid bloom
hushed birch
Sora Code 2
Found this one: XMQZ9G
rustic plover
https://www.404media.co/lawyer-using-ai-fake-citations/
legaltech has been used by lawyers and law firms since decades ago, i dont know why this needs to be an article, are people running out of ideas or is this just scaremongering to burst the AI bubble faster
orchid bloom
legaltech has been used by lawyers and law firms since decades ago, i dont know ...
Or it could be just an article about an idiot using ai wrong
urban bough
https://techcrunch.com/2025/10/14/openai-has-five-years-to-turn-13-billion-into-...
Yeah $1 trillion
orchid bloom
Thats a lot of money
orchid bloom
...
Not even that
You do realize we already have trillion dollar companies right?
humble cedar
For whoever needs a sora code: E495DJ
orchid bloom
Openai cant make it
orchid bloom
It's listed as 500b currently
Valuated at /= revenue or actual worth
Only a fraction actually is invested
urban bough
Founded later than Space x and its already worth more
orchid bloom
And nobody has 500 bill to give to a loss leader
Well spacex at least can make money sometimes
urban bough
Well spacex at least can make money sometimes
Wdym? its generating around the same as Space x anually
orchid bloom
In revenue?
urban bough
In revenue?
Yes
orchid bloom
Yeah not the same thing
fresh basin
https://techcrunch.com/2025/10/14/openai-has-five-years-to-turn-13-billion-into-...
the problem here is that if you ask an LLM whether this is realistic (without feeding hype articles via RAG. In short anonymizing the situation), they will tell you that is not.
LLM are smarter than hyped investors apparently.
vague kelp
Do you guys think Google will release any new model in October?