Surprised no one is talking about it but the 0.1 version bumped the parameters from 284B to 552B but “more efficient”, particularly kv cache usage

I wonder if that’s why 3.8 got so much better? Mixing the reasoning traces from both sides seems to be effective.

I’m surprised they allow open lid drinks in the lab. One wrong bump and poof 300K easy.

> 23 agents total.

This hit a bit too close to home. Sol has the same issue, spawns a lot of agents for no good reasons (besides burning tokens).

I heard this was a thing when listening to a Theo podcast, he mentioned to add a "Only use subagents if the user explicitly requests them" line in your agents.md file.

I don't know if it works, but I've always had a consistent level of token burn on my plans (I've only heavily used Sol after adding it).

I’m more curious how each 4 bit quant compares. It seems like NVFP4 outperforms Q4_K_M in terms of speed and top 1 but is only good for expensive Nvidia cards

I swear, Qwen 3.8 27B @ Q8 is smarter than Sonnet 5 most of the time. Why wouldn’t corporate America self host at this point, especially with better options like Deepseek Flash and GLM 5.3 flash that’s a middle ground between Sonnet and Opus

Agreed. And conversely, American models can also just as easily be secretly influenced for bad things, or be more tightly controlled by the government, to corporate America's own detriment.

Post-IPO I'd trust the American models far far less than the Chinese models.

The most insidious advertising in the world is about to be surfaced as people use LLMs to look for product recommendations.

It's wild that people are so lost in the sauce of social media that they have no qualms handing over all their data to an authoritarian ethno state with a single ruler who appointed themselves for life with unrestricted unilateral control over every aspect of the state. And here we are calling for collapse because mom might get recommended Gain instead of Tide.

Sorry, how does running a local model hand over my data?

You are very confused about the security and what can happen here.

The context here of comparing trust between American models (which are mostly centrally hosted) to Chinese models (rather than "local" models) implies trust levels in who is hosting.

American local models don't hand over data either, which would nullify the point of the comment.

For most people around the world America is more of a threat than China. Heck for most Americans the American government is more of a threat than the Chinese government.

trump has named himself dictator for life now? when did that happen?

What's even more wild to me is that basically ALL modern electronics and all modern batteries are made from raw materials sourced by forced and child labor (and sometimes both)... yet the vast majority of the entire world just turns a blind eye to it.

https://gcdnb.pbrd.co/images/gKMYRcEIeE9j.png

This is very confused, first the world does not turn a blind eye, and by having US purchasers of these products the US is actually forcing a big change in the standards for the better due to purchasing power. In particular the US has avoided huge amounts of potential purchase in solar, largely under the justification of avoiding forced Chinese labor.

Second, the "ALL" qualification is extremely wrong, as only small fractions of these products in the US could ever be sourced to the human rights violations cited here.

America's own demise will be made in America, stamped by American laws

From whence shall we expect the approach of danger? Shall some trans-Atlantic military giant step the earth and crush us at a blow? Never. All the armies of Europe and Asia...could not by force take a drink from the Ohio River or make a track on the Blue Ridge in the trial of a thousand years. No, if destruction be our lot we must ourselves be its author and finisher. As a nation of free men we will live forever or die by suicide. ― Abraham Lincoln

@q4 is definitely smarter than sonnet from what I’ve seen so far. It’s even caught problems in code made by fable, when using it as a code reviewer.

> Why wouldn’t corporate America self host at this point

Because they've been trained to think "cloud-first" for a decade?

Still a ton of non tech companies doing a digital / tech transformation out there too lol. Maybe some so far behind they still have the real estate and rack space to get ahead on this one

is this actually the case? I haven't kept up with the small models

but if there's roughly Sonnet 4.6 level capable open small models, then I'd be impressed

Qwen 3.8 27B is the real deal BUT remember to use froggeric template and/or medium reasoning.

https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates

Qwen 3.8 27B is better than Sonnet 4.6

Qwen 3.8 27b has the juice. Try it.

Why not Luna?

I mean, why self-host? Deepseek v4 flash is dirt-cheap on openrouter. Inference is a race to the bottom at this point.

I’m honestly surprised this is better benchmark wise than the text only model. I figured the addition of vision would take away from some of the text capabilities.

One of the early results from multimodal training is that it kinda works like cross training. Training vision helps with text tasks and visa versa.

I believe that multimodal training increases the robustness of latent representations regardless of which modality is being processed.

Tangentially this makes me wonder how large Opus really is. Perhaps Opus is a lot smaller than most of the 1T+ assumptions, just a lot more post-training/ finetuning on a 300-400B sized MoE model.

How do people bypass captcha or robot checks? All I wanted is a price aggregator but it always gets blocked by major retailers.

I'm with you here. Every demo I asked for where I knew a captcha / cloudflare would block an AI directed scraper was unsuccessful / produced unsatisfactory results. WebMCP for the win, or loss, depending on your perspective. Personally, I could get behind WebMCP if micropayments ever became a thing. Of course, then my incentive to trick your Agent in crawling millions of pages and paying me lots of cash would be rather high.

If you get a children’s card, they print your kids name right on it. It’s a nice little souvenir to keep.

Ironically, our administration pushing for ban of the AI chips to China is forcing them to make smaller and more efficient models which seems like a requirement for running on Chinese chips. I wouldn’t be surprised this model was tailored to run purely on Chinese chips. Same thing with Deepseek MLA, the drastically lower KV cache memory requirement was born out of necessity so it runs on the Huawei chips.

This is exactly what Jenson said in all of his interviews. Banning it in the short term would have long term consequences.