r/LocalLLaMA • u/jacek2023 llama.cpp • 7h ago
Discussion Qwen 4 35B is not ruled out
I think you missed this guys
656
Upvotes
r/LocalLLaMA • u/jacek2023 llama.cpp • 7h ago
I think you missed this guys
•
u/WithoutReason1729 4h ago
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.
31
u/Skyline34rGt 7h ago
A lot hopium here so if they finally not release any small model exept 27b (which need nice amount of Vram) I got other good news for all poor setups:
We should soon have MiniCPM5-15B-A2.5B - https://github.com/ggml-org/llama.cpp/pull/32386 👍
4
u/Monkey_1505 6h ago
They are all going to have engrams so will be 25% or so larger (but you can put that in ram). So they'll have different sizes.
119
u/Monad_Maya llama.cpp 6h ago
27B also qualifies as a smaller one (and the one mentioned officially).
At this point, I'm not sure if the Qwen folks are intentionally being vague or just really bad at english.
151
u/No_Swimming6548 llama.cpp 7h ago
They said themselves lol. But ngl I'm very hyped rn.
55
u/-Krotik- 7h ago
9B qwhen
109
u/Spitihnev 7h ago
Wake me up when they finally release them. Getting tired of this month long hype train they put in motion.
22
u/james_pic 6h ago
I finally got round to reading The Qwen Flash Next Technical Report, and one interesting tidbit is that they mostly used 35B A3B and 25B A3B models in their ablation studies, which is to say that they trained a lot of those size models on variants of the QFN architecture as part of developing it. These will have been short training runs with small data sets, that aren't competitive enough to release, and many labs don't bother releasing fully trained versions of the models they used in their ablation studies or in their ladders, so it doesn't necessarily mean anything by itself, but it is true that they've got a fair bit of experience training Qwen 4 models that size.
35
u/Numerous-Ad6217 7h ago
Probably referring to 27B
47
u/Weak-Shelter-1698 llama.cpp 7h ago
I really Hope. 35B surpasses 3.8 27B
10
u/Holiday_Point_603 7h ago
I also want a 9B for simple tasks
22
u/Gomitopia 4h ago
The fact they're calling 35b small is what makes me sad.
6
u/Sweet-Jump1024 7h ago
I'll believe it qwhen I see it.
6
u/Nefilim314 5h ago
Can’t wait for this FLASH ULTRALIGHT 250B Superleggera that can run on 256GB unified at Q0.
6
u/AcerVentus 4h ago
Me and muh 9B model : 👀
11
u/Kidplayer_666 7h ago
Qwhopium
5
u/NigaTroubles 7h ago
Smaller than 35b ? 27b
5
u/mt5o 6h ago
Cybersec being gutted has killed all my hype ripperoni
9
u/Double-Extent-8739 7h ago
After starta and basalt came out I am only hoping for qwen flash.
8
u/JLeonsarmiento 7h ago
4
u/source-drifter 7h ago
smaller ones doesnt mean 35b and they already announced no more 35b as i remember. well, i would be glad to be wrong, though
4
u/Kerem-6030 🥔 hardware 6h ago
i am still hope for 9b qwhopeul
4
u/trolololster 3h ago
a 9b-a1b moe thank you :)
7
u/Atretador llama.cpp 5h ago
they said 3.8 would have a small one too
3
u/siete82 6h ago
Is there a real big difference between 27B and 35B? I only ask for good tooling call support and reasoning on small models, idc about world knowledge.
3
u/fishhf llama.cpp 6h ago
They will start by releasing Qwen4 0.8B, so that there's always 27B we can look forward to.
2
u/Front-Presence-8532 5h ago
How much can they possibly push the performance at this less training...
2
u/jax_cooper 4h ago
I dont think its going to be 27b and 35b as we though that qwen 3.5 would have 30b and 32b. Some similar sized ones would get out but I would be surprised if it would be exactly 27b and 35b. I would love some bigger MoEs though that can fit into my 64gb macbook.
2
u/Perfect-Campaign9551 59m ago
The latest tests of Qwen 4 are not encouraging. I am not holding up any hopes that it's that much better than 3.8
3
u/taking_bullet 6h ago
They said the same before 3.8 release. Don't get too excited.
3
u/CodexHax 6h ago
9B pretty please
3
u/Iq1pl 6h ago
We are gonna get 35B but it’s gonna be dense not MOE 😭💔
3
u/xadiant 3h ago
40B A4B + 20B n-gram table would be nice
1
u/Significant_Mail5398 7h ago
Chad
1
u/LegacyRemaster 7h ago
uhhhh spicy
1
u/Equivalent_Bit_461 7h ago
No fucking way
1
u/thestillwind 4h ago
Don’t play with me
1
u/dusanodalovic 3h ago
i was only waiting for the 27b, so a 35b on top is a bonus. for agent work i care how it does in opencode on a real repo, the benchmark table tells me little
1
u/zsydeepsky 2h ago
This might imply the whole lineup. It's also a good time to refresh the entire family since the model architecture was updated from Qwen3.5.
1
u/Character-Second781 2h ago
While we're at it, I wouldn't mind them issuing a 9B and a 2B.
1
u/PerAngusta-AdAugusta 2h ago
Qwype!
1
u/Eyelbee 2h ago
You know what would be a disaster? If they skip the 120A6B Flash-Next, and the 27B ends up tying with the 38FN, leaving us with zero capability gains.
1
u/Important_Earth6615 2h ago
hope they didn't forget about tiny ones like 4 or 9
1
u/Charuru 2h ago
Ideally they would release a jev-like system 1 decision model.
1
u/saosebastiao 2h ago
So let's fucking see it already. JFC, the slow roll on this is driving me crazy.
1
u/keepthepace 1h ago
Qwen 4 35B is not out.
Keep the noise low please.
1
u/ahorsenamedjeff 1h ago
I am iso a good 20b model
1
u/WhoRoger 1h ago
4B and lower dammit! Compute doesn't grow on trees
1
u/xsilas43 1h ago
Man I hope so! My favorite version qwen.
1
u/madkimchi 1m ago
Any gossip on the possibility of a dense 4B/8B?
1
u/Barni275 6h ago
I'm so happy with 27B, that I'm not even waiting for Qwen 4, since 27B does all my work. Though, I agree, that larger MoE companion (suitable for consumer hardware, as QFN) is also very appreciated, as it fits better for somr hardware setups.
I don't get a hype about smaller models. Obviously, there is a limit of intellect-per-bit somewhere. Smaller models will always be dumber than larger ones. 27B can be a workhorse on 16GB VRAM, and I think it is a sweet spot of consumer hardware. I wouldn't expect any good intelligence level on 4GB VRAM iGPU.
What I'm dreaming about, is that ngram approach would allow to put more world knowledge in still-a-consumer-class models.
0
u/fatboy93 3h ago
I havent seen this level of hopium and copium outside of r/frankocean lmao
1
u/rorowhat 4h ago
Personally I would love a dense Qwen 3.8-9B