r/mlscaling • • 6h ago

STARN Protocol: A System Architecture for Deterministic, Fact-Anchored AI Execution

Thumbnail
2 Upvotes

r/mlscaling • • 6h ago

Prompt Engineering and LLM-as-a-Judge (2026)

Thumbnail
youtube.com
0 Upvotes

r/mlscaling • • 18h ago

Horizon Supercomputer Opens to Early Users - Fastest Academic Supercomputer in the United States

Thumbnail
news.utexas.edu
6 Upvotes

r/mlscaling • • 15h ago

We've refreshed out model offerings!

Thumbnail
0 Upvotes

r/mlscaling • • 1d ago

Smol, T "...Claude figured out how to train a 6M parameter model that fits into 3.2 MB optimized for Game Boy. The result: on-cartridge generative conversation with a finch oddly knowledgeable about the Revolutionary War", Tim Hwang

Thumbnail x.com
67 Upvotes

r/mlscaling • • 15h ago

We've refreshed our model offerings!

Thumbnail
0 Upvotes

r/mlscaling • • 1d ago

R, Emp, RL Rethinking "RL Generalizes, SFT Memorizes": The Role of SFT Data, Hou et al. 2026 [SFT matches generalization of RL on the same data (no. of rollouts); diversity in teacher models is beneficial]

Thumbnail
arxiv.org
7 Upvotes

r/mlscaling • • 1d ago

Theory Branchy, distributed inference focused training

Thumbnail
1 Upvotes

Hope you like the read!


r/mlscaling • • 1d ago

OP, Econ, NV, Hardware "Obituaries", Ben Thompson

Thumbnail
stratechery.com
6 Upvotes

r/mlscaling • • 1d ago

SenseNova-Loop-9B: 32 decoder layers run as 56 by looping the middle 24 twice (9B multimodal, open weights)

1 Upvotes

Weights are at https://huggingface.co/sensenova/SenseNova-Loop-9B. About 9B parameters, text and image input, text output. Layers 4 through 27 are executed two times on one set of weights and the four layers on either side once, so the checkpoint holds 32 layers and a forward pass computes 56.

The README also reports what happens when the loop count changes: same 9B model, same training data and settings, 1 to 4 loops. All four tasks improve over the single-pass baseline, and the best results come at 3 or 4 loops: Workbuddy-office is 16.93% higher at 3, LiveCodeBench V6 8.10% higher at 4. The release defaults to 2 loops for inference efficiency. On the README's numbers it scores 36.67 on AutomationBench, the same as Qwen3.8-27B, and 65.31 vs 65.01 on AIDABench.


r/mlscaling • • 1d ago

N, NV, Hardware "Facing Criticism, Trump Administration Says It’s Investigating Megaspeed" (Nvidia continued shipping >$0.8b of GPUs to Megaspeed subsidiary for 8 months after Megaspeed placed on 'no sell' list)

Thumbnail
nytimes.com
1 Upvotes

r/mlscaling • • 3d ago

N, NV, Hardware, Econ "Lutnick Pushed to Weaken Chip Rules That Overlap With His Family Business: The commerce secretary has been writing new rules that would affect Southeast Asian data centers, some of which are clients of his former firm"

Thumbnail
nytimes.com
19 Upvotes

r/mlscaling • • 3d ago

R, T, Emp, FB Unbundling Multimodal Vision Encoding: training 200+ MLLMs to find encoder pretraining is optional but vision-only parameters are not

Post image
7 Upvotes

r/mlscaling • • 3d ago

How to Distill and train a smaller model for agentic coding tasks

Thumbnail
0 Upvotes

r/mlscaling • • 3d ago

N, NV, Hardware, Econ "Ex-Nvidia CEO misled top lawyer on affair with Chinese businesswoman, sources say"

Thumbnail reuters.com
15 Upvotes

r/mlscaling • • 3d ago

Hoarding GGUFs in case Hugging Face changes? Fit 10% more on the same drive, byte-for-byte lossless

Thumbnail gallery
1 Upvotes

r/mlscaling • • 4d ago

N, NV, Hardware "Alice Huang-Linked Firm Procured Banned Nvidia Chips in China"

Thumbnail
bloomberg.com
4 Upvotes

r/mlscaling • • 4d ago

Zipping my code for Claude by hand turned into a tool. The hard part wasn't the zip

0 Upvotes

I assumed the useful part would be picking the right files. It turned out to be the trip back. AI tools return a ZIP with paths flattened, or wrapped in an extra folder, or with a file cut short and a comment saying "rest unchanged", and meanwhile I've edited two of those files myself.

So contextzip keeps a snapshot of what it sent and, when the reply comes back, compares three versions of every file: what I sent, what's on disk now, what came back. Clean edits go in, mine are merged around, and anything it isn't sure about waits for me.

It's free and open source: https://github.com/akadeepesh/contextzip. There's a no-install version at https://www.contextzipcli.com if you want to try it on a folder.


r/mlscaling • • 4d ago

Exploring a LoRA Optimization Research Idea

Thumbnail
0 Upvotes

r/mlscaling • • 5d ago

Training a 1T MoE on JUPITER: TorchTitan optimizations from 90 to 1,300 TPS

7 Upvotes

Write-up on pretraining a 952B-total / 32.8B-active MoE on GH200s over slow InfiniBand: Muon without the communication overhead, activation offloading to Grace, FSDP memory fragmentation. Fixes upstreamed to PyTorch and TorchTitan. (I work at Domyn, happy to answer questions.)

https://pytorch.org/blog/training-a-1t-parameter-moe-on-eu-public-infrastructure-with-pytorch-and-torchtitan/


r/mlscaling • • 5d ago

For PII detection in financial text, a small model reportedly matched a large one. The data made the difference

Thumbnail
0 Upvotes

r/mlscaling • • 5d ago

New Inference Engine to run Ripple-65B-Preview

Thumbnail
huggingface.co
2 Upvotes

r/mlscaling • • 6d ago

R, OP, NV, Econ, Hardware "NVIDIA (NVDA): The China Problem", Culper Research 2026-05-13 (are Nvidia financials massively overstated due to hidden diversion to China?)

Thumbnail culperresearch.com
23 Upvotes

r/mlscaling • • 6d ago

N, NV, Hardware "NVIDIA Announces CEO Transition" (Jensen Huang -> Colette Kress)

Thumbnail
nvidianews.nvidia.com
1 Upvotes

r/mlscaling • • 6d ago

Governing Clinical AI Deployment: A Mathematical Framework for Transparency-Dependent Autonomy

Thumbnail
mdpi.com
1 Upvotes

Title: [Discussion] Does scaling model capability also scale the reliability needed for autonomous decisions?

As AI models become more capable, we increasingly discuss how to scale their reasoning, performance, and autonomy.

But there is another question worth examining:

How do we scale the evidence required to trust an AI system to act autonomously?

In healthcare, high predictive performance does not automatically establish that a model should make decisions without human oversight.

I recently developed a mathematical framework for clinical AI deployment that combines calibrated confidence, explanation quality, and clinical guideline alignment.

One finding was particularly interesting: although the framework included three dimensions, its case-level decisions largely followed confidence-based ranking. This raises a deeper question about whether additional transparency signals actually improve decision-level autonomy.

I would be interested in discussing whether this problem has parallels in scaling the reliability and autonomy of large AI systems.

Research: https://www.mdpi.com/4173088