r/deeplearning • u/FishermanResident349 • 39m ago
Looking for self-learners to join BlueprintML
BlueprintML: https://github.com/AbhinandanMandal/BlueprintML
Discord: https://discord.gg/RR5XhNhH4
r/deeplearning • u/FishermanResident349 • 39m ago
BlueprintML: https://github.com/AbhinandanMandal/BlueprintML
Discord: https://discord.gg/RR5XhNhH4
r/deeplearning • u/Neurosymbolic • 3h ago
r/deeplearning • u/kamesh_singh • 6h ago
I'm trying to build a golf ball tracking app similar to Shot Tracer and SmoothSwing. I've experimented with several open-source AI models, but I haven't been able to achieve reliable tracking accuracy.
The ball is tiny and moves very fast, making it difficult to track consistently across video frames.
I'm looking for advice from people experienced in computer vision, object tracking or ML:
I'm not looking for a basic YOLO implementation. I'd like to understand how to build a genuinely reliable tracking pipeline.
Any suggestions or experiences would be appreciated!
r/deeplearning • u/Luci_nishant • 6h ago
student project, forecasting crypto price ranges (btc, eth, sol) with an LSTM that outputs quantiles.
- 1 day ahead: the 80% band covers about 76%, decent
- 1 week: 68%
- 1 month: 51%, basically a coin toss with extra steps
i tried more layers, more history (2 years instead of 6 months), and adding volume and funding rates. nothing moved the 1 month number much.
my guess is the 1 month range depends on stuff that just isnt in the price history (news, macro). but i might also be doing something dumb with how i build the training windows.
is it normal for DL models to fall apart like this on longer horizons, or should i be looking at a different architecture?
r/deeplearning • u/Savings_Durian3268 • 7h ago
r/deeplearning • u/oversolan007 • 8h ago
r/deeplearning • u/klsameera • 9h ago
r/deeplearning • u/ZeroYDELTA555 • 11h ago
r/deeplearning • u/Convincing_Convo • 16h ago
r/deeplearning • u/WAMFT • 17h ago
So a few weeks back, I got a message from a guy on here asking about problems with training a robotic arm in a simulator, particularly with collisions. I made a note of it and today got working on it.
So the basic idea is to train a robotic arm in a simulated environment where it learns which movements cause collisions, which are safe and how to recognise and sort coloured objects.
The system uses three learning components:
A neural network that learns to predict collisions though virtual touch sensors along the arm.
A neural network that learns which grasping and placement movements are most likely to succeed.
A radial-basis neural vision classifier trained using pixels from a single 384 × 384 RGB camera, without a depth sensor.
Both successful and unsuccessful movements contribute towards learning, creating a predictive 3D map of collision risks and safe movements.
Once trained, the virtual touch sensors and teacher are disabled, leaving the robot to use its learned knowledge alongside its programmed movement controller.
The long-term idea is to train a robotic arm entirely within a simulation, reducing the sensory hardware needed in the real world.
The project is open source, MIT licensed, written entirely in HTML and JavaScript, and runs directly in your browser.
It's still an experimental concept, but I'd be interested to hear what people think.
Simulator:
https://rickey1990.github.io/NTRAM-Neurally-Trained-Robot-Arm-Model/
GitHub:
https://github.com/rickey1990/NTRAM-Neurally-Trained-Robot-Arm-Model
r/deeplearning • u/Dense_Primary629 • 19h ago
A paper in npj Computational Materials reports materials-science models retaining their accuracy while trained on about 90% less data. Data efficiency matters a lot in scientific ML, where labeled examples are expensive simulations or experiments.
Is the field over-indexing on dataset size when better inductive bias does this? Where else would a 10x data reduction change what is feasible?
Research highlights like this also land in r/AINewsRumors.
r/deeplearning • u/Severe-Ad8673 • 20h ago
A continuous rotation canonicalization assigns a single standard pose to an unordered point cloud, with the same answer for every rotated copy. For centered 3D clouds of a fixed size \(n\), this manuscript proves that such a rule exists on the full domain if and only if \(n\leq 3\). It gives explicit canonical poses for up to three points and proves impossibility from four points onward. This answers the proper-rotation version of the unordered-point-cloud question raised by Dym, Lawrence and Siegel at ICML 2024. For uncentered clouds rotated about a fixed origin, the corresponding threshold is \(n\leq 2\). raw.githubusercontent.com
The obstruction already appears in a family of asymmetric clouds whose points have distinct distances from the centroid. A full axial rotation traces a contractible loop in this family, but an equivariant orientation rule would send that loop to a noncontractible loop in \(SO(3)\). Every continuous single-orientation predictor therefore makes a 180° equivariance error somewhere along each axial rotation orbit of the family. For the explicit four-point example, the smallest achievable worst-case displacement after optimal point matching is exactly \(2(\sqrt{2}-1)/\sqrt{14+(\sqrt{2}-1)^2}\), or 22.0062% of the cloud’s Frobenius norm.
The manuscript constructs a continuous alternative by assigning a weighted distribution of orientations to each cloud. Each directed convex hull edge defines an orientation, weighted by its length times its exterior dihedral angle. The resulting distribution of canonicalized inputs remains continuous when the hull changes, points collide, or a cloud collapses to a plane or line. The construction uses at most \(6n-12\) orientations for \(n\geq4\) centered 3D points. The exact worst case is \(2n\) for planar clouds embedded in 3D with \(n\geq3\). Across all centered 3D clouds, the exact worst cases for 4, 6 and 12 points are 12, 24 and 60 orientations, respectively.
For geometric deep learning, the construction gives a finite averaging rule that turns continuous vector- and tensor-valued backbones into rotation-equivariant predictors while preserving their existing permutation symmetry. The manuscript also proves that, for fixed ambient dimension \(d\), the worst-case local orientation-support requirement grows as \(\Theta(n^{\lfloor d/2\rfloor})\) among clouds of rank at least \(d-1\). A concrete isotropic cloud made of two orthogonal regular 50-gons in 4D requires at least 10,000 physical orientations in the stated frame model. The exact global minimum for general \(n\) in 3D and a global Lipschitz bound for the hull construction remain open.
The deposit includes the 12-page manuscript, a Python reference implementation, a deterministic data generator, numerical results and 10,188 synthetic verification records. These comprise 50 three-dimensional equivariance cases, nine degeneracy perturbations, 128 four-point matching cases, one reference 4D cloud, and 10,000 proper rotation matrices with their induced point permutations.
r/deeplearning • u/No-Conclusion3720 • 21h ago
Access Dental Management disclosed a breach affecting over 340,000 people. Attackers exfiltrated personal records, health data, and insurance information in a single incident.
This is not an isolated case — healthcare organizations are aggressively adopting AI pipelines for claims processing, patient intake, and records management. Each pipeline hop that touches raw PHI is a new exposure point. Concentrated sensitive data at any layer of the stack amplifies the blast radius when a breach occurs.
The 340,000-person headcount here came from one management company. That scale is achievable precisely because health identifiers, insurance IDs, and personal records flow through centralized systems without being structurally isolated from each other.
Practitioners building or auditing these pipelines: how are you handling PHI as it moves between ingestion, processing, and storage layers? Are you tokenizing before it enters the pipeline, after, or relying on access controls at the data store level — and what has actually held up under real audit scrutiny?
r/deeplearning • u/EmuAfter5933 • 23h ago
I’ve been building a tool (AI-Atlas) that reads public GitHub repos and tries to answer one question: is there real model work here, or a wrapper around someone else’s API?
Some things that turned out to matter:
My own AlexNet reimplementation got 60.5/100, with the judge pointing out that my custom ReLU is just a torch.clamp wrapper... which is fair to be honest.
Curious what this sub thinks: which signals in a repo would convince you that someone understands deep learning rather than just using it? You can test it on your own GitHub at getaiatlas.com (free, no account), and I’d love examples where it gets it wrong :)
r/deeplearning • u/AltruisticCouple3491 • 1d ago
I fine-tuned Gemma 4 31B for drug-level sentiment.
Input: a pharma or medical text plus a list of drugs.
Output: one Positive/Neutral/Negative label per drug, as JSON. I'm looking for people to test it on their own data.
Apache 2.0. Gated with automatic approval (you tick a box saying you won't use it for diagnosis or treatment decisions).
Sentiment, 473 held-out labels
| Model | Accuracy |
|---|---|
| This fine-tune | 91.3% |
| Gemma 4 31B base | 90.5% |
| Qwen3.8-27B | 83.5% |
| Qwen3-32B | 83.3% |
| MedGemma 27B | 82.9% |
| Llama 3.1 8B | 76.3% |
The other models were asked about one drug at a time with a long labelling prompt. Asked for all drugs at once in JSON, base Gemma scored 32% because 59% of its answers didn't parse. The fine-tune had no malformed JSON in 1,500 test answers. Negative precision: 84% vs 71% for base (45 Negatives in the test set).
Medical benchmarks
| Benchmarks | This fine-tune | Best frontier score found |
|---|---|---|
| MedQA (thinking) | 94.2 | 96.5 (o1) |
| MedMCQA, 1k sample (thinking) | 81.4 | 83.9 (o1-preview) |
| MMLU medical (step by step) | 94.2 | 96.0 (GPT-5) |
| PubMedQA (thinking) | 80.2 | 82.0 (GPT-4 + Medprompt) |
Frontier scores are from the Vals.ai MedQA leaderboard and published papers. Fine-tuning kept Gemma's medical knowledge: the scores match the base model.
Testing
Use the prompt format from the model card, thinking off and temperature 0. The FP8 build runs on vLLM (command on the card) and needs about 31 GiB of VRAM for the weights. I've only run it on a 96 GB RTX PRO 6000.
Useful feedback:
Trained on ~50k curated pharma and medical documents, LoRA rank 16.
r/deeplearning • u/No-Conclusion3720 • 1d ago
CISA issued an advisory this week for Siemens Mendix Studio Pro covering vulnerabilities in its MCP Server. Attackers with network access can interact with the server remotely, invoke tools without authorization, and potentially exfiltrate data. No authentication bypass or insider access required — network reach is enough.
This isn't a Siemens-specific problem. MCP is being embedded into production enterprise workflows at scale right now. Every deployed MCP server that accepts tool calls over a network is a potential lateral movement entry point. The CISA advisory makes it concrete, but the exposure class is industry-wide.
The uncomfortable part: most organizations have no inventory of which MCP servers are live, which tools each server exposes, or which callers are permitted to invoke which actions. Discovering you have a problem after an advisory drops — or after a breach — is the current default.
For those running MCP servers in production or evaluating MCP-based tooling: how are you handling authorization at the tool-call level? Are you relying on network segmentation, or do you have something evaluating individual invocations before they execute?
r/deeplearning • u/Safe-Escape197 • 1d ago
so ik there are way better vision models out there yaar. i built this one just out of curiosity only, cause i wanted to learn how these things actually work from inside.
and to be honest its not entirely mine, i took a lot of help from claude to build it. like the architecture, debugging, training setup, figuring out why my mac was training so slow, all that. but i learned a lot in the process which was the main goal anyway.
its called tiny-vision. its around 24M params and trained completely from scratch, no pretrained weights or anything. i trained it on my macbook pro m5 and it took like 42 min on flickr8k (only 6k images).
basic idea is pretty simple:
image/video → small ViT encoder → adapter → tiny decoder → caption textfor videos it takes frames every few seconds, captions them and makes a timeline like [00:04–00:10] a dog runs on the beach. so any llm can kinda “watch” a video even if it dont support video natively.
i also made an MCP server for it, and tbh i was surprised that it actually gives a little bit better context in claude when i throw images or videos at it. i even tested it with a 10-15 min youtube video (this one) and it still worked fine. not perfect at all, but chal raha hai so i’m happy.
i uploaded it to huggingface just to have it somewhere, and also cause i kinda like the open source thing. later when i checked it was at like 44 downloads, and now its 50+. ik thats not a lot bhai, but its my first time putting something open source out in this field so it felt pretty cool ngl. a lot of people have built way cooler stuff than this, i just made it to learn.
some honest stuff:
random thing i learned on mac (MPS):
next i want to train on flickr30k and maybe try making it plug directly into qwen/llama through llama.cpp (mmproj). lets see kitna ho pata hai.
code: https://github.com/amar683/tiny-vision
model: https://huggingface.co/amartomar683/tiny-vision-flickr8k
would love any feedback or tips
r/deeplearning • u/Future_Pace_5290 • 1d ago
SOAP is more step efficeint than Shampoo, and KL-Shampoo is more step efficient than SOAP.
Then how is OKLS getting outperformed by Muon in terms of step efficiency where it's a zero-staleness implementation of KL-Shampoo?
It only gets ahead of Muon in terms of parameter efficiency in very long training runs.
r/deeplearning • u/omendUUde • 1d ago
i have been working on a new optimizer from scratch called ApexW to see if i could beat AdamW on convergence while keeping the memory footprint lower than bitsandbytes to make sure it wasn't just noise i locked deterministic seeds and ran side-by-side tests against standard torch AdamW and bnb 8-bit across two setups: a free T4 (fp16) on llama 3.2 3b, and an A100 (bf16) scaling up to llama 3.1 8b across a few different learning rates.
apexw has 3 modes compact 8bit and hybridapexw more info of it in readme even the compact formulation beat torch AdamW on loss while using way less memory, and the 8-bit mode pushed it even further—cutting active vram roughly in half compared to bnb (0.67gb vs 1.48gb on 8b, with the state footprint down to ~120mb instead of 320mb). step speed also came out slightly faster than bnb, and training loss ended up lower across 1e-4, 2e-4, and 5e-4,these are still short 60-100 step runs just to sanity-check convergence, throughput, and memory overhead. next step is running full multi-epoch fine-tunes and downstream evals to see how the update rule holds up later in training.
threw the full benchmark runs and logs into a colab if anyone wants to check the numbers or test it on their own setup
collab link for a100 result: https://colab.research.google.com/drive/1mMejzRoCnD6avlOQ5SQDuiLndN5ovax9#scrollTo=be28d3ad
collab link for t4 result: https://colab.research.google.com/drive/14tLAX6kZYy2918sx1ztIEwb5R-1c3KiX#scrollTo=f750c631
for githubproject: https://github.com/omen42515-prog/apexw/
curious what you guys think or what models/configs i should throw at it next.
r/deeplearning • u/Valuable_Team_96 • 1d ago
r/deeplearning • u/solanotodesch • 1d ago
Marimba is Jev for audio: a System One model for speech. You ask typed questions about the last 8 seconds of audio and get typed answers back: a yes/no, a choice, or a calibrated score.
pip install "marimba-audio[torch]".
=
=
On 1,000 paired public questions against much bigger audio LLMs (Qwen3-Omni-30B-A3B, Qwen2-Audio-7B, FireRedAudio 10.6B), Marimba wins binary term detection on Common Voice and FLEURS, and turn end (0.935 AUROC vs 0.54–0.79). That last one is in-distribution for us, since we trained on Smart Turn data. It loses on Speech Commands, and Smart Turn v3.2 still beats it on its own test set (0.982 vs 0.930). Full table on the model card.
Happy to answer questions. Feedback on which questions you'd want it to answer is very welcome.
r/deeplearning • u/Ok-Memory6156 • 1d ago
Since yesterday was the deadline for CVPR submission, can we expect reviewers to be more engaged in the last day of ICLR rebuttal phase?
r/deeplearning • u/LivingCompetitive384 • 1d ago
Hey everyone!
I've been exploring an interesting problem in RLHF: how asynchronous rollout systems can influence the experiences that actually make it into model training.
We studied this through PPO experiments with GPT-2 and LLaMA-3-8B, looking at latency-dependent selection effects, their impact on policy optimization, and ways to correct for them.
One result that caught our attention: GSM8K accuracy dropped from 68.4% to 44.1% under rollout truncation.
The work introduces a diagnostic called Effective Gradient Information (EGI) and a correction method called Selection-Probability Weighting (SPW).
This research has been accepted at NeurIPS 2026, and I'll be presenting it in Sydney this December.
Curious to hear whether others have encountered similar issues in large-scale model training or asynchronous inference systems. Anyone else attending NeurIPS?