r/deeplearning • • 6h ago

Need advice on accurate golf ball tracking using computer vision

6 Upvotes

I'm trying to build a golf ball tracking app similar to Shot Tracer and SmoothSwing. I've experimented with several open-source AI models, but I haven't been able to achieve reliable tracking accuracy.

The ball is tiny and moves very fast, making it difficult to track consistently across video frames.

I'm looking for advice from people experienced in computer vision, object tracking or ML:

  • What approaches/models work best for tracking tiny, fast-moving objects?
  • Should I combine object detection with temporal tracking, optical flow or Kalman filters?
  • Are there any specific models, datasets or research papers worth exploring?

I'm not looking for a basic YOLO implementation. I'd like to understand how to build a genuinely reliable tracking pipeline.

Any suggestions or experiences would be appreciated!


r/deeplearning • • 40m ago

Looking for self-learners to join BlueprintML

Post image
1 Upvotes

r/deeplearning • • 6h ago

My LSTM is fine at 1 day ahead and useless at 1 month. Is that just how price series work?

2 Upvotes

student project, forecasting crypto price ranges (btc, eth, sol) with an LSTM that outputs quantiles.

- 1 day ahead: the 80% band covers about 76%, decent

- 1 week: 68%

- 1 month: 51%, basically a coin toss with extra steps

i tried more layers, more history (2 years instead of 6 months), and adding volume and funding rates. nothing moved the 1 month number much.

my guess is the 1 month range depends on stuff that just isnt in the price history (news, macro). but i might also be doing something dumb with how i build the training windows.

is it normal for DL models to fall apart like this on longer horizons, or should i be looking at a different architecture?


r/deeplearning • • 3h ago

Prompt Engineering and LLM-as-a-Judge (2026)

Thumbnail youtube.com
1 Upvotes

r/deeplearning • • 7h ago

Struggling to optimize YOLO on a heavily imbalanced, small-object dataset (Road Damage - RDD2022). What approach yields the best ROI?

Thumbnail reddit.com
1 Upvotes

r/deeplearning • • 8h ago

Fazendo fine tune no modelo de 100 milhões de parâmetro usando LoRa

1 Upvotes

r/deeplearning • • 19h ago

Materials-science models keep accuracy with 90% less training data (npj Computational Materials)

7 Upvotes

A paper in npj Computational Materials reports materials-science models retaining their accuracy while trained on about 90% less data. Data efficiency matters a lot in scientific ML, where labeled examples are expensive simulations or experiments.

Is the field over-indexing on dataset size when better inductive bias does this? Where else would a 10x data reduction change what is feasible?

Research highlights like this also land in r/AINewsRumors.


r/deeplearning • • 9h ago

I built a free AI course for developers | 45 lessons covering ML, LLMs, RAG and deployment

Thumbnail reddit.com
1 Upvotes

r/deeplearning • • 11h ago

i built MicroTorch: a lightweight tensor autograd engine and neural network framework from scratch in pure Python

Thumbnail reddit.com
1 Upvotes

r/deeplearning • • 1d ago

Jev for speech

Thumbnail gallery
39 Upvotes

Marimba is Jev for audio: a System One model for speech. You ask typed questions about the last 8 seconds of audio and get typed answers back: a yes/no, a choice, or a calibrated score.

  • Is someone speaking? Did the turn end? Which language? Did someone say "refund"? Did the speaker change?
  • One pass of a frozen Qwen3-ASR-0.6B encoder serves every question, with small readouts on top. Streams every 250 ms.
  • Runs locally on CPU or GPU. Apache-2.0, pip install "marimba-audio[torch]".
  • Plugs into Pipecat, LiveKit and Vapi as a turn detector.
from marimba import Marimba, Question

model = Marimba.from_pretrained(backend="torch", device="cpu", dtype="float32")
questions = [
    Question.score("Has the speaker finished?"),
    Question.choice("What language?", ["en", "pt", "es"]),
]
for d in model("clip.wav", questions):
    print(d.task, d.value, d.probability)

On 1,000 paired public questions against much bigger audio LLMs (Qwen3-Omni-30B-A3B, Qwen2-Audio-7B, FireRedAudio 10.6B), Marimba wins binary term detection on Common Voice and FLEURS, and turn end (0.935 AUROC vs 0.54–0.79). That last one is in-distribution for us, since we trained on Smart Turn data. It loses on Speech Commands, and Smart Turn v3.2 still beats it on its own test set (0.982 vs 0.930). Full table on the model card.

  • Live demo: https://huggingface.co/spaces/charcot-ai/marimba
  • Model + comparison table: https://huggingface.co/charcot-ai/marimba
  • Code: https://github.com/Charcot-AI/marimba-api
  • Paper: https://arxiv.org/abs/2611.18330

Happy to answer questions. Feedback on which questions you'd want it to answer is very welcome.


r/deeplearning • • 17h ago

Nice little fun project to get you excited...I hope 🥳

Thumbnail gallery
2 Upvotes

So a few weeks back, I got a message from a guy on here asking about problems with training a robotic arm in a simulator, particularly with collisions. I made a note of it and today got working on it.

So the basic idea is to train a robotic arm in a simulated environment where it learns which movements cause collisions, which are safe and how to recognise and sort coloured objects.

The system uses three learning components:

A neural network that learns to predict collisions though virtual touch sensors along the arm.

A neural network that learns which grasping and placement movements are most likely to succeed.

A radial-basis neural vision classifier trained using pixels from a single 384 × 384 RGB camera, without a depth sensor.

Both successful and unsuccessful movements contribute towards learning, creating a predictive 3D map of collision risks and safe movements.

Once trained, the virtual touch sensors and teacher are disabled, leaving the robot to use its learned knowledge alongside its programmed movement controller.

The long-term idea is to train a robotic arm entirely within a simulation, reducing the sensory hardware needed in the real world.

The project is open source, MIT licensed, written entirely in HTML and JavaScript, and runs directly in your browser.

It's still an experimental concept, but I'd be interested to hear what people think.

Simulator:

https://rickey1990.github.io/NTRAM-Neurally-Trained-Robot-Arm-Model/

GitHub:

https://github.com/rickey1990/NTRAM-Neurally-Trained-Robot-Arm-Model


r/deeplearning • • 1d ago

i kindda made a new optimizer (ApexW) that beats AdamW and bitsandbytes) i tested it in a100 and t4 from google collab and with diff lr and multiple random seeds(well in a100 only tho)

10 Upvotes

i have been working on a new optimizer from scratch called ApexW to see if i could beat AdamW on convergence while keeping the memory footprint lower than bitsandbytes to make sure it wasn't just noise i locked deterministic seeds and ran side-by-side tests against standard torch AdamW and bnb 8-bit across two setups: a free T4 (fp16) on llama 3.2 3b, and an A100 (bf16) scaling up to llama 3.1 8b across a few different learning rates.

apexw has 3 modes compact 8bit and hybridapexw more info of it in readme even the compact formulation beat torch AdamW on loss while using way less memory, and the 8-bit mode pushed it even further—cutting active vram roughly in half compared to bnb (0.67gb vs 1.48gb on 8b, with the state footprint down to ~120mb instead of 320mb). step speed also came out slightly faster than bnb, and training loss ended up lower across 1e-4, 2e-4, and 5e-4,these are still short 60-100 step runs just to sanity-check convergence, throughput, and memory overhead. next step is running full multi-epoch fine-tunes and downstream evals to see how the update rule holds up later in training.

threw the full benchmark runs and logs into a colab if anyone wants to check the numbers or test it on their own setup

collab link for a100 result: https://colab.research.google.com/drive/1mMejzRoCnD6avlOQ5SQDuiLndN5ovax9#scrollTo=be28d3ad

collab link for t4 result: https://colab.research.google.com/drive/14tLAX6kZYy2918sx1ztIEwb5R-1c3KiX#scrollTo=f750c631

for githubproject: https://github.com/omen42515-prog/apexw/

curious what you guys think or what models/configs i should throw at it next.


r/deeplearning • • 20h ago

Xhaeyorin - The Four-Point Obstruction to Continuous 3D Rotation Canonicalization and Linear-Size Frames for Unordered Point Clouds

2 Upvotes

A continuous rotation canonicalization assigns a single standard pose to an unordered point cloud, with the same answer for every rotated copy. For centered 3D clouds of a fixed size \(n\), this manuscript proves that such a rule exists on the full domain if and only if \(n\leq 3\). It gives explicit canonical poses for up to three points and proves impossibility from four points onward. This answers the proper-rotation version of the unordered-point-cloud question raised by Dym, Lawrence and Siegel at ICML 2024. For uncentered clouds rotated about a fixed origin, the corresponding threshold is \(n\leq 2\). raw.githubusercontent.com

Xhaeyorin - The Four-Point Obstruction to Continuous 3D Rotation Canonicalization and Linear-Size Frames for Unordered Point Clouds | Zenodo

The obstruction already appears in a family of asymmetric clouds whose points have distinct distances from the centroid. A full axial rotation traces a contractible loop in this family, but an equivariant orientation rule would send that loop to a noncontractible loop in \(SO(3)\). Every continuous single-orientation predictor therefore makes a 180° equivariance error somewhere along each axial rotation orbit of the family. For the explicit four-point example, the smallest achievable worst-case displacement after optimal point matching is exactly \(2(\sqrt{2}-1)/\sqrt{14+(\sqrt{2}-1)^2}\), or 22.0062% of the cloud’s Frobenius norm.

The manuscript constructs a continuous alternative by assigning a weighted distribution of orientations to each cloud. Each directed convex hull edge defines an orientation, weighted by its length times its exterior dihedral angle. The resulting distribution of canonicalized inputs remains continuous when the hull changes, points collide, or a cloud collapses to a plane or line. The construction uses at most \(6n-12\) orientations for \(n\geq4\) centered 3D points. The exact worst case is \(2n\) for planar clouds embedded in 3D with \(n\geq3\). Across all centered 3D clouds, the exact worst cases for 4, 6 and 12 points are 12, 24 and 60 orientations, respectively.

For geometric deep learning, the construction gives a finite averaging rule that turns continuous vector- and tensor-valued backbones into rotation-equivariant predictors while preserving their existing permutation symmetry. The manuscript also proves that, for fixed ambient dimension \(d\), the worst-case local orientation-support requirement grows as \(\Theta(n^{\lfloor d/2\rfloor})\) among clouds of rank at least \(d-1\). A concrete isotropic cloud made of two orthogonal regular 50-gons in 4D requires at least 10,000 physical orientations in the stated frame model. The exact global minimum for general \(n\) in 3D and a global Lipschitz bound for the hull construction remain open.

The deposit includes the 12-page manuscript, a Python reference implementation, a deterministic data generator, numerical results and 10,188 synthetic verification records. These comprise 50 three-dimensional equivariance cases, nine degeneracy perturbations, 128 four-point matching cases, one reference 4D cloud, and 10,000 proper rotation matrices with their induced point permutations.


r/deeplearning • • 16h ago

Flow matching, explained with a galaxy

Thumbnail youtu.be
1 Upvotes

r/deeplearning • • 1d ago

How is it possible that OKLS can't outperform Muon in terms of step efficiency?

3 Upvotes

SOAP is more step efficeint than Shampoo, and KL-Shampoo is more step efficient than SOAP.

Then how is OKLS getting outperformed by Muon in terms of step efficiency where it's a zero-staleness implementation of KL-Shampoo?

It only gets ahead of Muon in terms of parameter efficiency in very long training runs.


r/deeplearning • • 21h ago

Access Dental Management Data Breach Impacts Over 340,000

1 Upvotes

Access Dental Management disclosed a breach affecting over 340,000 people. Attackers exfiltrated personal records, health data, and insurance information in a single incident.

This is not an isolated case — healthcare organizations are aggressively adopting AI pipelines for claims processing, patient intake, and records management. Each pipeline hop that touches raw PHI is a new exposure point. Concentrated sensitive data at any layer of the stack amplifies the blast radius when a breach occurs.

The 340,000-person headcount here came from one management company. That scale is achievable precisely because health identifiers, insurance IDs, and personal records flow through centralized systems without being structurally isolated from each other.

Practitioners building or auditing these pipelines: how are you handling PHI as it moves between ingestion, processing, and storage layers? Are you tokenizing before it enters the pipeline, after, or relying on access controls at the data store level — and what has actually held up under real audit scrutiny?


r/deeplearning • • 1d ago

built a tiny vision model from scratch just for learning and somehow it got 50+ downloads on huggingface 😅

2 Upvotes

so ik there are way better vision models out there yaar. i built this one just out of curiosity only, cause i wanted to learn how these things actually work from inside.

and to be honest its not entirely mine, i took a lot of help from claude to build it. like the architecture, debugging, training setup, figuring out why my mac was training so slow, all that. but i learned a lot in the process which was the main goal anyway.

its called tiny-vision. its around 24M params and trained completely from scratch, no pretrained weights or anything. i trained it on my macbook pro m5 and it took like 42 min on flickr8k (only 6k images).

basic idea is pretty simple:

image/video → small ViT encoder → adapter → tiny decoder → caption text

for videos it takes frames every few seconds, captions them and makes a timeline like [00:04–00:10] a dog runs on the beach. so any llm can kinda “watch” a video even if it dont support video natively.

i also made an MCP server for it, and tbh i was surprised that it actually gives a little bit better context in claude when i throw images or videos at it. i even tested it with a 10-15 min youtube video (this one) and it still worked fine. not perfect at all, but chal raha hai so i’m happy.

i uploaded it to huggingface just to have it somewhere, and also cause i kinda like the open source thing. later when i checked it was at like 44 downloads, and now its 50+. ik thats not a lot bhai, but its my first time putting something open source out in this field so it felt pretty cool ngl. a lot of people have built way cooler stuff than this, i just made it to learn.

some honest stuff:

  • it gets the scene right most of time (snow, grass, water etc) but the subject is often wrong lol
  • it loves saying “a man in a blue shirt” for everything, pata nahi kyun 😂
  • its v0.1 and trained on very small data, so dont expect too much

random thing i learned on mac (MPS):

  • swapping the conv2d patch embedding for reshape + linear was like 30x faster
  • manual attention was ~1.5x faster than pytorch’s sdpa

next i want to train on flickr30k and maybe try making it plug directly into qwen/llama through llama.cpp (mmproj). lets see kitna ho pata hai.

code: https://github.com/amar683/tiny-vision
model: https://huggingface.co/amartomar683/tiny-vision-flickr8k

would love any feedback or tips


r/deeplearning • • 1d ago

Gemma 4 31B fine-tune for drug-level sentiment in medical text, appreciate testing

1 Upvotes

I fine-tuned Gemma 4 31B for drug-level sentiment.

Input: a pharma or medical text plus a list of drugs.

Output: one Positive/Neutral/Negative label per drug, as JSON. I'm looking for people to test it on their own data.

Apache 2.0. Gated with automatic approval (you tick a box saying you won't use it for diagnosis or treatment decisions).

Sentiment, 473 held-out labels

ModelAccuracy
This fine-tune91.3%
Gemma 4 31B base90.5%
Qwen3.8-27B83.5%
Qwen3-32B83.3%
MedGemma 27B82.9%
Llama 3.1 8B76.3%

The other models were asked about one drug at a time with a long labelling prompt. Asked for all drugs at once in JSON, base Gemma scored 32% because 59% of its answers didn't parse. The fine-tune had no malformed JSON in 1,500 test answers. Negative precision: 84% vs 71% for base (45 Negatives in the test set).

Medical benchmarks

BenchmarksThis fine-tuneBest frontier score found
MedQA (thinking)94.296.5 (o1)
MedMCQA, 1k sample (thinking)81.483.9 (o1-preview)
MMLU medical (step by step)94.296.0 (GPT-5)
PubMedQA (thinking)80.282.0 (GPT-4 + Medprompt)

Frontier scores are from the Vals.ai MedQA leaderboard and published papers. Fine-tuning kept Gemma's medical knowledge: the scores match the base model.

Testing

Use the prompt format from the model card, thinking off and temperature 0. The FP8 build runs on vLLM (command on the card) and needs about 31 GiB of VRAM for the weights. I've only run it on a 96 GB RTX PRO 6000.

Useful feedback:

  • wrong labels, with the text, the drugs and the label you expected
  • document types, languages or lengths (over 4k tokens) it wasn't trained on
  • hardware and VRAM reports, especially from 48 GB cards

Trained on ~50k curated pharma and medical documents, LoRA rank 16.


r/deeplearning • • 1d ago

Siemens Mendix Studio Pro MCP Server Vulnerabilities

1 Upvotes

CISA issued an advisory this week for Siemens Mendix Studio Pro covering vulnerabilities in its MCP Server. Attackers with network access can interact with the server remotely, invoke tools without authorization, and potentially exfiltrate data. No authentication bypass or insider access required — network reach is enough.

This isn't a Siemens-specific problem. MCP is being embedded into production enterprise workflows at scale right now. Every deployed MCP server that accepts tool calls over a network is a potential lateral movement entry point. The CISA advisory makes it concrete, but the exposure class is industry-wide.

The uncomfortable part: most organizations have no inventory of which MCP servers are live, which tools each server exposes, or which callers are permitted to invoke which actions. Discovering you have a problem after an advisory drops — or after a breach — is the current default.

For those running MCP servers in production or evaluating MCP-based tooling: how are you handling authorization at the tool-call level? Are you relying on network segmentation, or do you have something evaluating individual invocations before they execute?


r/deeplearning • • 1d ago

Last day of ICLR rebuttal phase!

4 Upvotes

Since yesterday was the deadline for CVPR submission, can we expect reviewers to be more engaged in the last day of ICLR rebuttal phase?


r/deeplearning • • 23h ago

What makes a from-scratch model repo look different from a wrapper, when you only have the code?

Post image
0 Upvotes

I’ve been building a tool (AI-Atlas) that reads public GitHub repos and tries to answer one question: is there real model work here, or a wrapper around someone else’s API?

Some things that turned out to matter:

  • A README is the least reliable signal. “Novel transformer architecture” often sits on top of one API call.
  • From-scratch work shows up in the code itself (layers, losses, training loops), sometimes in Rust or CUDA rather than Python.
  • Infrastructure repos with words like “inference” or “pipeline” fooled an LLM judge badly. In one case a Terraform module was rated 1.0 for ML. Checks in code now catch that.

My own AlexNet reimplementation got 60.5/100, with the judge pointing out that my custom ReLU is just a torch.clamp wrapper... which is fair to be honest.

Curious what this sub thinks: which signals in a repo would convince you that someone understands deep learning rather than just using it? You can test it on your own GitHub at getaiatlas.com (free, no account), and I’d love examples where it gets it wrong :)


r/deeplearning • • 1d ago

Looking for Real-World ML Project Ideas for My Final-Year Major Project

Thumbnail reddit.com
1 Upvotes

r/deeplearning • • 2d ago

I wrote a visual guide to Linear Attention — from the original idea to Gated DeltaNet and Kimi Linear

Post image
73 Upvotes

Hey everyone!
I’ve been diving into linear attention recently and put together a four-part blog series tracing its evolution — from early Linear Attention to Delta Rule, Gate Rule, Gated DeltaNet, and Kimi Linear.
I went through the key papers and drew illustrations to make the algorithms and their underlying intuition easier to understand.
I’m also planning a follow-up series exploring linear attention from an AI infrastructure perspective.
Hope this is useful to anyone interested in the topic! I’d really appreciate any feedback, corrections, or suggestions. Happy to discuss!
Blog: https://xiaofengwang01.github.io/2026/11/10/linear-attention.html


r/deeplearning • • 1d ago

More than 34% of U.S. Companies Report that Employees Use AI Tools with No Governance Policy

3 Upvotes

A Pipefy survey found that 34% of U.S. organizations have no AI governance policy in place. No inventory of which models are running. No controls on what enterprise data those models are processing. No record of what actions AI agents are taking.

That is one in three U.S. companies right now, not as a projected future state.

AI adoption has outrun AI oversight. Employees are connecting models and agents to internal systems, and in a third of organizations there is no policy, no visibility, and no audit trail for any of it. The sensitive data those models are touching — customer records, financial data, internal communications — is moving through systems nobody is watching.

The gap is not closing. AI tool adoption keeps accelerating and governance programs are not keeping pace.

For practitioners inside these organizations: how are you actually handling this? Are you going top-down with policy mandates, bottom-up with approved tooling lists, or something else entirely? What has worked and what has failed?