r/ResearchML • • 10h ago

Update: I did it! OpenReview changed the PhD advisor requirement!

30 Upvotes

After repeatedly emailing CVPR and OpenReview about a situation where someone couldn't complete their OpenReview profile because they didn't have an advisor or an advisor's email address to verify, I finally got a response saying that adding a PhD advisor is no longer required to complete the profile.

Not saying I caused the change, but I definitely bugged them enough about it lol.

Glad they fixed this. Hopefully it helps others in the same situation!


r/ResearchML • • 5h ago

New reviewing policy, what do you think?

7 Upvotes

Every reviewer who does not engage in the rebuttals, at least once, needs to have their paper desk-rejected. I think this is fair and will substantially improve reviews so authors do not write “new” papers just for the reviewers to ghost them. We should be mindful of resources and make sure they do not go to waste.


r/ResearchML • • 45m ago

ICLR rebuttal: 2 weak accepts, 1 strong reject who barely engaged with the rebuttal. What should we do?

3 Upvotes

Our ICLR submission received scores of 3, 3, 1. All three reviewers rated soundness 2.

The two positive reviewers recognized the technical contribution. One even inspected our code confirmed that all their main concerns were resolved after our rebuttal, keeping their positive score.

The negative reviewer (score 1, confidence 2) criticized limited baselines (the reviewer did not suggest any specific baselines for comparison), required additional experiments to isolate gains, and critizied readability, giving us informativeness 1 and presentation 1.

During rebuttal, we:

- Explained that for our main task/contribution, no prior baselines exists, except for the one we compared to in the paper, and added one external baseline for the secondary task/contribution.

- We also added several new ablations addressing the specific criticisms.

- Ran additional experiments controlling for potential confounding factors.

- Added full computational cost accounting.

- Added unified results and ablation tables to the main text (as the reviewer requested).

Our experiments show substantial gains of our method compared to prior approaches.

The negative reviewer waited over a week since we posted our rebuttal and responded only in the final hours of the discussion, essentially restating his previous concerns: insufficient baselines, hard to evaluate the method (despite the clear summary evaluation table appearing in the main text) and that the paper was difficult to follow. They provided no new technical objections or explanation of why the additional experiments were insufficient, and kept their score at 1.

We responded politely, pointing to the new evidence, and posted a factual summary for the AC.

What would you do in this situation? Is there any way to persuade the negative reviewer, or is it better to focus on making the AC evaluates the substantive evidence independently? Would another comment help, or only harm?


r/ResearchML • • 6h ago

I was tech chair for ICCV 2021. Here's my Defense of Academic Gatekeeping.

7 Upvotes

I was tech chair for ICCV 2021, and had "root access" to the whole process, so I saw (and scrubbed) its barnacly underbelly.

The ICCV organization tried to combat fraud, plagiarism, and cheating, but it was not a fair fight. There were at that point no effective mechanisms for detecting and punishing authors who tried to gain an unfair advantage.

Academic ML needs better policies. And we need to get this right because society needs better ways to build consensus and seek truth.

I wrote this essay to share some meta-science analysis I did over the last few weeks on academic ML and a few policy ideas.

My hope is to engage in discussion about academic ML policy. I believe that the only way we make progress on this is to sample and refine ideas together. So I ask: what are the policies you'd like to see adopted by academic journals and conferences?

Full essay: https://lacuna.tiptreesystems.com/paper/a-defense-of-academic-gatekeeping/art_221912b72e224a4393c508d4dd3ce5ed

(I'm now a postdoc-entrepreneur at Mila with Hugo Larochelle and Chris Pal, working on meta-science, multi-agent games, and AI for science.)


r/ResearchML • • 3h ago

[D] ICLR 2027 rebuttal: What should I do?

2 Upvotes

What would you do in this situation?
I responded to the first reviewer’s initial review. They came back with follow-up questions, which I also answered. They then said they had no further questions and needed some time to reassess their evaluation. I haven’t heard back since.
The second reviewer gave me some hope from the beginning. In their initial review, they wrote:
The paper has several issues that I think are not easy to address, however a compelling reply could make me upgrade the score.
Then, on November 16, after reading our responses, they wrote:
Overall, I am convinced by the response and am leaning toward a more positive evaluation, which I will grant after I will double check the whole paper in its most updated version.
Since then, there has been no further response or score update, and we’re now very close to the end of the discussion period.
Has anyone been in a similar situation? Should I follow up with the reviewers, contact the AC, or just wait?

I got 4 - 2 -2 with confidence 4-3-4


r/ResearchML • • 9h ago

ICLR no score update from reviewers

5 Upvotes

With just a few hours left in the discussion period, I have scores of 3, 2, 2, and no changes have been made yet. The reviewer who gave me a 3 has kept their score, while I'm still waiting for the other two reviewers to provide feedback and hopefully increase their scores.

This is frustrating because I've sent multiple reminders, and I can't even do that anymore. Meanwhile, I keep seeing people here getting score increases, which makes me feel like my paper is definitely further down the rankings.

This is just a rant, but how hard can it be to provide feedback? It's been over 6 days now.


r/ResearchML • • 13h ago

ICLR Reviewer Concerns

9 Upvotes

Hi All,

I submitted a paper at ICLR this time. Got reviews with scores 222 with the confidence of 232. Both the reviewers that had low confidence talked about very minor/presentation issues that simply had to be clarified which we did. The content of the review also made it very apparent that they were not aware of the literature or the field in itself and spent very little time on the paper.The reviewer with confidence 3 suggested ablations which we ran and got back. Now both the low confidence reviewers have responded with no new clarifications or concerns but that they would like to keep their score, and did not state any reason why. And the high confidence reviewer has simply not responded.

As the discussion currently stands there are no unaddressed concerns and no serious claims that we had to acknowledge. There were also no loopholes pointed out, and the additional experiments only reinforced our results further. The reviewers also praise the results, call the work timely, and say it is informative, but the scores have not changed. Is there no way to get an AC/SAC to look at cases like this where we're stuck in a horrible cycle of bad reviewers throughout?


r/ResearchML • • 2h ago

AI models in extraction methods of Secondary Metabolites

1 Upvotes

Seeking guidance to understand how AI models enhance and optimize the extraction methods of secondary metabolites from plants. I am from Plant Science related background, but I need to learn this for my Interview.


r/ResearchML • • 2h ago

An idea for bias mitigation in LLMs. Would it work?

1 Upvotes

It is known that LLMs have biases in their output, due to both training data and the training process. See the articles below, for instance:

https://arxiv.org/html/2410.15413v2
https://arxiv.org/abs/2309.00770
https://www.mdpi.com/2079-9292/15/9/1824

I've got a crazy idea to mitigate these biases, and I would like to know your opinion: would it work?

Start with a large corpus of training data, unlabeled. Pick any commercial LLM (call it M1) and give it a task like:

You are an expert at labeling training data for LLMs, and an expert at LLM training techniques. Your task is to label a corpus of training data, and preapre a training procedure, under a procedure to be describe later on. You have some biases, and is aware of them, namely:

(List of known biases on LLM output and training)

While doing your work, you will actively avoid these biases, applying the known mitigation techniques described in these articles (a list of articles follow).

(Labeling / training procedures follow)

So, M1 will train a new model, M2, with the given corpus. I expect that M2 will also have biases, but different from the ones from M1.

Then, we get adversarial. Make M1 emulate a variety of people, chatting with M2, and vice-versa; both LLMs must be instructed to think of themselves as humans when doing the chatting. Do the same with M1 to M1 and M2 to M2. Log every interaction.

With this additional data, make M2 do the same task as M1, with the same corpus, plus the chat logs from M1 and M2 to guide bias mitigation; this copy of M2 is informed that M1 and M2 in the chat are both LLMs, and where they "think of" themselves as human. The resulting LLM, M3, is expected to have less biases than both M1 and M2.

From then on, repeat: repeat the steps that used M1 and M2 to create M3, to use M2 and M3 to create M4, and so on: M_n created from M_(n-1) and M_(n-2). Stop when a LLM is too similar to the previous one, and only then call the human experts to measure its biases.


r/ResearchML • • 6h ago

[Article] A Hybrid Intrusion Detection System for Smart Home Security Using LSTM and Autoencoder Neural Networks (M. R. Jasim, S. H. Mahdi, H. A. H. Al Naffakh)

1 Upvotes
  • DOI/PMID/ISBN: 10.4028/p-WeGz5P
  • URL
  • Other comments: Thanks in advance!

r/ResearchML • • 15h ago

Can Humor and Memes Have a Place in Academic Research?

4 Upvotes

I am a graduate student in my third year of research. I recently had a paper accepted for publication and am currently working on a project page to introduce the work.

When explaining ideas, I believe that making them intuitive, approachable, and easy to understand is one of the most important things. For this reason, I enjoy presenting the methods I propose through memes and humorous illustrations.

However, I sometimes wonder whether this approach might be considered inappropriate or even off-putting in academia, which can be a relatively formal and serious environment. I would appreciate hearing some advice and perspectives from more senior researchers on this matter.

Thank you for your time!


r/ResearchML • • 16h ago

A random split overstated my model’s recall by ~10 points (NYC facade inspections). Is my evaluation fair?

4 Upvotes

I'm doing a student project on NYC's facade inspection program. Buildings over six stories get rated Safe, SWARMP or Unsafe every five years, and a 2024 law requires the city to use a predictive model to prioritize inspections. I couldn't find a public one, so I tried building my own from the public filings.

Task: predict whether a building will be rated Unsafe at its next inspection cycle.
Setup: trained on cycles 6→7 and 7→8, tested once on 8→9 (about 11k buildings, 25% Unsafe).

Results on the held-out cycle:
- Top 20% of the ranked list catches 36.4% of Unsafe buildings (random order: 19.8%, last rating only: 32.6%)
- LightGBM and logistic regression perform the same
- A random split of the same data gave 46.8%, so about 10 points too optimistic
- Each cycle is harder to predict than the last
- A conformal recall guarantee works (90% target gave 89.2%) but needs about 75% of buildings inspected

Random splitTime split (test 8→9)
Recall in top 20%46.8%36.4%
PR-AUC0.5480.430
AUC0.7630.687
Recall targetRealized on 8→9Share of buildings to inspect
80%80.6%62.6%
90%89.2%75.4%
95%93.6%83.3%

Same-cycle CV recall in top 20% (a rough ceiling): 6→7 53.3%, 7→8 47.7%, 8→9 39.2%

After I looked at 8→9, I split it into dev and reserve halves and only kept ideas that helped both. None did.

Questions:

  1. Is that dev/reserve approach reasonable once a test set has been used?
  2. What would you use for conformal calibration when labeling rules change between cycles?
  3. Labels come from inspectors hired by the buildings themselves, not by the city. Any ideas for handling that with public data?

Data is NYC Open Data (DOB NOW facade filings). Numbers are in the tables above.


r/ResearchML • • 1d ago

OpenReview with Posthumous Authors

46 Upvotes

My PhD student recently passed away a few weeks ago. He was so close to finishing his first paper and I'm determined to finish it off and get it into a good AI conference because getting published was one of his last wishes.

I'm not sure which conference yet, but I realised that I don't know how to handle posthumous submissions with OpenReview. He doesn't have a profile on OpenReview, so I'm not sure whether I should submit it without him and request author alteration later.

I suspect the answer is most certainly talk to the PCs, but I was wondering if anyone has done this before.


r/ResearchML • • 6h ago

Cursor Ultra for $18 instead of $200. seriously how?

0 Upvotes

been using it for 3 months, no issues. feels too cheap to be real. if they’re still making money at this price, how are they getting the accounts?


r/ResearchML • • 10h ago

ICLR 2027: Scores improved from 3/2/1 to 3/3/1, but the reviewer who gave 1 is silent. Any chance?

1 Upvotes

My ICLR 2027 scores went from 3/2/1 to 3/3/1 after rebuttal.
The reviewer who gave a 1 mainly criticized presentation and clarity, but rated soundness as 3. We substantially rewrote the paper to address these issues and responded to the concerns of the other reviewers.
After rebuttal, the reviewer who initially gave a 2 raised their overall score to 3, as well as both presentation and informativeness from 2 to 3.
However, the reviewer who gave a 1 has been completely silent, with no response or discussion.
How would ACs evaluate this case? Would they consider that the main concerns behind the score of 1 were presentation-related and have since been addressed, especially given that another reviewer acknowledged the improvements?
Does this 3/3/1 still have a realistic chance of acceptance?


r/ResearchML • • 12h ago

Looking to collaborate on Computer Vision research

1 Upvotes

I've been exploring Computer Vision, particularly Visual SLAM, 3D perception and reconstruction, through research oriented projects and open-source contributions (Open CV, Kornia and Apache Iceberg).

I'm looking to connect and collaborate with researchers, PhD students, postdocs or master's students working in these areas. I'd be interested in contributing to experiments, projects or ongoing research where my engineering background could be useful.

Also open to research guidance from people working in this space.


r/ResearchML • • 1d ago

CVPR 2027: OpenReview profile incomplete because my advisor's PhD advisor passed away

22 Upvotes

I submitted a paper to CVPR, and my OpenReview profile is complete, but my advisor's isn't.

My advisor is 60+, and his PhD advisor passed away more than 6–7 years ago. OpenReview requires him to add his PhD advisor, but that person doesn't have an OpenReview account or an active email address, so he can't add him manually.

CVPR explicitly states that papers with incomplete coauthor profiles may be desk-rejected, so I'm really worried.

Has anyone faced this issue? How did you resolve it? Could our paper actually get desk-rejected because of this?

Edit: I did it! After repeatedly emailing CVPR and OpenReview about this issue, I finally got a response confirming that adding a PhD advisor is no longer required to complete the OpenReview profile.


r/ResearchML • • 1d ago

Looking for study partner for RL, DL and CV.

3 Upvotes

Hi buddy,

If you have some knowledge of deep learning , machine learning ,NLP or Cv and are willing to prepare llms, Reinforcement learning and doing research work. Please ping me up. Maybe we can study and let's make this easy . Though I am thinking of starting to read research papers too .

My background: I am from one of the iits , Branch - Mathematics and Computing.

Have two intern offers for next summer ofc one is related to AI .

So if u r genuinely interested let's make this journey easy.


r/ResearchML • • 23h ago

The Fastest Academic Supercomputer in the U.S. | Horizon Supercomputer

Thumbnail
news.utexas.edu
1 Upvotes

r/ResearchML • • 1d ago

[Article] When AI outperforms humans, who bears the burden of proof?

Thumbnail
reddit.com
1 Upvotes

r/ResearchML • • 1d ago

Just submitted my first CVPR paper

31 Upvotes

Just submitted my first paper to CVPR 2027. nervous but excited. Wish me luck 🤞🤞🤞

My submission number was 37K+
Curious what everyone else's submission numbers look like. How high are they going this year? Last submission was 42k+.


r/ResearchML • • 1d ago

Looking to work as a Research Assistant to for my Master's thesis

1 Upvotes

I am a final year Msc AI & ML student from India, as part of my course syllabus I am supposed to undertake a master's thesis project under the guidance of a PI of a research group.

I'm interested in working on areas such as adversarial machine learning, llm security and AI robustness.

I am currently doing a small research project evaluating the limits of rewrite based AI text detectors and other than that I have also conducted an independent empirical study by Stress testing detectors.

If there is anyone who currently is a part of a research group currently working on this field, kindly give me a referral or an opportunity to prove my worth to be a part of your group.

I have been cold mailing PI's for weeks and there has been no response, hence using social media as my last resort.


r/ResearchML • • 1d ago

Xhaeyorin - The Four-Point Obstruction to Continuous 3D Rotation Canonicalization and Linear-Size Frames for Unordered Point Clouds

1 Upvotes

A continuous rotation canonicalization assigns a single standard pose to an unordered point cloud, with the same answer for every rotated copy. For centered 3D clouds of a fixed size \(n\), this manuscript proves that such a rule exists on the full domain if and only if \(n\leq 3\). It gives explicit canonical poses for up to three points and proves impossibility from four points onward. This answers the proper-rotation version of the unordered-point-cloud question raised by Dym, Lawrence and Siegel at ICML 2024. For uncentered clouds rotated about a fixed origin, the corresponding threshold is \(n\leq 2\). raw.githubusercontent.com

Xhaeyorin - The Four-Point Obstruction to Continuous 3D Rotation Canonicalization and Linear-Size Frames for Unordered Point Clouds | Zenodo

The obstruction already appears in a family of asymmetric clouds whose points have distinct distances from the centroid. A full axial rotation traces a contractible loop in this family, but an equivariant orientation rule would send that loop to a noncontractible loop in \(SO(3)\). Every continuous single-orientation predictor therefore makes a 180° equivariance error somewhere along each axial rotation orbit of the family. For the explicit four-point example, the smallest achievable worst-case displacement after optimal point matching is exactly \(2(\sqrt{2}-1)/\sqrt{14+(\sqrt{2}-1)^2}\), or 22.0062% of the cloud’s Frobenius norm.

The manuscript constructs a continuous alternative by assigning a weighted distribution of orientations to each cloud. Each directed convex hull edge defines an orientation, weighted by its length times its exterior dihedral angle. The resulting distribution of canonicalized inputs remains continuous when the hull changes, points collide, or a cloud collapses to a plane or line. The construction uses at most \(6n-12\) orientations for \(n\geq4\) centered 3D points. The exact worst case is \(2n\) for planar clouds embedded in 3D with \(n\geq3\). Across all centered 3D clouds, the exact worst cases for 4, 6 and 12 points are 12, 24 and 60 orientations, respectively.

For geometric deep learning, the construction gives a finite averaging rule that turns continuous vector- and tensor-valued backbones into rotation-equivariant predictors while preserving their existing permutation symmetry. The manuscript also proves that, for fixed ambient dimension \(d\), the worst-case local orientation-support requirement grows as \(\Theta(n^{\lfloor d/2\rfloor})\) among clouds of rank at least \(d-1\). A concrete isotropic cloud made of two orthogonal regular 50-gons in 4D requires at least 10,000 physical orientations in the stated frame model. The exact global minimum for general \(n\) in 3D and a global Lipschitz bound for the hull construction remain open.

The deposit includes the 12-page manuscript, a Python reference implementation, a deterministic data generator, numerical results and 10,188 synthetic verification records. These comprise 50 three-dimensional equivariance cases, nine degeneracy perturbations, 128 four-point matching cases, one reference 4D cloud, and 10,000 proper rotation matrices with their induced point permutations.


r/ResearchML • • 1d ago

ICLR what do you think is the accept cut off?

2 Upvotes

I rebuttaled up to 332 with conf 433 (initial rating 322). Am i safe or am i in AC's call now?

It is my first paper and I am very nervous. I don't really know the scoring and acceptance stuff so what do you guys think? What did you guys are at right now and are you guys hopeful?


r/ResearchML • • 1d ago

How can I gpt access Sci hub ?

Thumbnail reddit.com
1 Upvotes