AC made certain requests regarding my #NeurIPS2026 submission in the initial metareview that directly violate the official reviewing guidelines, while simultaneously declaring those requests impossible to satisfy, effectively rendering the author-reviewer discussion pointless before it had even started.
Today, I tried to report this to the SACs but was basically told to fuck off. How am I supposed to report violations like this? Or should I just accept that NeurIPS reviewing has always been, and always will be, nonsense?
1
21
4,898
Dmitry Kovalev retweeted
I am pleased to announce that together with 3 of my (then present and now former) KAUST PhD students
- Samuel Horváth @sam_hrvth (now Assistant Professor at MBZUAI, Abu Dhabi),
- Dmitry Kovalev @dakovalev1 (now Research Scientist at Yandex, Moscow),
- Konstantin Mishchenko @konstmish (now Research Scientist at Meta, Paris)
and Sebastian U Stich @SebastianUStich (now Faculty at CISPA, Saarbrücken; who was visiting us at KAUST at the time)
we have won the
2023 Charles Broyden Prize
for the paper
Stochastic distributed learning with gradient quantization and double-variance reduction
the paper: tandfonline.com/doi/full/10.…
previous prizes: tandfonline.com/journals/gom…
*****
The Charles Broyden Prize is an annual international award honoring the best paper published in the journal Optimization Methods and Software (OMS) during the preceding year. Established in 2009, the prize commemorates the life and work of British mathematician Charles George Broyden (1933–2011), a pioneer in numerical optimization known for his namesake methods and his role in the development of the BFGS algorithm.
*****
I consider this prize to be shared with the authors of the original DIANA paper
Konstantin Mishchenko @konstmish, Eduard Gorbunov @ed_gorbunov, Martin Takáč @TakacMartin and P.R. Distributed learning with compressed gradient differences, arxiv.org/abs/1901.09269,
which was the inspiration for this follow up work that polished, generalized and improved it, and the authors of the previous SEGA work,
Filip Hanzely, Konstantin Mishchenko @konstmish and P.R.. SEGA: Variance reduction via gradient sketching, Advances in Neural Information Processing Systems 31:2082-2093, 2018,
which can be seen as a single-node variant of DIANA, as well as the authors of the JacSketch paper, which was the inspiration for SEGA:
Robert M. Gower @gowerrobert, P.R. and Francis Bach @BachFrancis, Stochastic quasi-gradient methods: Variance reduction via Jacobian sketching, Mathematical Programming 188:135–192, 2021 (arxiv.org/abs/1805.02632)
One can keep going like this, since every new discovery builds on prior work, but I'll stop here.
So, once again, congrats to the authors of the award-winning paper, as well as to the authors of all these prior works!
Dmitry Kovalev retweeted
I find this new paper on adaptive methods very impressive. It develops a new accelerated method with adaptive estimation of smoothness. Its unique feature is that the method keeps adapting to local geometry as long as we run it. It's not trivial, so let me explain in a thread.
Dmitry Kovalev retweeted
Several research groups have released papers on the convergence of Muon, mostly looking at either as a Frank-Wolfe method with momentum or a trust region procedure. I find this one to be particularly easy to read.
Dmitry Kovalev retweeted
Boris Polyak (1935) passed away today. An immensely gentle person the way I knew him, and a giant of science in general and optimization in particular. His name, results and legacy will live forever.
Dmitry Kovalev retweeted
Reverse mode automatic differentiation computes the gradient with approximately the same cost as evaluating the function itself. en.wikipedia.org/wiki/Automa…
Dmitry Kovalev retweeted
Yes, this response is rude and should not have been formulated that way. But we should ask: why is the person so angry with the received review? I have received utterly unprofessional, brief and superficial reviews countless times. They exist. And it's a huge problem.
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
Dmitry Kovalev retweeted
The talk I gave yesterday at the One World Seminar on the Mathematics of Machine Learning is now on YouTube: youtube.com/watch?v=IhoonUtt… Check it out! Coauthors of the 1+3 papers I mentioned: @konstmish G. Malinovsky @SebastianUStich L. Condat @williamyi96 @dakovalev1 A. Sadiev.
Thank you, Peter. This all would not be possible without you.
Huge congrats to @dakovalev1 who defended his PhD thesis "Optimal Algorithms for Affinely Constrained, Distributed, Decentralized, Minimax, and High-Order Optimization Problems" on Sept 14! Committee: A. Nemirovski, Yu. Nesterov, D. Keyes, M. Parsani, D. Wang and myself. 1/n
18
Dmitry Kovalev retweeted
I am very very proud of my team at KAUST who have done a wonderful job by authoring several super exciting papers that were just accepted to the #NeurIPS2022 conference. Check them out! Also, I am hiring interns, students, postdocs & research scientists! richtarik.org/i_join.html
Dmitry Kovalev retweeted
Replying to @qiqihelloworld
I was the reviewer who gave it a 7. But the AC was not wearing his glasses and had Terrible, Horrible, No Good, Very Bad Day. He thought 7 was a 3 and the 6 was a 4. #NeurIPS2022 (variance in reviewers is ok, but variance in ACs, unacceptable).
Dmitry Kovalev retweeted
My technical note with some details regarding the C and all primary C++ programming language standards C++03/98/11/14/17/20:
burlachenkok.github.io/CPP-f…
#cplusplus
Dmitry Kovalev retweeted
Only one #NeurIPS2022 review got a reply in my batch. The rebuttal period is ending soon. This is disrespectful especially for all the students' work and time.
If you are a reviewer reading this, I hope you could take the time to start that discussion!




















