Aseem Raj Baranwal (@aseemrb) profile picture

AI Scientist

Minkowski spacetime
Joined March 2010
Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)Photo by Aseem Raj Baranwal (@aseemrb)
Aseem Raj Baranwal retweeted
Forget about the sand guys at NVIDIA, Intel, and AMD. This is ancient technology now. Let's build computers using fluids! OpenAI's Result 376 shows how to apply forces to a fluid so that a fluid particle's motion simulates the computation of an arbitrary Turing machine, while satisfying the Navier–Stokes equations. Apparently, the construction is explicit, so I can actually try simulating it! Link: kfoynt.github.io/stationary-…
7
13
1
87
5,804
Aseem Raj Baranwal retweeted
Kinda sad that humans are doing clean up after a premier robotics conference #IROS2026 maybe 2036 will be different
1
1
36
Aseem Raj Baranwal retweeted
Nihar Shah did a heroic experiment for TMLR: he spent 20-25 hours over two weeks interviewing authors of seemingly low-quality submissions about their own papers. He confirmed what we all suspected: people submitting these papers have *no idea* what is going on in them.
TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/asking-a…
11
138
27
1,314
175,754
Great work by @unifiedsciences! The interesting part for me isn't the speedups, but that reproducibility and correctness checks are built into the search itself, not bolted on after, which in my opinion is the right way to do automated optimization. Kudos @dem_fier !
2
2
2
626
Aseem Raj Baranwal retweeted
wanted to make a few clarifications on openleaf as there’s lot of love from people (thanks❤️!) but also some misunderstanding: 1. "this encourages blind citation" -- openleaf links every suggested paper for a reason. you're supposed to read it before citing (the paper link is right there). it's a discovery tool, and most def not a "cite for me" button. also, its ranking is purely content-based -- no citation count, no popularity metrics -- specifically to avoid unfair concentration of citations to a select few papers/institutions. 2. "if you do your lit search after writing a paragraph, you're doing it wrong" -- agree! but the demo showed a simplified flow. the real use case: you've read 20 papers, but there are 1000s published monthly. you will miss relevant ones. openleaf helps you find them. already working on improvements to make it even better: - reading your existing .bib so it's aware of what you already cite - analyzing full paper text, not just abstracts - better reasoning track progress, suggest features, or pick up an issue! github.com/Demfier/openleaf/…
ever been here? open overleaf → write a paragraph → "hmm...this needs a citation" → open 15 different tabs → skim 8 abstracts → find the 1 actually relevant paper → format bibtex → paste it back on overleaf if so, i built a plugin just for you. meet openleaf: → reads your paper paragraph by paragraph → searches major academic databases → filters out irrelevant papers using ai → one click to add BibTeX to your .bib you'll also find the 🤝 friendly and 🔥 fire reviewers there. i don't think i need to tell you what they do :) free. open source. no account. no data collection. works with ollama, openrouter, openai api and more. github.com/demfier/openleaf dear algorithm, please show this to my fellow researchers in need 🙏 #overleaf #latex #opensource #academictwitter
4
33
7,901
Aseem Raj Baranwal retweeted
I am hiring one PhD student. Subject: Reasoning and AI, with a focus on computational learning for long reasoning processes such as automated theorem proving and the learnability of algorithmic tasks. Preferred background: A mathematics student interested in transitioning to computer science and machine learning. However, I will also consider engineering and computer science students with a strong mathematical background.
13
92
1
502
39,010
Aseem Raj Baranwal retweeted
On the Statistical Query Complexity of Learning Semiautomata: a Random Walk Approach Work with @ggiapitz, @EshaanNichani and @jasondeanlee. We prove the first SQ hardness result for learning semiautomata under the uniform distribution over input words and initial states, without relying on parity gadgets or adversarial inputs. The hardness is structural, it arises purely from the transition structure, not from hard languages. We show that SQ hardness can be established when both the alphabet size and input length are polynomial in the number of states.
2
12
1
61
68,590
Aseem Raj Baranwal retweeted
Waterloo Computational Learning Lab it is: watcl.ca! I rebranded our lab after six years to better reflect the work we do and will continue to do in the future.
1
7
681
Aseem Raj Baranwal retweeted
Presenting "Optimal Fair Learning Robust to Adversarial Distribution Shift" at #ICML2025 (openreview.net/pdf?id=TGcXwW…) 📍East Exhibition Hall A-B #E-1001 ⏲️16th July, 4:30-7PM Please have a look, and do stop by if it sounds interesting to you! RT's appreciated😊Summary to follow
1
9
17
852
Aseem Raj Baranwal retweeted
My former PhD student, Aseem Baranwal, won the PhD Dissertation Award from the Department of Computer Science at the University of Waterloo for his thesis, “Statistical Foundations for Learning on Graphs.” Aseem is the first PhD student I graduated, and I couldn't be happier for him.
.@aseemrb (co-supervised with A. Jagannath) passed his PhD defence yesterday. Aseem is the first PhD student to graduate from our group. I am very happy for Aseem and the work that he has done. I would also like to thank the members of the committee, @xbresson, @thegautamkamath, Stephen Vavasis, and Yaoliang Yu, for taking the time to read the thesis and for appearing so early (7 a.m.) in Waterloo and so late (7 p.m.) in Singapore! Aseem's PhD is about "Statistical Foundations for Learning on Graphs" based on a series of good papers: 1) Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalization (spotlight), proceedings.mlr.press/v139/b… 2) Effects of Graph Convolutions in Multi-layer Networks (spotlight) openreview.net/forum?id=P-73… 3) Optimality of message-passing architectures for sparse graphs dl.acm.org/doi/10.5555/36661… 4) Graph Attention Retrospective (best paper award at GroundedML ICLR 2022) jmlr.org/papers/v24/22-125.h… Aseem was awarded 3 competitive scholarships during his PhD, he interned at Google NY and Microsoft Redmond, he was a top 20 reviewer at the Learning on Graphs Conference, and now he is joining the AI residency program at XTY Labs.
8
13
1
226
19,173
My PhD thesis is now available on UWspace: uwspace.uwaterloo.ca/items/2…. Thanks to my advisors @kfountou and Aukosh Jagannath for their support throughout my PhD. We introduce a statistical perspective for node classification problems. Brief details are below.
3
2
8
540
This classifier is implementable using a message-passing GNN and is the best of both worlds (an MLP for a noisy graph and a GCN for an informative graph) across the range of SNR in the edges/features on synthetic data. Work is pending to make it scalable for use on real data.
1
165
Replying to @aseemrb @kfountou
Following these analyses, we define a precise notion of Bayes optimality for node classification problems and compute the optimal classifier for arbitrary distributions of the node features and edge connectivity.
1
136
Replying to @aseemrb @kfountou
We analyze GNNs from this statistical perspective. We isolate the convolutions from the layers for GCN architectures to understand its variance reduction effects on the data. For GAT, we identify regimes of the SNR of the node features where attention helps or does not help.
116
Aseem Raj Baranwal retweeted
Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning We propose calculating the attention weights in Transformers using only fixed positional encodings (referred to as positional attention). These positional encodings remain the same across layers, and no other data is used to compute attention weights. We call this architecture positional Transformer, an illustration is shown in the attached figure. Contribution 1: We show that positional Transformer achieves an average improvement of 1000x (ranging from 400x to 3000x) in out-of-distribution (OOD) value generalization (informally defined below) compared to traditional Transformers during end-to-end training on various algorithmic tasks. Value generalization describes an OOD setting where the input lengths remain the same, but the values in the test set differ in magnitude or are larger than those seen during training. This is particularly important because, when learning to solve an algorithmic task, the model is expected to perform the task across a range of numbers that it may not have encountered during training. It also serves as an indication that the model is truly learning to solve the underlying problem. We present OOD generalization results on five tasks: cumulative sum, cumulative minimum, cumulative median, sorting, and cumulative maximum sum subarray. Our results are compared to standard self-attention and various configurations of traditional Transformers, and different positional encodings. Contribution 2: We prove that positional Transformers can simulate any algorithm defined in a parallel computation model. Our motivation for positional attention for algorithmic reasoning stems from the following two facts. First, many problems are solved by parallel algorithms, where data communication does not depend on the values of the data but solely on the positions (IDs) of each machine. Second, it is also known that Transformers can function as parallel computers, with data communication managed through attention mechanisms. arXiv link: arxiv.org/abs/2410.01686 code: github.com/opallab/positiona…
10
58
5
300
32,745
Aseem Raj Baranwal retweeted
This paper was just accepted at NeurIPS. I am particularly happy about this because it originated as a course project by Robert in our Graph Neural Networks course.
Paper: Analysis of Corrected Graph Convolutions We study the performance of a vanilla graph convolution from which we remove the principal eigenvector to avoid oversmoothing. 1) We perform a spectral analysis for k rounds of corrected graph convolutions, and we provide results for partial and exact classification. 2) For partial classification, we show that each round of convolution can reduce the misclassification error exponentially up to a saturation level, after which performance does not worsen. 3) For exact classification, we show that the separability threshold can be improved exponentially up to O(log n/log log n) corrected convolutions. link: arxiv.org/abs/2405.13987 P.S.: That's the first paper produced as part of the graduate course (CS886, 2024) on graph neural networks that I am teaching!
1
3
32
3,591
Aseem Raj Baranwal retweeted
If you are at #ICML2024 and interested in the theory of graph neural networks, come by our poster 'Graph Attention Retrospective.' conference link: icml.cc/virtual/2024/poster/… paper: jmlr.org/papers/v24/22-125.h… relevant blog: medium.com/@kimon.fountoulak…
1
8
39
3,056
Aseem Raj Baranwal retweeted
I guess that as of today I can also announce that I have been promoted to the rank of Associate Professor. I am mostly making this post to publicly thank all the people who have supported me during my career, especially my first two PhD students, @aseemrb and @shenghao_yang (in alphabetical order), for the great work we have done, the numerous lengthy meetings and discussions, and their devotion to learning.
6
3
41
5,375