Malhar Jere (@malharjere) profile picture

Multimodality @Apple

San Francisco
Joined April 2009
Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)Photo by Malhar Jere (@malharjere)
Our team at Apple is hiring for Summer and/or Fall 2025 interns! Help us push the boundaries of visual generative modeling, stylized and identity preserving image/video generation, image and video editing, avatar generation and much more! Feel free to DM me for more details.
4
10
574
Malhar Jere retweeted
If you want to really feel the future, take your iPhone out of its case and run a Deep Seek 7B reasoning model on it:
83
219
34
4,989
557,614
Malhar Jere retweeted
2,933
4,944
952
81,039
69,409,728
Looking to recruit "one" PhD student (in either ECE + CS @ UIUC) with STRONG interests in ML+Systems+Security, or demystifying foundation models. Deadline: Dec 15. Ping with any questions. Please RT and help amplify?
8
48
1
203
30,979
Malhar Jere retweeted
Apple has announced you can now add California driver’s licenses and state IDs to Apple Wallet!
205
402
182
7,448
691,896
Malhar Jere retweeted
imagine seeing this and not feeling incredible wonder about the scale of the universe
224
1,326
184
15,257
998,420
Malhar Jere retweeted
We found 100 stranded/abandoned dogs and spent over $1,000,000 to find them loving homes! This is one of my favorite videos so I hope you consider adopting a dog :)
13,882
30,246
4,355
323,679
151,007,494
Reminds me of @karpathy’s tweet - the only things he trusts are the LM chatbot arena and the comment section of r/LocalLlama
1
1
137
Malhar Jere retweeted
An incredible use of LiDAR technology and iPhone 14 Pro! 🐶
293
1,068
122
8,724
933,594
I was surprised by a talk Yejin Choi (an NLP expert) gave yesterday in Berkeley, on some surprising weaknesses of GPT4: As many humans know, 237*757=179,409 but GPT4 said 179,289. For the easy problem of multiplying two 3 digit numbers, they measured GPT4 accuracy being only 59% accuracy on 3 digit number multiplication. Only 4% on 4 digit number multiplication and zero on 5x5. Adding scratchpad helped GPT4 but only to 92% accuracy on multiplying two 3 digit numbers. Even more surprisingly, finetuning GPT3 on 1.8m examples of 3 digit multiplication still only gives 55 percent test accuracy (in distribution). ¯\_(⊙︿⊙)_/¯ So whats going on? Multiplication is algorithmically very challenging (as are less known algorithmic problems). The authors hypothesize that Transformers have a hard time because they learn linear patterns that they can memorize, maybe compose, but not generally reason with. The paper raises interesting theoretical and practical questions on understanding what Transformers can learn. The paper "Faith and Fate: Limits of Transformers on Compositionality" says: "Our empirical findings suggest that Transformers solve compositional tasks by reducing multi-step compositional reasoning into linearized subgraph matching, without necessarily developing systematic problem solving skills"
232
474
153
3,223
1,709,800
Carlini got fed up breaking every adversarial defense that gets published (rightfully so), and is now using GPT4 to automate it. This is a legit statement paper, with transparency on methods, that should be read as a criticism of the related literature arxiv.org/abs/2307.15008
4
47
3
258
41,361
Adversarial examples are back :-)
4
2
36
7,466
Malhar Jere retweeted
Replying to @maksym_andr
Was literally preparing slides for my talk about it tomorrow, and this was a rough draft for slide 1...
2
4
37
4,532
Prompt injection keeps getting wilder. Unlike text-based methods, you can't tell by looking at one of these images or audio clips that it's malicious. It can be embedded in a website/email attachment and will alter the model's behavior if it processes it. arxiv.org/abs/2307.10490
7
212
39
872
182,561
Malhar Jere retweeted
Not easy, but if we can figure out how to extend this to LLMs the impact would be huge. Imagine having access to models that take 5 minutes to ponder each response but the output is as good as a model that's 1,000x larger and trained for 1,000x longer than GPT-4
I keep revisiting this great paper from @andy_l_jones: “Scaling scaling laws with board games”. It shows how training compute and inference compute of MCTS can be traded off against each other. 10x more MCTS steps is almost the same as training 10x more. arxiv.org/abs/2104.03113
5
25
7
199
52,861
Malhar Jere retweeted
there’s something really fascinating about deep learning based intelligence where it’s clear that their ancestral environment “vaster internet scrapes” doesn’t select for understanding of physics/causality/reasoning as much as it does for human preference
18
76
14
2,167
2,980,515
The hot mess theory of AI misalignment (+ an experiment!) sohl-dickstein.github.io/202… There are two ways an AI could be misaligned. It could monomaniacally pursue the wrong goal (supercoherence), or it could act in ways that don't pursue any consistent goal (hot mess/incoherent).
25
85
32
510
298,965
Most are unaware of how much of space technology was theoretically anticipated and worked out by a handful of people decades before anyone actually tried to achieve orbit. Tsiolkovsky’s achievements, for example, are astounding and worth reading about. en.wikipedia.org/wiki/Konsta…
11
55
3
303
54,432
What a year it's been in AI! Where by "year" I mean one week in February.
23
95
8
1,092
139,612
Malhar Jere retweeted
i will admit though, it would be insane if *this* were the face of the paperclip maximizer
107
170
30
3,528
2,947,572