
Our team at Apple is hiring for Summer and/or Fall 2025 interns! Help us push the boundaries of visual generative modeling, stylized and identity preserving image/video generation, image and video editing, avatar generation and much more! Feel free to DM me for more details.
4
10
574
Malhar Jere retweeted
If you want to really feel the future, take your iPhone out of its case and run a Deep Seek 7B reasoning model on it:
Malhar Jere retweeted
Looking to recruit "one" PhD student (in either ECE + CS @ UIUC) with STRONG interests in ML+Systems+Security, or demystifying foundation models. Deadline: Dec 15. Ping with any questions. Please RT and help amplify?
Malhar Jere retweeted
Apple has announced you can now add California driver’s licenses and state IDs to Apple Wallet!
Malhar Jere retweeted
imagine seeing this and not feeling incredible wonder about the scale of the universe
Malhar Jere retweeted
We found 100 stranded/abandoned dogs and spent over $1,000,000 to find them loving homes! This is one of my favorite videos so I hope you consider adopting a dog :)
I Rescued 100 Dogs!
Malhar Jere retweeted
Replying to @aidan_mclau @lmsysorg
Reminds me of @karpathy’s tweet - the only things he trusts are the LM chatbot arena and the comment section of r/LocalLlama
Malhar Jere retweeted
I was surprised by a talk Yejin Choi (an NLP expert) gave yesterday in Berkeley, on some surprising weaknesses of GPT4:
As many humans know, 237*757=179,409
but GPT4 said 179,289.
For the easy problem of multiplying two 3 digit numbers, they measured GPT4 accuracy being only 59% accuracy on 3 digit number multiplication. Only 4% on 4 digit number multiplication and zero on 5x5. Adding scratchpad helped GPT4 but only to 92% accuracy on multiplying two 3 digit numbers.
Even more surprisingly, finetuning GPT3 on 1.8m examples of 3 digit multiplication still only gives 55 percent test accuracy (in distribution).
¯\_(⊙︿⊙)_/¯
So whats going on? Multiplication is algorithmically very challenging (as are less known algorithmic problems).
The authors hypothesize that Transformers have a hard time because they learn linear patterns that they can memorize, maybe compose, but not generally reason with. The paper raises interesting theoretical and practical questions on understanding what Transformers can learn.
The paper
"Faith and Fate: Limits of Transformers on Compositionality" says:
"Our empirical findings suggest that Transformers
solve compositional tasks by reducing multi-step compositional reasoning into
linearized subgraph matching, without necessarily developing systematic problem solving skills"
Malhar Jere retweeted
Carlini got fed up breaking every adversarial defense that gets published (rightfully so), and is now using GPT4 to automate it.
This is a legit statement paper, with transparency on methods, that should be read as a criticism of the related literature
arxiv.org/abs/2307.15008
Malhar Jere retweeted
Adversarial examples are back :-)
Replying to @CadeMetz
@CadeMetz at the New York Times just published a piece on a new paper we are releasing today, on adversarial attacks against LLMs. You can read the piece here:
nytimes.com/2023/07/27/techn…
And find more info and the paper at: llm-attacks.org/ [1/n]
Malhar Jere retweeted
Replying to @maksym_andr
Was literally preparing slides for my talk about it tomorrow, and this was a rough draft for slide 1...
Malhar Jere retweeted
Prompt injection keeps getting wilder. Unlike text-based methods, you can't tell by looking at one of these images or audio clips that it's malicious. It can be embedded in a website/email attachment and will alter the model's behavior if it processes it.
arxiv.org/abs/2307.10490
Malhar Jere retweeted
Not easy, but if we can figure out how to extend this to LLMs the impact would be huge. Imagine having access to models that take 5 minutes to ponder each response but the output is as good as a model that's 1,000x larger and trained for 1,000x longer than GPT-4
I keep revisiting this great paper from @andy_l_jones: “Scaling scaling laws with board games”. It shows how training compute and inference compute of MCTS can be traded off against each other. 10x more MCTS steps is almost the same as training 10x more. arxiv.org/abs/2104.03113
Malhar Jere retweeted
there’s something really fascinating about deep learning based intelligence where it’s clear that their ancestral environment “vaster internet scrapes” doesn’t select for understanding of physics/causality/reasoning as much as it does for human preference
Malhar Jere retweeted
The hot mess theory of AI misalignment (+ an experiment!)
sohl-dickstein.github.io/202…
There are two ways an AI could be misaligned. It could monomaniacally pursue the wrong goal (supercoherence), or it could act in ways that don't pursue any consistent goal (hot mess/incoherent).
Malhar Jere retweeted
Most are unaware of how much of space technology was theoretically anticipated and worked out by a handful of people decades before anyone actually tried to achieve orbit. Tsiolkovsky’s achievements, for example, are astounding and worth reading about.
en.wikipedia.org/wiki/Konsta…
































