
Data scientist @Datadoghq. ex-@CriteoAILab -- interest in machine learning, dataviz, programming, philosophy & history of science... opinions mine.
Joined August 2009
- Tweets5.7K
- Following197
- Followers691
- Likes2.4K
Wow. This must be terrible for the family 😥
Earlier this week, @HouseForeign heard from Anna Corbett, whose husband Ryan is wrongfully detained in Afghanistan.
RM @RepGregoryMeeks: “I hope that more ears are open to help bring Ryan back home…America will never forget about Ryan until he is brought home to you safely.”
Bring Ryan Home
158
Anne-Marie retweeted
Today @HouseForeignGOP was honored to hear from Anna Corbett, whose husband has been detained by the Taliban for over a year.
I can't imagine the pain and suffering she and her family are feeling. My committee and I will do everything in our power to bring her husband Ryan home.
Wait they killed tweetdeck?
I think I'll have no choice but say goodbye to Twitter. It doesn't seem to exist anymore anyways. 😫
Sorry folks, I'd rather remove a social network than add a new one for replacement. You can find me on LinkedIn.
2
364
Anne-Marie retweeted
I hit a bug in the Attention formula that’s been overlooked for 8+ years. All Transformer models (GPT, LLaMA, etc) are affected.
Researchers isolated the bug last month – but they missed a simple solution…
Why LLM designers should stop using Softmax 👇
evanmiller.org/attention-is-…
Anne-Marie retweeted
Today, we celebrate the extraordinary talent of Bill Watterson on his 65th birthday! The legacy of Calvin & Hobbes lives on, reminding us to embrace our inner child,explore our imaginations and find beauty in the simplest moments. Here’s to the magic you’ve shared with the world!
Anne-Marie retweeted
Meet our speaker
@glemaitre58
He will talk about how to get the best from your scikit-learn classifier: trusted probabilities and optimal binary decision.
More info and tickets: euroscipy.org/2023/
#EuroSciPy2023 #Basel
Anne-Marie retweeted
L'université de Poitiers @univPoitiers recrute un enseignant contractuel en droit public. Beaucoup d'heures de cours (377 heures de cours équivalent TD) à Poitiers, Niort et Angoulême pour un salaire que je n'ose pas écrire ici...
univ-poitiers.fr/choisir-lun…
Anne-Marie retweeted
I've been skipping slides and just doing live coding when I talk about @modal_labs and it's a lot more fun! I had a question today how fast it scales out and in < 1 min I had some code running on 100+ GPUs in the cloud. Never going to do slides again.
Anne-Marie retweeted
It does not spell the beginning of the end for LLMs. All it means is that providers need to adopt classic software best practices and provide blue/green rollouts and access to old versions of models. There are basic engineering/software best practices that folks can draw on.
Anne-Marie retweeted
Lots of people are wondering whether #GPT4 and #ChatGPT's performance has been changing over time, so Lingjiao Chen, @james_y_zou and I measured it. We found big changes including some large decreases in some problem-solving tasks: arxiv.org/pdf/2307.09009.pdf
Anne-Marie retweeted
There has been a lot of talk on social media about #gzip paper, but it is interesting to see the undue focus on gzip as such and people talking about embeddings etc etc.
The fact of the matter gzip is only used to approximate computation of Kolmogorov’s complexity and the output of compression as such only matters in computing C(x) which is basically sequence length. That’s is, so much of “zipping” it.
As the author of the paper commented in extended thread, one might as well replace gzip with other compression methods that produce some form of approximation to Kolmogorov’s complexity and still use the approach.
“You don't have to actually have a compressor as eventually you only need "estimated compressed length". This means if you are training a VAE, you can just use nELBO as the estimated compressed length and use that with NPC framework.”
Kolmogorov’s complexity is key for the method, gzip is not. When reading scientific papers, it is important not to miss the forest 🌳 for the trees
#gzip #machinelearning #kolmogorovcomplexity
Thread by @ZhiyingJ
threadreaderapp.com/thread/1…
Anne-Marie retweeted
History of statistics in India. A few years ago a colleague who went to Indian Statistical Institute told me that Kolmogorov was quite involved in helping to get the institute off the ground at the time of its foundation and that ISI had quite a lot of Kolmogorov memorabilia.
I have written an article a while back about Kolmogorov who was larger than life figure (and also my academic grandfather after I have defended PhD supervised by Vovk who himself was the last PhD student of Kolmogorov).
And recently someone sent me a picture of Kolmogorov from the times he was visiting Indian Statistical Institute at Kolkata.
It is amazing how much one person has achieved in his life, by not only making probability theory a formal science, but also making key contributions to so many fields (both at research level but also solving key applied problems) and going beyond by helping other countries to get their leading scientific institutes.
You can read about Kolmogorov’s contributions in my Medium article Andrey Kolmogorov — one of the greatest mathematicians of the XXst century
valeman.medium.com/andrey-ko…
More on Kolmogorov's visit to India -> ias.ac.in/article/fulltext/r…(page 59 onwards)
#india #statistics #phd
Anne-Marie retweeted
Simple and powerful math ideas 💡 will always beat non math ideas.
In the new paper a simple model based on gzip and KNN obliterated transformers with hundreeds of million parameters.
How did it do it? The central powerful idea is that if x1 and x2 are similar their joint compression is more efficient than compressing them separately.
#llms #transformers #timeseries
Anne-Marie retweeted
A 14-line Python script using gzip outperforming a 345m parameter transformer model is probably the most hilarious result I've seen all year.
aclanthology.org/2023.findin…
Anne-Marie retweeted
Long-awaited...An Introduction to Statistical Learning, one of the classical machine learning books is finally available in Python. Same contents as existing R version but now with commonly used programming language in data world.
Get your (free) copy here: hastie.su.domains/ISLP/ISLP_…
Book website: statlearning.com/
Anne-Marie retweeted
Special thanks to Philosophy of Science (Cambridge UP) for highlighting the work of Albert Einstein alongside philosophy heavyweights like @Kevinzollman in celebration of the journal’s 90th anniversary. I think we’ll soon be hearing great things from this Albert Einstein.
Anne-Marie retweeted
Topic-wise the central locus of discussion in AI right now
I've spent the last few months interviewing >60 experts in law, economics, AI, alignment, etc, on the impacts of AI, and safety interventions.
Today I'm publishing my first article, showing regulation designed to increase AI safety may backfire badly!
fast.ai/posts/2023-11-07-dis…




























