🧠computational neuroscience | emergence 🤖 Research Staff Scientist at Neuroblox, Inc. (views here are my own!)
Boston, MA
Joined March 2009
- Tweets31.8K
- Following954
- Followers7.5K
- Likes22.2K
Yohan J. John retweeted
This is a beautiful dictionary of the different kinds of Goodhart proxy failures across different domains! Love these kind of interdisciplinary work.
Yohan J. John retweeted
Like @davidbessis and others, I think that Hinton is wrong. To explain why, let me tell you a brief story.
About a decade ago, in 2017, I developed an automated theorem-proving framework that was ultimately integrated into Mathematica (see: youtube.com/watch?v=mMaid2jY…) (1/15)
Yohan J. John retweeted
Very sad to learn of the death on 18th July of Margaret (Maggie) Boden, a titan of cognitive science and AI. I met her many times, and respected her greatly.
theargus.co.uk/memorials/dea…
ALT Maggie Boden and Murray Shanahan on a panel in 2018
Yohan J. John retweeted
I love that it's not just "turtles all the way down", but turtles all the way up, down, left and right, filling up the entire plane. The reflected turtles get three stripes, as they are where three lines meet.
The proofs are over my head, but I still really love this paper. It also provides a nice metaphor for understanding emergence in a system that is completely "transparent" (since it is an abstract mathematical phenomenon).
1/n
arxiv.org/abs/2303.10798
Yohan J. John retweeted
What are we talking about, when we talk about 'representations'?
My undergraduate student, Oyinkansola Olorunleke, is conducting a thesis project @tcddublin on the concept of representation in cognitive sciences & neuroscience.
tinyurl.com/2e6rcnxv
Yohan J. John retweeted
What can weakly electric fish teach scientists about #NeuroAI? Read about how #KempnerInstitute’s @KanakaRajanPhD is studying elephantnose fish to gain insights into #collectiveintelligence and #AI systems. bit.ly/4gQMbi1
@harvardmed @DrYohanJohn
Yohan J. John retweeted
An LLM knows every work of Shakespeare but can’t say which it read first. In this material sense a model hasn’t read at all.
To read is to think. Only at inference is there space for serendipitous inspiration, which is why LLMs have so little of it to show for all they’ve seen.
Yohan J. John retweeted
I think part of the appeal of mathematical logic is that the formulas look mysterious - You write backward Es!--Hilary Putnam
Yohan J. John retweeted
Francis Crick against falsificationism: “evidence can be unreliable, and therefore you should use as little of it as you can”
Yohan J. John retweeted
You know the "🔹AI Overview" you get on Google Search?
I discovered today that it's repeating as fact something I made up 7 years ago as a joke.
"Kyloren syndrome" is a fictional disease I invented as part of a sting operation to prove that you can publish any nonsense in predatory journals...
Yohan J. John retweeted
We're proud to share the #KempnerInstitute’s AI cluster has joined the ranks of the fastest green supercomputers in the world (32nd on Green500 and 85th in TOP500)! Read the full announcement: bit.ly/3YRXdMO #ML #computing #SC24
Yohan J. John retweeted
I think this idea of biological processes happening in nested timescales is one that is much more general and not well appreciated
Yohan J. John retweeted
Paul Cisek on the question of LLM understanding:
"We're like professional magicians wondering about magic."
🔥 at #MAIN2024
Yohan J. John retweeted
With a shoutout to work by @jmacshine & @DrYohanJohn 👇🏽
How Antidepressants Work
A neuropsychological story featuring emotional processing shifts, cognitive flexibility, neuroticism, and emotional blunting
psychiatrymargins.com/p/how-…
Yohan J. John retweeted
If you give small children a choice between some things - this toy or that - and you ask "which do you prefer?" they tend to answer "both" or "this one and this one."
The nonsensical concept of ranking things may be `learned' later in life.
Yohan J. John retweeted
Latest in our #KempnerInstitute Seminar Series: @scott_linderman describes how state space models in #neuro & #ML helped reveal a line attractor in the hypothalamus.
And they may soon be giving #AI transformers a run for their money!
Watch here: youtube.com/watch?v=2hL6Keqp…
