David H Brown (@_dhbrown) profile picture

Neuroscientist & lover of math. Machine Learning Engineer

Austin, TX
Joined November 2013
Photo by David H Brown (@_dhbrown)
I still code by hand and I still read code generated by agents. But around me I see what's quoted here. When I ask questions to some colleagues they answer after 30 minutes what should take a minute. Why? Because they have to prompt their agent. And probably try several prompts as they have no clue about what to look for. Even more surprising. A colleague asked me how I got an idea that proved interesting. I said I used my brain. This idea implementation was removed by AI agent and I override their code. We've entered the meat proxy era I'm afraid. Don't become a meat proxy. Use your brain.
this is whats going to happen to epic games in about a year
88
208
18
2,550
90,132
David H Brown retweeted
I hope the proposals by frontier labs to pace AI research stem from a genuine concern for safety and a recognition of the potential risks posed by future models, rather than a strategic effort to consolidate power and permanently solidify the market dominance of a few top players. If these efforts are genuine, then oversight must take a more democratic and accountable form, with both national and international components, similar to the Nuclear Regulatory Commission in the US and the International Atomic Energy Agency internationally. If there is only one organization responsible for safety monitoring, and it happens to be staffed by the same people as the frontier labs, and it is perfectly aligned with them both by incentives and by ideology, then it would be indistinguishable from letting frontier labs self-regulate and self-certify their own safety standards. Two potential warning signs of regulatory capture to watch out for: 1. Calls to ban open-source AI. Open-source development currently serves as the only real counterweight to the dominance of frontier labs. 2. Attempts to hinder non-frontier research. Models that are one or two generations behind the frontier -- whose level of capability has already been deployed at scale -- are empirically known not to pose safety risks. As long as we don't see 1 & 2, and we see real international coordination efforts, then I will optimistically believe that the proposals are benevolent.
118
251
44
1,528
136,487
David H Brown retweeted
Key to note that AI scientists are not experts on labor. Some other economists active on X doing work on AI & labor: @alexolegimas, @danielrock, @joshgans & @robseamans (among many others) But worth noting that economists don’t have a consensus either: aleximas.substack.com/p/how-…
Dario is wrong. He knows absolutely nothing about the effects of technological revolutions on the labor market. Don't listen to him, Sam, Yoshua, Geoff, or me on this topic. Listen to economists who have spent their career studying this, like @Ph_Aghion , @erikbryn , @DAcemogluMIT , @amcafee , @davidautor
61
150
11
1,121
210,272
This is a controversial claim, but in my experience, more than 90% of the time, when people bring up neuroscience during explanations of psychological phenomena, the neuroscience adds nothing of value to the explanation other than making the explanation *seem* more authoritative
124
138
64
1,972
278,700
The most potent way to think about the world is analytically, from first principles, with a focus on the long-term. Nearly all of the media you consume daily steers you towards the opposite: a reactive mindset, based on shallow perceptions, processing the world minute-by-minute.
27
437
27
1,512
jneurosci.org/content/44/30/… Mixed selectivity…in the auditory midbrain? @GArtofscience certainly says so. Additional shout out to the reviewers who provided some of the most constructive and eloquently written critiques of my career thus far.
3
11
3
38
3,663
When we wrote that paper on neuroscientists understanding microprocessors we inspired a computer architecture person to actually develop a model of the brain: shorturl.at/fKPZx thoughts? I will be happy to report any feedback back to him.
5
11
2
50
10,729
What the Plant Says to the Touch What the Plant Says to the Flame Blog post 👉 tinyurl.com/HiSchoolPaper
1
2
359
If you try it 3 times you’ll be banned by seaborn.
1
1
7
624
David H Brown retweeted
# on shortification of "learning" There are a lot of videos on YouTube/TikTok etc. that give the appearance of education, but if you look closely they are really just entertainment. This is very convenient for everyone involved : the people watching enjoy thinking they are learning (but actually they are just having fun). The people creating this content also enjoy it because fun has a much larger audience, fame and revenue. But as far as learning goes, this is a trap. This content is an epsilon away from watching the Bachelorette. It's like snacking on those "Garden Veggie Straws", which feel like you're eating healthy vegetables until you look at the ingredients. Learning is not supposed to be fun. It doesn't have to be actively not fun either, but the primary feeling should be that of effort. It should look a lot less like that "10 minute full body" workout from your local digital media creator and a lot more like a serious session at the gym. You want the mental equivalent of sweating. It's not that the quickie doesn't do anything, it's just that it is wildly suboptimal if you actually care to learn. I find it helpful to explicitly declare your intent up front as a sharp, binary variable in your mind. If you are consuming content: are you trying to be entertained or are you trying to learn? And if you are creating content: are you trying to entertain or are you trying to teach? You'll go down a different path in each case. Attempts to seek the stuff in between actually clamp to zero. So for those who actually want to learn. Unless you are trying to learn something narrow and specific, close those tabs with quick blog posts. Close those tabs of "Learn XYZ in 10 minutes". Consider the opportunity cost of snacking and seek the meal - the textbooks, docs, papers, manuals, longform. Allocate a 4 hour window. Don't just read, take notes, re-read, re-phrase, process, manipulate, learn. And for those actually trying to educate, please consider writing/recording longform, designed for someone to get "sweaty", especially in today's era of quantity over quality. Give someone a real workout. This is what I aspire to in my own educational work too. My audience will decrease. The ones that remain might not even like it. But at least we'll learn something.
658
3,619
837
18,754
2,297,575
Llemma: An Open Language Model For Mathematics abs: arxiv.org/abs/2310.10631 This paper from @AiEleuther describes an open 7b and 34b LM (continued pretraiming of CodeLlama) and Proof-Pile-2 dataset. The model outperforms all open base models and even Minerva at similar model scales.
5
69
7
418
95,643
David H Brown retweeted
this paper's nuts. for sentence classification on out-of-domain datasets, all neural (Transformer or not) approaches lose to good old kNN on representations generated by.... gzip aclanthology.org/2023.findin…
119
802
375
4,620
3,386,309
The solution is to hold your opinions loosely unless the question really matters to you, in which case you're going to have to invest the time and effort.
6
28
2,018
David H Brown retweeted
Imposter's Math Bio Podcast Episode 2: The Geometry of Dynamics. It's phase plane analysis and dynamical systems for beginners! Please check it out and share it so I can keep working on these. youtube.com/watch?v=AD0fgAv3…
2
5
1
9
1,139
David H Brown retweeted
Map of @github have arrived. Hope you enjoy it: anvaka.github.io/map-of-gith…
61
556
98
3,001
542,105
David H Brown retweeted
I am once again begging people not to write excitedly about absurd bills that are introduced in a state legislature without giving any indication of whether those bills are going to go anywhere at all.
102
228
115
1,769
465,004
Reversals in Psychology: A list of famous psychological findings that are now in doubt. Includes the Stanford prison experiment, implicit bias, Pygmalion effect, stereotype threat, power posing, multiple intelligences, brain training, learning styles, etc. gleech.org/psych
82
589
105
2,198
1,303,042
David H Brown retweeted
People naturally want to minimize sources of uncertainty that they don’t understand, even if there are far larger sources of uncertainty that they do understand.
1
14
2
64