Drav (@MrDravcan) header
Drav (@MrDravcan) profile picture

Honestly? Self-aware enough to be aware that self-awareness doesn't give me any edge anymore.

Poland
Joined July 2023
Photo by Drav (@MrDravcan)Photo by Drav (@MrDravcan)Photo by Drav (@MrDravcan)Photo by Drav (@MrDravcan)Photo by Drav (@MrDravcan)Photo by Drav (@MrDravcan)Photo by Drav (@MrDravcan)
Drav retweeted
New optimizer.
33
41
18
1,306
93,945
this is, in a nutshell, why deep learning's success was so non-intuitive (and what allowed LLMs to be possible) more dimensions generally mean more training data required (look up "curse of dimensionality") but in high-dimensional non-convex landscapes, local minima become surprisingly rare. you're much more likely to encounter saddle points than local minima this is also one reason stochastic gradient descent works so well: the randomness introduced by mini-batch sampling can help you escape saddle points and flat regions, rather than getting stuck beautiful viz
"the greatest whitepill of all is that local minima are rare in high dimensional spaces"
13
92
8
1,419
93,023
Replying to @adrian_partain
“Replace all my loading spinners with skeleton loaders”
1
1
162
29,079
if you're making such decisions you're likely not "vibe coding" it, just using AI
5
2
142
34,756
Dear God what is happening
29
Peak Content
If you’re going to pop the AI bubble, do it with style baby
2
27
Polished slop is real. But a crafted $30k table can be slop too. And tech can be craft. It’s the process, not the person.
There is a collective hallucination going on in the tech world maybe just as bad as being forced to wear masks outdoors during covid. And its this idea that AI can solve every problem and lesser so that people actually want to talk your "agents"... I struggle, wanting to remove myself from tech culture because this hallucination is induced in part because no one in it really seems to understand craft or quality or culture. Its even more surprising because lots of these people have money and so have eaten really good food, used really good electronics and sat in really good furniture. It seems like tech people don't actually have taste and can't tell why a $30k table is different than something you spend 10 minutes "designing". What is the disconnect? Is it for the attention, the TL likes? Do people actually believe this stuff they are peddling? Because if they do I can't relate. I see a $30k piece of furniture and see painstaking choices that were made for beauty, functionality and craft. I see it in everything from a good croissant, cup of coffee, piece of clothing, perfume, everything. Once you understand craft its hard not to see it everywhere. But AI has so many tech people believing they can create anything, which is laughable. It's cringe, it's a bubble that doesn't exist in reality. Can tech just stay in its lane and go back being ok with and embracing the fact that you're just a nerd and thats ok. No onecin the real world wants you spending 10 minutes "designing" things and claiming you can replicate art.
33
AI is a mirror. lazy people get lazy results. curious people get superpowers.
150
912
95
8,614
142,845
Men trying to find a good woman in 2026.
362
3,691
280
21,743
987,554
The Biblical Experience Music: Holy Place by BENNETT
930
6,366
885
29,869
3,613,558
41
369
12
7,258
210,916