Drav retweeted
this is, in a nutshell, why deep learning's success was so non-intuitive (and what allowed LLMs to be possible)
more dimensions generally mean more training data required (look up "curse of dimensionality")
but in high-dimensional non-convex landscapes, local minima become surprisingly rare. you're much more likely to encounter saddle points than local minima
this is also one reason stochastic gradient descent works so well: the randomness introduced by mini-batch sampling can help you escape saddle points and flat regions, rather than getting stuck
beautiful viz
Drav retweeted
Replying to @EyphanMandraci @adrian_partain
if you're making such decisions you're likely not "vibe coding" it, just using AI
Polished slop is real. But a crafted $30k table can be slop too. And tech can be craft.
It’s the process, not the person.
There is a collective hallucination going on in the tech world maybe just as bad as being forced to wear masks outdoors during covid. And its this idea that AI can solve every problem and lesser so that people actually want to talk your "agents"...
I struggle, wanting to remove myself from tech culture because this hallucination is induced in part because no one in it really seems to understand craft or quality or culture.
Its even more surprising because lots of these people have money and so have eaten really good food, used really good electronics and sat in really good furniture.
It seems like tech people don't actually have taste and can't tell why a $30k table is different than something you spend 10 minutes "designing".
What is the disconnect? Is it for the attention, the TL likes? Do people actually believe this stuff they are peddling?
Because if they do I can't relate. I see a $30k piece of furniture and see painstaking choices that were made for beauty, functionality and craft. I see it in everything from a good croissant, cup of coffee, piece of clothing, perfume, everything. Once you understand craft its hard not to see it everywhere.
But AI has so many tech people believing they can create anything, which is laughable. It's cringe, it's a bubble that doesn't exist in reality.
Can tech just stay in its lane and go back being ok with and embracing the fact that you're just a nerd and thats ok. No onecin the real world wants you spending 10 minutes "designing" things and claiming you can replicate art.
33












