Gopal | Co-Founder, dropD Network (@golosopher) header
Gopal | Co-Founder, dropD Network (@golosopher) profile picture

Greenskeeper, Cinephile, Herpetologist, Poet, Philosopher, Bitcoiner. Co-Founder: @dropdnetwork @mamgoraservices

Amritsar, India
Joined December 2012
Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)Photo by Gopal | Co-Founder, dropD Network (@golosopher)
उड़ सकूँ तो आकाश दे देना, चल सकूँ तो मार्ग दे देना, तैर सकूँ तो सागर दे देना, पढ़ सकूँ तो साहित्य दे देना, सो सकूँ तो स्वप्न दे देना, और जी सकूँ तो प्रेम दे देना।
1
12
The role of the writer is to lift people up, not to lower them down, and I believe that’s the role of every writer, every artist, every creator of culture.
1
29
You think your pain and heartbreak are unprecedented in the history of the world, but then you read. It was Dostoevsky and Dickens, who taught me that things that tormented me most were the very things that connected me with all the people who were alive.
10
Find the time to take care of your minds. Only then, you can find a way to rebuilt trust between humans and thereby make sure that humanity not just survives, but also flourishes in the era of AI.
9
Money isn’t made from gold and paper. Money is a story made from words. Humans mastered the language and rely on language tokens.
9
Language is the most important tool that humans use in order to cooperate and try to acquire divine powers and divine abilities.
8
Nobody is ordinary for storytellers,
1
7
Intelligence and consciousness are two distinct things.
1
4
Gopal | Co-Founder, dropD Network retweeted
The success of LLM is undeniable, and does not match my earlier predictions. I already admitted that on several occasions over this year, and I'll do it here too now. My mathematical analysis of the capabilities (or lack thereof) of machine learning and of the transformer algorithm, is correct. What is mathematically impossible, remains so. However there are two things that I didn't take into account. One is the huge computational resources invested in LLM: if you take a bad algorithm (i.e. with very low complexity-theoretic power and even then with far-from-optimal implementation) yet give it so much compute time and space, it will give nice results. The second is a real shame: again I made the classical mistake of overestimating humans, forgetting that doing better than humans, is not that hard, and this is pretty much where current AI stands. It works similarly to humans, i.e. broad but not very deep. Logical solvers, on the other hand, can go exponentially deeper but on narrower scopes. Transformers proved an important theoretical point: a cap on what does it take to be fluent in natural language. Now that we know that, we can try to do better by many other means. This is an effort I started a few months ago, taking core lessons from transformers and studying them in frameworks that spend less on the unknown, and by that I mean: transformers give a very abstract skeleton of how things should work (quadratic forms over the history, then MLP, and repeat), then using SGD to tune all its many parameters. The part to learn (in the machine learning sense) is huge. I'm working under the guideline of "solve more, learn less" by having a skeleton that leaves much less degrees of freedom, using lessons learned from transformers, and using the expressive power of the logical frameworks I'm dealing with over the last years. To this end I also formulated the basis of theoretical machine learning in those frameworks, suggesting new aspects and giving rise to a fruitful combonation of the approaches. Empirically, some of the new settings managed to beat small transformers on lower wall-time even though they ran on CPU while the transformers ran on GPU.
1
16
4
55
2,515
Currency issuers don't tax first. They spend first. #modernmonetarytheory
2
5
Anybody can become indocrinated. It doesn't matter you'e a Christian or a Hindu or an athiest or a meat eater or a vegan, whatever. As far as anyone hold their beliefs, it can become indoctrinated.
2
8
The most important asset in the world is "Trust". It is more important than the money, electricity, oil, chips, or anything else. And the trust will migrate from humans to AIs. We already see that happening the financial system in the form of cryptocurrencies.
2
7
When one has no one, nowhere else one can go! For every man must have somewhere to go. Since there are times when one absolutely must go somewhere!
6
Sunday has killed more men than bombs.
1
3
19
Tentative Decisions!: Why Egalitarian Societies Never Needed Rebels? gopalbansal93.blogspot.com/2…
3
9
Tentative Decisions!: Fashion, Filters, and Porn Are Selling You the Sam... gopalbansal93.blogspot.com/2…
1
23
Tentative Decisions!: Why Poetry Is Going Extinct (And Almost No One Has... gopalbansal93.blogspot.com/2…
11
कविता में शब्द और अर्थ का सौंदर्य होता है, और जहाँ यह सौंदर्य साथ हो उसे कविता कहता है।
6
Faith is a belief in absence of the evidence.
1
10