Seung Joon Choi (@erucipe) header
Seung Joon Choi (@erucipe) profile picture
Korea
Joined July 2009
Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)Photo by Seung Joon Choi (@erucipe)
Seung Joon Choi retweeted
#서울시립백남준을기억하는집 #메가트론랩소디 《메가트론 랩소디》 동기신호 프로그램 프로토룸 〈언이븐퓨처+렉처퍼포먼스 Matter Matters: 데이터, 모델, 지능〉 참여자 모집 프로토룸의 작업 〈0.000001 GB Matter Matters〉를 데이터로 삼아, 신승백은 작은 인공지능과 함께 듣기를 연주하고, 최승준은 소리가 아닌 기호와 이미지로 읽고 해석하는 실험적인 렉처 퍼포먼스를 선보입니다. 프로토룸은 렉처 퍼포먼스에 개입하며 두 참여자와 함께 협연을 펼칩니다. ● 일 시 : 10월 17일(토) 15:00-18:00 ● 장 소 : 서울시립 백남준을 기억하는 집 ● 참여자 : 프미(신승백, 최승준, 프로토룸) ● 모집기간 : 9월 29일(화) - 10월 14일(수) 23:00 ● 모집인원 : 30명 ● 신청방법 : 서울시립미술관 홈페이지 ➜ 교육·이벤트 ➜ 해당 프로그램 클릭 ➜ 구글폼 작성
2
1
5
1,859
Replying to @javilopen
this looks awesome
1
1
558
Seung Joon Choi retweeted
Finally had a chance to listen through this pod with Sutton, which was interesting and amusing. As background, Sutton's "The Bitter Lesson" has become a bit of biblical text in frontier LLM circles. Researchers routinely talk about and ask whether this or that approach or idea is sufficiently "bitter lesson pilled" (meaning arranged so that it benefits from added computation for free) as a proxy for whether it's going to work or worth even pursuing. The underlying assumption being that LLMs are of course highly "bitter lesson pilled" indeed, just look at LLM scaling laws where if you put compute on the x-axis, number go up and to the right. So it's amusing to see that Sutton, the author of the post, is not so sure that LLMs are "bitter lesson pilled" at all. They are trained on giant datasets of fundamentally human data, which is both 1) human generated and 2) finite. What do you do when you run out? How do you prevent a human bias? So there you have it, bitter lesson pilled LLM researchers taken down by the author of the bitter lesson - rough! In some sense, Dwarkesh (who represents the LLM researchers viewpoint in the pod) and Sutton are slightly speaking past each other because Sutton has a very different architecture in mind and LLMs break a lot of its principles. He calls himself a "classicist" and evokes the original concept of Alan Turing of building a "child machine" - a system capable of learning through experience by dynamically interacting with the world. There's no giant pretraining stage of imitating internet webpages. There's also no supervised finetuning, which he points out is absent in the animal kingdom (it's a subtle point but Sutton is right in the strong sense: animals may of course observe demonstrations, but their actions are not directly forced/"teleoperated" by other animals). Another important note he makes is that even if you just treat pretraining as an initialization of a prior before you finetune with reinforcement learning, Sutton sees the approach as tainted with human bias and fundamentally off course, a bit like when AlphaZero (which has never seen human games of Go) beats AlphaGo (which initializes from them). In Sutton's world view, all there is is an interaction with a world via reinforcement learning, where the reward functions are partially environment specific, but also intrinsically motivated, e.g. "fun", "curiosity", and related to the quality of the prediction in your world model. And the agent is always learning at test time by default, it's not trained once and then deployed thereafter. Overall, Sutton is a lot more interested in what we have common with the animal kingdom instead of what differentiates us. "If we understood a squirrel, we'd be almost done". As for my take... First, I should say that I think Sutton was a great guest for the pod and I like that the AI field maintains entropy of thought and that not everyone is exploiting the next local iteration LLMs. AI has gone through too many discrete transitions of the dominant approach to lose that. And I also think that his criticism of LLMs as not bitter lesson pilled is not inadequate. Frontier LLMs are now highly complex artifacts with a lot of humanness involved at all the stages - the foundation (the pretraining data) is all human text, the finetuning data is human and curated, the reinforcement learning environment mixture is tuned by human engineers. We do not in fact have an actual, single, clean, actually bitter lesson pilled, "turn the crank" algorithm that you could unleash upon the world and see it learn automatically from experience alone. Does such an algorithm even exist? Finding it would of course be a huge AI breakthrough. Two "example proofs" are commonly offered to argue that such a thing is possible. The first example is the success of AlphaZero learning to play Go completely from scratch with no human supervision whatsoever. But the game of Go is clearly such a simple, closed, environment that it's difficult to see the analogous formulation in the messiness of reality. I love Go, but algorithmically and categorically, it is essentially a harder version of tic tac toe. The second example is that of animals, like squirrels. And here, personally, I am also quite hesitant whether it's appropriate because animals arise by a very different computational process and via different constraints than what we have practically available to us in the industry. Animal brains are nowhere near the blank slate they appear to be at birth. First, a lot of what is commonly attributed to "learning" is imo a lot more "maturation". And second, even that which clearly is "learning" and not maturation is a lot more "finetuning" on top of something clearly powerful and preexisting. Example. A baby zebra is born and within a few dozen minutes it can run around the savannah and follow its mother. This is a highly complex sensory-motor task and there is no way in my mind that this is achieved from scratch, tabula rasa. The brains of animals and the billions of parameters within have a powerful initialization encoded in the ATCGs of their DNA, trained via the "outer loop" optimization in the course of evolution. If the baby zebra spasmed its muscles around at random as a reinforcement learning policy would have you do at initialization, it wouldn't get very far at all. Similarly, our AIs now also have neural networks with billions of parameters. These parameters need their own rich, high information density supervision signal. We are not going to re-run evolution. But we do have mountains of internet documents. Yes it is basically supervised learning that is ~absent in the animal kingdom. But it is a way to practically gather enough soft constraints over billions of parameters, to try to get to a point where you're not starting from scratch. TLDR: Pretraining is our crappy evolution. It is one candidate solution to the cold start problem, to be followed later by finetuning on tasks that look more correct, e.g. within the reinforcement learning framework, as state of the art frontier LLM labs now do pervasively. I still think it is worth to be inspired by animals. I think there are multiple powerful ideas that LLM agents are algorithmically missing that can still be adapted from animal intelligence. And I still think the bitter lesson is correct, but I see it more as something platonic to pursue, not necessarily to reach, in our real world and practically speaking. And I say both of these with double digit percent uncertainty and cheer the work of those who disagree, especially those a lot more ambitious bitter lesson wise. So that brings us to where we are. Stated plainly, today's frontier LLM research is not about building animals. It is about summoning ghosts. You can think of ghosts as a fundamentally different kind of point in the space of possible intelligences. They are muddled by humanity. Thoroughly engineered by it. They are these imperfect replicas, a kind of statistical distillation of humanity's documents with some sprinkle on top. They are not platonically bitter lesson pilled, but they are perhaps "practically" bitter lesson pilled, at least compared to a lot of what came before. It seems possibly to me that over time, we can further finetune our ghosts more and more in the direction of animals; That it's not so much a fundamental incompatibility but a matter of initialization in the intelligence space. But it's also quite possible that they diverge even further and end up permanently different, un-animal-like, but still incredibly helpful and properly world-altering. It's possible that ghosts:animals :: planes:birds. Anyway, in summary, overall and actionably, I think this pod is solid "real talk" from Sutton to the frontier LLM researchers, who might be gear shifted a little too much in the exploit mode. Probably we are still not sufficiently bitter lesson pilled and there is a very good chance of more powerful ideas and paradigms, other than exhaustive benchbuilding and benchmaxxing. And animals might be a good source of inspiration. Intrinsic motivation, fun, curiosity, empowerment, multi-agent self-play, culture. Use your imagination.
.@RichardSSutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI
411
1,224
372
9,445
1,981,274
Seung Joon Choi retweeted
New SwissGL example, ParticleLife3d! Combines ParticleLife and Shadowmap examples google.github.io/swissgl/#Pa…
3
15
1
80
32,634
Seung Joon Choi retweeted
github.com/cloneofsimo/consi… I managed to get it work! 2 Step, No progressive distillation as promised, reasonable quality for dumb unet structure and 10 min of training. I think this is the only implementation out there (given its like 4 days old) Not bad!
6
14
3
119
32,361
Seung Joon Choi retweeted
Over the last few weeks I was working on SwissGL, tiny JS graphics library with a single function that does everything. Demos: swiss.gl Code: github.com/google/swissgl
13
83
2
474
59,033
Seung Joon Choi retweeted
Mathimage #44,"One New Realtime Shader a Week for a Whole Year", a (broken) dolphin: shadertoy.com/view/4sS3zG
9
59
39
Seung Joon Choi retweeted
Mathimage #45,"One New Realtime Shader a Week for a Whole Year", voronoi blocks: shadertoy.com/view/lsSGRc
2
19
26
Seung Joon Choi retweeted
Mathimage #43,"One New Realtime Shader a Week for a Whole Year", a fish in shallow waters: shadertoy.com/view/ldj3Dm
7
61
56
Seung Joon Choi retweeted
<한국의 오픈소스 개발자들> 인터뷰이는 안녕 리눅스의 김정균, 데비안메인테이너 류창우, 네티개발자 이희승, FreeBSD 전커미터 최준호, 웹킷커미터 허준회, 리눅스 커널 개발자 허태준 님. 인터뷰어는 송우일 님insightbook.co.kr/post/6600
1
15
21
Scratchの開発者、ミッチェル・レズニック教授の「子どもにプログラミングを教えよう」はEテレで今晩23:00から。連動企画のハングアウトは13:30からです。トピックス | スーパープレゼンテーション|Eテレ NHKオンライン nhk.or.jp/superpresentation/…
1
31
19
“PogoScript (a programming language for lazy sunday afternoons)” http://t.co/ZhrF07j9sQ 으잌ㅋㅋㅋㅋ 이거 맘에 드네. 이건 오늘 당장에라도 써봐야겠다.
2
5
web app의 성능 얘기가 부쩍 많아지고 있네요 - Effectively Managing Memory at Gmail scale http://t.co/P6ekshr8q4
2
8
Seung Joon Choi retweeted
팀 버너스리와의 대화 interpiler.com/2013/05/03/in…
2
9
11
Seung Joon Choi retweeted
오늘도 잊지 말아야 할 Knuth 옹의 명언. "Premature optimization is the root of all evil." pplab.snu.ac.kr/courses/adv_…
5
11
Seung Joon Choi retweeted
New blog entry on creating trees by Michael Goodfellow including #WebGL demo sea-of-memes.com/LetsCode79/…
5
9
Seung Joon Choi retweeted
A WebGL flight simulator. If you don't have Page Up key (eg, Mac laptop) use Func + Up Arrow to increase throttle. goo.gl/jxiQf
11
13
Seung Joon Choi retweeted
워드의 새작업: things-txtzyme-websocket-plugins youtube.com/watch?v=vo4VWQGl… 간단하지만, 유용하고 멋있게 만드는데 능력자. @WardCunningham
2
7
텀블벅에서 '와들와들 펭귄즈'의 크라우드펀딩을 시작했습니다. 많은 관심과 성원 부탁드립니다. 좋은 게임으로 보답하겠습니다. tumblbug.com/ko/waddlewaddle…
9
1
Seung Joon Choi retweeted
IT 체감온도 '쑤욱' 올리는 소통형 디지털 콘텐츠: youtu.be/GLBka9LV7TI 오래간만에 화면으로 뵙는 최승준작가님 @erucipe
1
1
6