Scott Gray (@scottgray76) profile picture

Currently independent. Exploring some neuro-inspired AI approaches. Former GPU geek at @OpenAI. He/Him.

San Francisco, CA
Joined April 2009
OpenAI is nothing without its people
38
53
26
909
185,338
❤️
i love the openai team so much
13
16
1
573
190,277
Scott Gray retweeted
The case for 4-bit precision: k-bit Inference Scaling Laws abs: arxiv.org/abs/2212.09720
2
12
1
88
32,071
I have no intention of changing my profile link. help.twitter.com/en/rules-an…
1
1
34
49,226
In case you missed it, here's @model_mechanic @jcjohnss and @karpathy getting into the gritty details of the DALL-E paper: youtu.be/PtdpWC7Sr98 . I hope this kind of interaction becomes the more of the norm in the future.
6
111
One of the many lessons we should be learning from COVID: the importance of statistics education. Understanding causality and probability is critical to being informed and making wise choices. How much better off would we be if schools replaced trig or calculus with stats?
210
857
254
4,408
How do we beat COVID-19, *while protecting our mental & financial health?* Epidemiologist @MarcelSalathe & I explain Epidemiology 101, #TestTraceIsolate, #MasksForAll, worst-case scenarios... all with playable simulations! 🕹 Check it out! 😷ncase.me/covid-19/😷 (30 min)
19
391
82
798
New video: Simulating an epidemic. What happens when people avoid each other for the most part but still go to a common central location like a store? What if you can track and isolate cases, but 20% slip through the cracks? 50%? And much more. youtu.be/gxAaO2rsdIs
106
2,069
474
5,047
Scott Gray retweeted
The fact that primaries are not done via ranked-choice voting is absurd
46
406
39
2,848
This is a really cool project I'm happy to have had the chance to help out with.
Introducing MuseNet, a neural network which discovered how to generate music using many different instruments and styles. Listen & interact: openai.com/blog/musenet/ MuseNet will play an experimental concert today from 12–3pmPT on livestream: twitch.tv/openai
1
18
Lots more work on sparsity in various forms forthcoming...
Releasing some work today with @scottgray76 @AlecRad and @ilyasut. Contains some simple adaptations for Transformers that extend them to long sequences.
1
2
1
34
Scott Gray retweeted
We've trained an unsupervised language model that can generate coherent paragraphs and perform rudimentary reading comprehension, machine translation, question answering, and summarization — all without task-specific training: blog.openai.com/better-langu…
420
2,742
1,246
12,108
Scott Gray retweeted
Random Network Distillation: A prediction-based method that achieves state-of-the-art performance on Montezuma’s Revenge -blog.openai.com/reinforcemen…
8
151
22
492
Scott Gray retweeted
A real robot hand, trained with same learning algorithm and code as OpenAI Five, has learned human-like motions to rotate objects: blog.openai.com/learning-dex…
33
514
81
1,269
Scott Gray retweeted
Our team of five neural networks, OpenAI Five, has started to defeat amateur human teams (including a semi-pro team) at Dota 2: blog.openai.com/openai-five/
53
761
193
2,087
Scott Gray retweeted
How big is the sudden explosion of startups building AI chips? There are 45 of them, and at least five have raised $100 million: nyti.ms/2EEpICX
8
162
22
328
You can find the slides to my NIPS talk on Small World Network Architectures here: supercomputersfordl2017.gith… There were lots of other great talks in that workshop. Thanks to Google (mainly @erich_elsen) for organizing.
19
51