@joelgrusi
iAccount based inUnited States
About this account
- Account based in
- United States
- Connected via
- United States Android App
Account-level information from X, not a live location or the device used for a specific post.
AI enthusiast + AI skeptic I contain multitudes
San Antonio ish
Joined March 2008
- Tweets12.3K
- Following969
- Followers20.4K
- Likes14.3K
Pinned Tweet
I don't want to generate hallucinations from any model that uses water or copyrighted training data, or plagiarize with any model that hallucinates or uses water, or use water to run a model that does hallucinations or plagiarism. You know, as a career, I don't want to do that. – at Scenic Oaks, TX
"it says here you like to attend 'AI Safety' conferences?"
"yes, but only for the sex cult stuff"
"oh ok good"
my experience traveling in Europe is that when you tell people you're from the US they usually ask what part, and then they get excited when it's somewhere they've heard of like Texas or New York or California
Joel Grus 🤠retweeted
Replying to @joelgrus
It is surprising to me it surprises people working in data science. That has always been the number one issue of most DS projects I've been on. That blog post from a while ago explained it well: siliconcontinent.com/p/what-…
Joel Grus 🤠retweeted
The Blue Cross/Blue Shield Association says that AI is already driving *up* healthcare costs, as hospitals use the technology to find instances where they can bill more for the same level of care. bcbs.com/about-us/associatio…
you know who else had the ability to tell a moral and ethical story about how we live together
which is why we need more administrators to oversee "faculty honorifics"
SCOOP: Top researchers at Columbia, Stanford, and others thought they were elected to elite scientific societies alongside Nobel laureates. The catch? The organizations are a sham.
I spent the last month investigating a massive academic scam, for @Nature
nature.com/articles/d41586-0…
one reason I am still an AI skeptic is *organizational illegibility*
it doesn't matter how big your context window is if all the necessary context is tacit
"If You Fine Tune A Language Model Is It Still A Language Model" - the greatest thread in the history of forums, locked by a moderator after 12,239 pages of heated debate,
according to the obscure-word vocabulary test everyone is sharing, I'm sort of a midwit
at least I'm still pretty good at math (until someone invents a test for that too)
gpt-2: parrot
gpt-3: also a parrot
gpt-3.5-turbo: more of a macaw
gpt-4o: parrot-esque
gpt-5: um, can we put the whole parrot idea behind us already?
gpt-6: who ever said that AI models are parrots? certainly not me!
Joel Grus 🤠retweeted
Replying to @MelMitchell1 @BlancheMinerva
how does "RL post training" change anything, you still end up with a stochastic "predict the next word" model
and the harness is basically a while loop and a bunch of tools, how does that eliminate "parrot-dom"
I was just talking about this yesterday
For the average computer user how is any software (Office? Gmail? Amazon? Zoom? Slack? Spotify? etc) better than it was a couple of years ago
("Excel now has a copilot button!")
Joel Grus 🤠retweeted
I've been using Jev for all kinds of things. This morning I had a realization I kind of like:
Use it to make non-black-box embeddings.
Instead of an embedding model spitting out 1,536 numbers that mean nothing, you ask Jev questions about each document. The answers become the vector.
An email in Cora:
"I got charged twice this month, pls fix asap"
[is_customer, urgent, about_billing, needs_reply]
[1.0, 0.9, 1.0, 1.0]
A newsletter:
[0.0, 0.0, 0.0, 0.1]
A friend asking about lunch:
[0.0, 0.1, 0.0, 0.7]
Then it's just old-school cosine similarity search. Search "billing issues from customers" as [1, 0.5, 1, 0.5] and the double charge comes out on top.
Same idea for our articles at Every:
[is_tutorial, about_ai, contrarian, beginner_friendly]
Or support tickets:
[is_bug, angry, churn_risk, enterprise]
Every number has a name, so you can see why something matched. Need a new dimension? Add a question. Want urgent stuff first? Change the query vector.
Trying this in @CoraComputer now to make search fast.
here's the slides for my talk
"The Last Mile of AI Is Longer Than You Think"
at the Optimized AI Virtual Conference a few weeks ago
(talk track in speaker notes as always)
docs.google.com/presentation…