starbaser (@starbaser) header
starbaser (@starbaser) profile picture

Thinking...⋰⋱⋰ 。・:*:・゚★,。・:*:・゚☆。・:*:・゚★,。・:*:・゚☆ self-funded ・ building specialist models ・ seeking help, DM if interested

bay area / 32
Joined February 2025
Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)Photo by starbaser (@starbaser)
Anthropic’s J-Lens asks what an internal activation is disposed to verbalize. This is a geometry-first peek at a related object, the final post-LN/pre-LM residual states from a 32B param reasoning model solving a divisibility proof, via UMAP+animated with attention flow (WIP)
New Anthropic research: A global workspace in language models. Of everything happening in your brain right now, only a tiny fraction is consciously accessible—thoughts you can describe, hold in mind, and reason with. We found a strikingly similar divide inside Claude.
2
3
1
9
7,187
starbaser retweeted
Sillies ©️ nyanii_nya (Instagram), Model: coffely
1
44
1
262
2,933
∅-unbounded.
9
7
1
65
2,858
An independent mathematician outclassed both OpenAI's and Anthropic's mathematicians in terms of efficacy, quality, and research value. No "internal model", no swarm, no lean slop. Just pristine epistemics.
Replying to @ElliotGlazer
To make this project fully accessible, I have made a repo with the writeup, history, and full research handoff zip for this project. Just download it, boot it to Astra or Fable, and your agent will immediately have full context and be able to answer your questions!
8
379
And to be clear, I am not mad at Anthropic over this. Don't hate the player, hate the game. We take a different approach to building companies, but this type of stuff has been going on for decades. You have to adapt or die, which is why we started building our own intelligence.
20
13
359
63,479
Anthropic gets BTFO
Let me tell you a story about how unethical Anthropic is. In April, the Anthropic team began heavily courting our engineering team to tell them corporate secrets, technical details, and future plans for @cfosilvia. They pretended their interest was due to our exploding popularity and accelerating compute usage, but it quickly became apparent that Anthropic was fishing for details on how we built our product and why it was so popular. This included the Anthropic team trying to wine-and-dine our engineers, including a infamous steak dinner where someone told our team "don't worry about it, this is on Dario." Our team was not born yesterday, so we quickly realized what was happening and refused to share sensitive information and technical details with the Anthropic team. As we suspected, Anthropic was trying to get information from us, so they could build a competing product. Some people on their team must have a guilty conscious because they messaged us a few days ago to give us "a heads-up" that they were launching a competing product. Thankfully, the Silvia engineering team has been aggressively working to get off the frontier models for the last ~ 6 months. That effort has been highly successful, because our compute costs are ~ 97% lower when we use our own model & hardware, the latency is lower, and the accuracy of answers materially increases as well. The sad thing for Anthropic is they have now released an inferior product and they had to sell their soul to do it. The only thing worse than being a trillion-dollar company that can't beat a 10-person team is being a trillion-dollar company that no one trusts and everyone knows is unethical. Serious investors continue to choose @cfosilvia over ChatGPT, Claude, and other frontier companies because these products are not optimized to solve the actual user problem. Today, Anthropic launched a Claude wrapper that is masquerading as a personal finance product. Best of luck to them. But I will take the Silvia misfits vs the Anthropic losers any day of the week. if you want to support people trying to do things the right way, and help investors be more informed, then consider signing up for Silvia today: silvia.com
1
79
starbaser retweeted
San Francisco and tech elite have bad taste because developing good taste is a lot like playing chess You need to start young. If you don’t start young, it doesn’t matter how much time you put into it, you will never be better than the guy who devoted their attention to aesthetics and composition at 10 years old The rare person who exists between business/technical sense and a trained creative eye is world defining. Steve Jobs, Walt Disney, Ye, Elon.
36
33
9
661
25,004
Marisa walking past me in the Scarlet Devil Mansion hallway knowing we're both here to do the same thing to different people.
5
83
2
1,107
14,144
2
2
41
508
It's technically fake since if you try to reproduce it you just get flagged for safety risk :/ le pdoom virus o algo
We’re sharing how our biology research team worked with Claude to map the first 3D structure of a vault particle from bacterial life. Vault particles are a longstanding mystery. They are barrel-shaped objects, among the largest protein structures found in our cells. They were first discovered by Leonard Rome and Nancy Kedersha in 1986, but their function remains unknown. With Claude, we’ve found results that might bring us closer to solving that mystery. Until now, vaults were only known in the cells of complex things like animals and plants. We have shown that similar proteins from bacteria (and the viruses that infect them) can also assemble into vaults. Finding the structures in these simpler forms of life may make it easier to investigate their function in our own cells. For our life sciences team, the project was also a demonstration of the potential (and the limitations) of using AI to accelerate science. In our full piece, we discuss how Claude was able to dramatically speed up some stages—manually determining the vault particle’s structure would have taken weeks to months of painstaking work, but here it took days. We also discuss how Claude made some simple mistakes along the way, and how we collaborated with our machine learning researchers to address them. Read more: anthropic.com/research/inves…
2
1
15
626
starbaser retweeted
1: Indians make up 1% of Texas, but there are 150mn internet accounts in India to bait. Plus several mn in Pakistan + Bangladesh to complete that hate loop. 2: Musk has hidden likes, so nobody sees who's engaging. All they see are viral posts on their TL full of hate goop. 3: You earn $10-20 per post, 5-6 times a day spewing hate on Indians. 4: Basically Musk was/is paying for racist engagement imo in the hopes that that would divert some attention away from internal issues/inflation/war etc. 5. That didn't work
This just empirically is not true, to an extent that is bizarre. Texas is 1% Indian. It is 40% Hispanic and 40% "Anglo" white. Hispanic males and young white men flipped dramatically. Why are Indians even being discussed? Deeper: to a weird extent, most people right-of-MAGA seem to just utterly ignore the real demographics of immigration. We constantly hear about this rotating Flash's Rogues Gallery of Indians, Jews, Arabs, Black islanders, Somalis, West Africans (4-5 of these groups do VERY well here, btw). But...45-59% of all LEGAL immigrants last year were Hispanic; I'd bet ~80% since 2000, after a 5-minute scan. The USA is now 20% Latino. #just_sayin
12
143
2
1,191
35,019
starbaser retweeted
“What was it like to be able to say retarded?”
356
3,938
227
79,240
2,448,281
starbaser retweeted
Siapa disini yang udah mulai ngurang2in nonton story orang2? Ternyata hidup jadi tenang bgt rasanya woi
20
476
107
5,043
818,207
starbaser retweeted
We have got to start being more credentialist
unavailable
1
3
84
9,604
starbaser retweeted
claude, find all implicit state machines in my life
1
4
103
1,683
L retard
1
5
189
starbaser retweeted
hey do u remember when that guy at MIT made up a fake story about astra modifying model weights and ppl believed it without even double clicking
48
39
13
2,386
174,080
This is an old hat. That's exactly what the neural fast weight programmers did in the 1990s (including the 1991 unnormalised linear Transformer). Overview with links to the original papers: people.idsia.ch/~juergen/fas…
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math. rikiyat.github.io/blog/weight-sp… github.com/RikiyaT/lm_und… huggingface.co/Qwen/Qwen3.5-0… huggingface.co/RikiyaT/Qwen3.…
101
199
99
2,089
225,676
Ele é tímido
32
780
28
11,820
170,072
starbaser retweeted
Linear Representation or did we just get lucky? New paper: Is a Linear Probe evidence of a Linear Representation? arxiv.org/abs/2610.22655 🧵
Wow, I did not expect that DINOv3's global [CLS] token linearly represents the continuous geometric latents of dSprites (size & X/Y position) 🤯 It only took me 3.5 years to finally run this experiment 😂 I'm looking to do more of this MechInterp work, dissecting foundation models like biological artifacts and building theory. If you want to collaborate (especially students looking for a fun project) reach out! 🔬🤖
6
47
4
501
24,484