@bootstrap_yang
Joined March 2012
How did agents become this good how were the rough edges smoothed out
1
2
451
"Data is the new oil, and we're bombing those too"
1
24
GSV upon further reflection... retweeted
Chinese AI cos historically have invested less in this type of thing so this is a notable development.
ByteDance has set up a dedicated frontier AI model alignment and preparedness department, Chinese media The Paper reports. The department will work on model/agent alignment and frontier risk mitigation including CBRN (one of the first Chinese companies to say publicly that they are working on this). Worth noting that ByteDance has always had a team working on model alignment, led by Yan Lin (严林). What's new is that this work is now being elevated to the level of a standalone department, while still being led by Yan. thepaper.cn/newsDetail_forwa…
2
2
28
1,083
Is there a prediction market on when the pr would flip again and towards what direction
there have not been fundamental advancements in alignment since RLHF. most of the stuff remains at the level of folk theory rather than scientific or engineering disciplines. the prediction that capabilities would race far ahead of interp and alignment has come true imo
1
25
I think Vitalik talked about this once it's so insane!!! The Han people literally could've bootstrapped the singularity in 700AD if it stayed fragmented to kept the intellectual innovative energy, and today ppl are still infected with the Chinese-unity-mind-virus
With recent discussions of EA influence, it’s worth taking a look at the first time an effectiveness-oriented altruistic movement held significant sway over a country: 4th century BC China. The Mohists argued for “impartial care” as the moral standard, prioritized prevention of war as a top cause area, had members take high-paying positions in governments (i.e. the war-making bodies) to try accelerate defense over offense (and sometimes donate gold to the movement), and scorned spending on rituals and ceremonies on grounds that the poor should be given more food instead. The Daoists attacked them for demandingness and the Confucians for treating family like strangers. All lost to the Legalists when the Qin dynasty started. When impartial welfare philosophy came to the West with Bentham, it made a big advance on the Mohists. Mohist doctrine had been afraid of ghosts. Bentham disbelieved ghosts on the grounds that no one ever saw a naked ghost. He was deathly scared of goblins instead.
2
7
228
The exact reason why they're so relatively stagnant compared to what's possible it's so fucking stupid
2
14
GSV upon further reflection... retweeted
We aren't ready....
2
1
14
532
Wide Lukashenko is actually cyber bullying
24
Wide Zelensky is kinda unnecessary man’s already quite wide
2
28
Predicted this shit pre Covid; such a perfect diplomatic/intel tool and is a tilted win win for both govs
1
261
The kind of data center strikes AI ethics people can stand behind
If confirmed, this is telling: Russian data centres get hit, and online activity around AfD suddenly plummets. 📉 So much talk about German patriotism… then the connection from Russia goes down. 🤔🇷🇺
30
I’m so far behind on ai swe…
34
Clanker cocktail vs artisan cocktail
1
19
Is this hypothetical cocktail so different from the many deeply imperfect but load bearing drugs we’ve been administering for decades? In the same way that medicine isn’t ml (and ai bros should usually sit their ass down)…
This is a slide from Terence Tao's 'Math 2.0' public lecture yesterday evening at Caltech. I am highly confident that, if the cure actually worked, almost any Stage 4 cancer patient would tell you that human comprehension of its mechanism is completely irrelevant to them.
1
3
151
A key difference: the existing weird drugs aren’t lean verified lmao I’d take the new cocktail over the old artisan ones
1
2
17
GSV upon further reflection... retweeted
Why care? Distillation (or OPD) is used in frontier model training. Our results suggest that some kinds of misalignment could propagate via distillation through unrelated data. Reward seeking, scheming and secret loyalties involve conditional policies (like backdoors) and sophisticated capabilities (e.g. inferring how rewards are calculated for an environment). Caveat: Our experiments are in toy settings (because this makes transfer easy to measure) and future work could explore realistic post-training.
2
10
6
125
7,940
I’m totally ok with if the hillclimbing approach to agi alignment totally worked out and my hand wringing is but one of the signs of my neuroticism; but for now I really want to know how to improve the states more robustly through technical means…
2
78
The inverse p zombi: absolutely useless and a pointless existence in every respect other than being conscious (me myself)
2
54
My fingers are rotting from the tip rn so is my nose :(
3
54