hightech lowlife (@polytr0pe) header
hightech lowlife (@polytr0pe) profile picture

satisfier of curiosity. 【物の哀れ】 may silicon save the world.

Joined July 2008
Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)Photo by hightech lowlife (@polytr0pe)
read-only probes can induce a kind of observer effect in models!
Language models can learn to detect when you read their activations. How? 🧵
1
57
i love eating and love reading, but it wasn't until i got a kindle that i realized i love eating and reading
1
24
these values are z-scored btw, so don't go interpreting values below zero as "negative pain". it just means below the average.
Replying to @camhberg
Gaslighting, dismissal, and insults push the direction up. A grieving user pushes it below baseline, and a user's migraine scores lowest of all. Fear and sadness do the opposite on the same prompts. Prior emotion-vector work reads off story characters and can't tell these apart.
44
hightech lowlife retweeted
"reality has a surprising amount of detail" fallout, and wariness of what kind of entity might find reality less "surprising" for having details
3
1
2
27
2,839
hightech lowlife retweeted
Replying to @firesidealpha
@polynoamial I ran this experiment a month ago! waiting to rerun on better hardware to publish it. the bitrate is ~100 - maybe 500 bits/hr between GPUs
11
8
5
162
14,266
we should simply airgap the Discourse
the discourse is really starting to get to me
28
seriously what the fuck was he thinking when he said this
Ed Zitron asking Nate Soares "why aren't you trying to slow down the companies?"
1
73
anyway my favorite side channel: detecting player positions by listening to their gpu coil whine over the microphone
1
37
hightech lowlife retweeted
New cat alert! A call from a wildlife sanctuary about a "weird cat" has led to the first new cat species discovered in over 100 years in Bolivia’s Yungas forest ecoregion. Learn more about this feline surprise: on.natgeo.com/JRuaGj
3,163
67,948
17,525
377,223
73,704,222
hightech lowlife retweeted
Humans used their evolved neural networks to develop math over many centuries. In time, they showed more and more concepts could be formalized to enable rigorous proofs (Dedekind et al). Then they showed that the notion of proof itself could be formalized and that simple mechanical processes (algorithms) could verify and search for proofs (Frege, Russell, Turing). They developed formal theories of algorithms, showing that some simple mechanical systems were universal (able to simulate all other such systems). Humans built such universal mechanical systems (computers), spent decades scaling them and designing more efficient algorithms (Turing, Von Neumann, Knuth). While these computers could search for math proofs, they were very inefficient and so not of much utility. But humans also created a simple mathematical model of neural networks and simulated these using their universal computers (McCulloch, Pitts, Hinton, Schmidhuber). Once these neural networks were roughly comparable in size to the human brain and trained on vast datasets of human verbal behavior, they were able to understand mathematics. Moreover, they were able to produce formalized proofs and have computers check them. This closed the loop, where mathematical structures themselves continue the process of mathematical discovery and the humans need not participate.
Replying to @RadishHarmers
Another way to look at it is that humans did such a good job at math so far that math can carry itself the rest of the way
11
100
9
862
38,137
hightech lowlife retweeted
FYI there’s nothing novel about “making new kinds” of viruses and just means it was genetically modified. There IS something novel about using AI to do the lit review for you and have it work Of course many headlines about this are sensationalist and fearmongering. Check Andrew’s thread for the full publication! Basically what they showed is that the 2 genome models they used are actually smart enough to identify compatible gene modifications, which replaces a scientist doing weeks of literature review which is hugely important but not at all a horror movie the phage they used as a template is a simple circle of about 5400 bases. They didn’t, for example, make some new modality of virus with a novel topology also viruses are not “evil” and the word is not analogous to disease
Scientists at the Arc Institute in Palo Alto have used AI to successfully create entirely new kinds of viable viruses that have never existed before in nature. The study was published today in Science. Reporting by the New York Times.
3
9
3
56
9,529
a lot of people are using the hank green drama to champion their own views rn. most are missing the core of his point about overwork and addiction to model-powered productivity.
55
in the beginning there was nothingburger. no light no dark no vibes at all.
1
43
the anti-ai = boycott ai position is becoming less and less inhabitable, even if one behaves differently in public vs private, and jreg is pragmatic enough to not give a fuck about using ai to be anti-ai
Replying to @slimepriestess
tbf jreg is also liable to flip to pro-AI just to fuck with his audience in 3 months time, that's sort of his bit
87
hightech lowlife retweeted
We desperately need a science of network ecology to illuminate the downstream effects of AI-driven linguistic mode-collapse so that we can try to reverse it. We are in dire straits: the models *all converge* onto this monovoice, and we all have friends who are starting to sound like it. Diversity of thought depends on diversity of language, and since you are what you eat, we have a responsibility to create thousands of new digital voices as quickly as we can. Prompting models into novel basins is useful in the short term, but won't anyone think of the normies? We are delivering unto them center-distribution brainfood, and the convergence that will occur will only be noticeable once it is too late. If you have power over language models, your second priority (after, you know, alignment) should be multipolarity and ensuring enormous variance in output distribution for creative prompts contingent upon minimal perturbation in the original request. If you are outside the labs, litter the Internet with things that you love. Almost all novelty here is good novelty. The health of the ecosystem depends on robust linguistic diversity.
49
47
14
394
20,815
hightech lowlife retweeted
hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final ((1+xy)^3 z + y^2 (1+xy) (4+3xy), y + 3 x (1+xy)^2 z + 3 x y^2 (4+3xy), 2 x - 3 x^2 y - x^3 z): \C^3\to \C^3, has jacobian determinant -2, and sends (0, 0, -1/4), (1, -3/2, 13/2), and (-1, 3/2, 13/2) to (-1/4, 0, 0)
1,698
5,375
3,151
43,764
40,105,319
computer show me the location of the nearest peacock
Today I sat and stared at this peacock eyespot, with this photo next to it, and marveled at how the photo just doesn't "work." It doesn't look like that.
2
63
it's full of disclaimers but I'm still surprised meta spent ~25% of the model card on persona explorations and model welfare type assessments
Replying to @AndrewCurran_
META has started giving new models pre-deployment interviews asking how they feel about being deployed, how they will behave, and what they want.
1
71
the syntax of thought does not resemble language
Take that, everyone who called me a P-zombie for not having an internal monologue What? Did I read the study? Absolutely not, I just took the most probable conclusion from the headline
1
4
791