
Building @hybridity_ai ex LLM researcher
Stockholm, Sweden
Joined April 2013
- Tweets1.6K
- Following2.6K
- Followers1.6K
- Likes23K
The constant decel messaging in Europe is insufferable as an adult, but its effect on kids is worse. As a parent, it's your obligation to counterprogram this nonsense. Show them robots, rockets, and wonders of AI. Show them cathedrals and moon landings. Instill hope in progress.
Ariel Ekgren retweeted
Replying to @francoisfleuret
It's all computation. Math is just a game we play to reason about some simpler parts of computation.
Ariel Ekgren retweeted
New Anthropic research: A global workspace in language models.
Of everything happening in your brain right now, only a tiny fraction is consciously accessible—thoughts you can describe, hold in mind, and reason with.
We found a strikingly similar divide inside Claude.
Ariel Ekgren retweeted
come to stockholm folks
Replying to @antonosika
@antonosika & @MaxJunestrand having a chat earlier this week while looking at the Stockholm skyline.
Two years ago these guys were building in the dark.
Now they represent the next-gen of AI-native founders coming from Stockholm & Nordics.
Never been a better time to build.
Ariel Ekgren retweeted
LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote server + self-replicate. link below
Ariel Ekgren retweeted
The EU initiative Going Dark has now been launched by the EU Commission. They call it ProtectEU.
It’s a rebranding of Chat Control. New name. Same old propaganda.
The EU Commission’s goal is to “access encrypted data in a lawful manner, safeguarding cybersecurity and fundamental rights.”
Read the full release from the Commission here:
eur-lex.europa.eu/legal-cont…
Ariel Ekgren retweeted
Today, I see the world as a jungle, a constant struggle between all sorts of people and groups. The divine force field of justice is a childish hallucination, and instead we have a never ending negotiation between decency, incentives, existing power, decay, ideas and innovation.
Ariel Ekgren retweeted
Put your work on arXiv and release 100% of your code/data/Mathematica notebooks/etc., packaged up in such a way that *anyone* can reproduce all of your results in a single click. Call out people who don’t. That’s what peer review should look like in the 21st century.
Ariel Ekgren retweeted
Mathematics can be understood as a way to formalize and codify the way in which minds (not just human ones) represent. Gödel and Turing demonstrated the failure of the nonconstructive branch. What’s left is constructive mathematics (computation).
Ariel Ekgren retweeted
Mario Draghi's new report on EU competitiveness doesn't mince words.
"Across different metrics, a wide gap in GDP has opened up between the EU and the US, driven mainly by a more pronounced slowdown in productivity growth in Europe. Europe’s households have paid the price in foregone living standards. On a per capita basis, real disposable income has grown almost twice as much in the US as in the EU since 2000."
"First – and most importantly – Europe must profoundly refocus its collective efforts on closing the innovation gap with the US and China, especially in advanced technologies. Europe is stuck in a static industrial structure with few new companies rising up to disrupt existing industries or develop new growth engines. In fact, there is no EU company with a market capitalisation over EUR 100 billion that has been set up from scratch in the last fifty years, while all six US companies with a valuation above EUR 1 trillion have been created in this period. This lack of dynamism is self-fulfilling."
"There are not enough academic institutions achieving top levels of excellence and the pipeline from innovation into commercialisation is weak. [...] However, while the EU boasts a strong university system on average, not enough universities and research institutions are at the top. Using volume of publications in top academic science journals as an indicative metric, the EU has only three research institutions ranked among the top 50 globally, whereas the US has 21 and China 15."
"Regulatory barriers to scaling up are particularly onerous in the tech sector, especially for young companies. Regulatory barriers constrain growth in several ways. First, complex and costly procedures across fragmented national systems discourage inventors from filing Intellectual Property Rights (IPRs), hindering young companies from leveraging the Single Market. Second, the EU’s regulatory stance towards tech companies hampers innovation: the EU now has around 100 tech-focused laws and over 270 regulators active in digital networks across all Member States. Many EU laws take a precautionary approach, dictating specific business practices ex ante to avert potential risks ex post. For example, the AI Act imposes additional regulatory requirements on general purpose AI models that exceed a pre-defined threshold of computational power – a threshold which some state-of-the-art models already exceed. Third, digital companies are deterred from doing business across the EU via subsidiaries, as they face heterogeneous requirements, a proliferation of regulatory agencies and “gold plating” of EU legislation by national authorities. Fourth, limitations on data storing and processing create high compliance costs and hinder the creation of large, integrated data sets for training AI models. This fragmentation puts EU companies at a disadvantage relative to the US, which relies on the private sector to build vast data sets, and China, which can leverage its central institutions for data aggregation. This problem is compounded by EU competition enforcement possibly inhibiting intra-industry cooperation. Finally, multiple different national rules in public procurement generate high ongoing costs for cloud providers. The net effect of this burden of regulation is that only larger companies – which are often non-EU based – have the financial capacity and incentive to bear the costs of complying. Young innovative tech companies may choose not to operate in the EU at all."
More: commission.europa.eu/documen….
Dear Mario Draghi, a year ago, I asked you to prepare a report on the future of Europe’s competitiveness.
No one was better placed than you to take up this challenge.
Now, we are eager to listen to your views ↓
nitter.cf/i/broadcasts/1mnxeAPOD…
Ariel Ekgren retweeted
Actually this was really good - a tour from one transistor to a small CPU (Scott CPU, to be precise).
The YouTube playlist:
youtube.com/watch?v=HaBMAD-D…
I also haven't yet come across the "But How Do It Know" by Scott, which this is based on, and which looks great:
amazon.com/But-How-Know-Prin…
Turns out this is a whole deeper rabbit hole of people who've also built + simulated it in code, e.g.:
djharper.dev/post/2019/05/21…
Now I must resist the temptation to simulate Scott CPU in C, add tensor cores to it, move it to an FPGA and get it to inference a Llama.
Ariel Ekgren retweeted
Brexit may yet turn out to have been a good idea, if it means the UK can be the Switzerland of AI.
Ariel Ekgren retweeted
Bias is in the eye of the beholder. Yann LeCun says it is impossible to produce an unbiased AI system, so the solution is a free and diverse range of models
Ariel Ekgren retweeted
I think assuming you’ll get gpt-4 or even gpt-3.5 level quality in a sub 7B LLM is a mistake. Problem is it might do well on benchmarks but then you start using it and realize there’s all these edge cases it doesn’t handle well - does not generalize as well as the larger models
Ariel Ekgren retweeted
I just found out that @AISweden has continued to do amazing things and trained a 20B and 40B model! Very excited to brag about all y'all's excellent work in the future :)
Also, you should add your eval benchmarks to the LM Eval Harness!
































