@AIFlow_MLi
iAccount based inThailand
About this account
- Account based in
- Thailand
- Connected via
- Italy App Store
Account-level information from X, not a live location or the device used for a specific post.
CEO AIFlow Labs https://nitter.cf/t.co/L27ts7lnGL SOCIETY 👁️ CEO @wearessociety CTO @datainetwork Advisor @WOWsummitWorld Dev - @ElizaOS
Phuket
Joined October 2023
- Tweets14.7K
- Following5.6K
- Followers4.5K
- Likes54.4K
Igor Lessio - Robots/acc - AIFlow Labs retweeted
github.com/githubnext/localj…
Not everyone on the team has access to Jev yet. Spent a morning cobbling together a poor man's Jev on top of omlx for local use. Benchmarked and eval'ed a variety of models including diffusiongemma and a variety of autoregressive models (Qwen MoE, Gemma 4 MoE, and Gemma 4 e4b/e2b.) Benchmark report is in the repo.
This is 100% promptcoding but hey the evals look okay, speeds are pretty good on local machine (m5 max 64gb), and the LocalJev server exposes an API that can be used with the normal Jev API wrapper libraries.
We are in the hands of soy boys here.
Bring on Skynet
OpenAI's Noam Brown says air-gapping the computers may not stop a misaligned AI, because two air-gapped machines can still talk by running a CPU hot and reading the temperature change
"But I think the major takeaway from the incident is that people underestimated the AI. And we never want to be in a situation again where we underestimate the AI. It's a weird world, because AI progress is so fast that people are consistently underestimating the AI."
"So to be in a situation where you don't underestimate it again, when it comes to safety and alignment, you have to have a very, very, very high bar."
"You could even go as far as to say, "Well, we should air gap the computers." And I'm not convinced that that would be sufficient."
"There are studies, and this is mostly academic, where you can have two computers next to each other that are air-gapped and they're still able to communicate with each other because they have temperature sensors."
"One of them is able to run their CPU really hot, and then the other one can actually detect the temperature change, and then that actually gives them a mechanism to communicate."
_________
Link and more key quotes from OpenAI's safety related conversations: firesidealpha.substack.com/p…
Great !!! @AlibabaGroup
Alibaba open-sources medical AI model that can detect cancer and nearly 150 conditions
scmp.com/tech/big-tech/artic…
Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro ⚡
Meet Inco Splash: our open-source inference engine, built around the model and around Apple silicon.
Up to 3× the decode speed of Ollama, 2× oMLX, and almost 4× when an agent fans out into sub-agents.
Just had a chat with a trainer and he told me after see my strategy that I should go back to university and get a degree hahaha
we have some more senior engineering roles we're looking to fill at anomaly on opencode and other projects
email [email protected] if
- you can do inference on $100M of hardware
- you are amazing at product
- you are deeply experienced with infra
Igor Lessio - Robots/acc - AIFlow Labs retweeted
Kev-0.5B: A tiny open source Jev-like decision model with a TypeSafe-compatible API based on Qwen2.5-0.5B that you can train and run on a MacBook Pro.
Model card and weights are available on GitHub
github.com/jaredpalmer/kev
Igor Lessio - Robots/acc - AIFlow Labs retweeted
Introducing Bespoke Nimble: an open data, open model, open recipe for an open Jev.
Code and info: github.com/bespokelabsai/nim…
Model: huggingface.co/bespokelabs/B…
Data:
* A new data curation recipe called contrastive data curation.
* Slightly change facts to generate negative data. This pushes the model to discriminate better and become a better decision maker. The calibration is implicit.
* Didn't do ablations but I think this is a critical piece!
* This also means training data doesn't need probabilities.
* Data covered 10 categories, and is fully synthetic.
* This data is split into train and eval.
Training
* LoRA finetune of Qwen3.5-9B.
* Distillation-free: we use Jev to only evaluate.
* No RL yet!
Serving
* Parallel constrained decoding as suggested by @NielsRogge and @harshagundal.
Results:
* The post-trained Qwen (Nimble) became substantially better on our curated eval: 66% for Qwen to 90% for Nimble. Jev is at 93%.
* 100ms on H100 and free to use on your macbook! Feel the AGI for free.
* 2 days of building in public. :)
Big caveat is that there is no standard benchmark to measure performance, and it's possible Nimble is much worse on other benchmarks compared to Jev. But it should be better than Qwen!
We thank @typesafeai for making Jev and the inspiring discussions in the community. Hope this release lifts all the boats and encourages more research and activity in this space.
We need local Ai with at least 250k token context. Stop post 500/tps with 4k context is fucking useless.