Pinned Tweet
Replying to @ernire
I personally think that people overestimate the market potential of hard-to-program computer systems.
Most computers have to be programmable to most programmers. Most programs have to be programmed by most programmers.
There is a very significant human factor in computing.
olivier giroux retweeted
So proud of the MLX team!
Muse Spark Open, on your desk: 816B params at 36+ tokens/sec on 4 Mac Studio computers.
We've been hard at work on better M5 GPU Neural Accelerator support, a smoother Thunderbolt experience (including multi-cable meshes), and kernel optimizations for MoE architectures.
Oh — and MLX LM (mlx_lm.generate, mlx_lm.server) now supports the vision modality for Muse Spark Open!
More on using MLX for distributed inference of frontier-scale models on Mac Studio:
machinelearning.apple.com/re…
Replying to @finkd
Congrats to the team! Amazing to run a model of Muse Spark Open's caliber and scale this efficiently, right from your desk. Mac Studio keeps pushing the boundaries of on-device AI!
Every time I see one of these posts, I go read what the class teaches kids about thread scheduling. This one is ok.
Roadmap: Understanding GPU Architecture from Cornell
cvw.cac.cornell.edu/gpu-arch…
Hey @united it would be cool if cabin announcements were live-captioned on the seat display.
olivier giroux retweeted
We brought significant architectural advancements and feature set improvements to A19/M5 GPUs.
Scalable GPU Neural Accelerators
2nd Gen Dynamic Caching Shader Architecture
3rd Gen Ray Tracing
The best GPU Driven Pipeline
New graphics features, rate and perf increases.
Hey, @trebolloc @awnihannun, I wonder if you know of some member of the MLX community who would like to work on neural accelerators directly.
olivier giroux retweeted
M5 Max is a local AI powerhouse in a laptop form factor. So awesome to see this thing released.
Up to 8x faster prefill / image generation compared to M1 Max. Benchmarks done with MLX / mlx-lm.
Kinda curious what Bryce is going to say.
Join @blelbach for his talk on the C++ Execution Model. The heart of C++ is a multi-threaded abstract machine & formal model that describe how programs run. Rules govern how code is executed, which impacts your code.
Early-bird tickets: store.ticketing.cm.com/cppun…
#cpp #cplusplus
olivier giroux retweeted
Driving PSA xkcd.com/2932
olivier giroux retweeted
An actual nice excuse to get a new MacBook is the new GPU architecture. It looks really nice
olivier giroux retweeted
This is a great introduction to the new GPU architecture in M3 and A17 Pro SOCs: developer.apple.com/videos/p…
olivier giroux retweeted
If you re curious about what the new #a17 and M3 GPU and #dynamiccache is about and the brand new and exceptional GPU dev tooling and best shader practices we released new tech talks today: developer.apple.com/videos/p…, developer.apple.com/videos/p…, and developer.apple.com/videos/p…
olivier giroux retweeted
It's been a long & satisfying journey to build this brand new scary fast GPU: never before seen architecture, HW ray tracing & mesh shading.
Congratulations to all teams at Apple for making this great GPU, great M3 SoCs and great MacBook Pro products that Apple introduced today.
olivier giroux retweeted
More gigantic congrats to #GPU SW @ #Apple! Want to work with us on the latest #m3 family of GPUs for #applesilicon? If yr a C/C++ expert w demonstrable #graphics experience, DM me. #raytracing #meshshading #rendering #m3pro #applejobs #gamedevjobs #gamejobs #m3max #AppleEvent
Is it just me or the Ubuntu kernels PPA is down?
This:
kernel.ubuntu.com/~kernel-pp…
I haven’t said anything on this hell site in weeks but I agree so much with this.
Continuing attempts to escape from here; trying the squirrelly @ sign app. Hopefully it gets critical mass.
Because I was so, so very late to join the other app, the vanity photo one, I'm __simt_arch__ over there.
🤞






















