MLCommons (@MLCommons) header
MLCommons (@MLCommons) profile picture

MLCommons

@MLCommons

Better Artificial Intelligence for Everyone

mlcommons.org
Joined September 2020
  • Tweets873
  • Following150
  • Followers3.8K
160Media
Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)Photo by MLCommons (@MLCommons)
MLPerf is the performance yardstick in the EU's AI Gigafactories tender, and MLPerf Endpoints v1.0 is open for submissions, with rolling results and mandatory power reporting. Blog: mlcommons.org/2026/10/open-s… #MLPerf #AIBenchmarks #AI
The image is a graphic with the ML Commons logo. It reads, "MLPerf Endpoints v1.0 Open for submissions." Below this, it states, "Rolling submissions, mandatory power reporting, and a place in the EU’s AI Gigafactories tender: measurement buyers can trust.

ALT The image is a graphic with the ML Commons logo. It reads, "MLPerf Endpoints v1.0 Open for submissions." Below this, it states, "Rolling submissions, mandatory power reporting, and a place in the EU’s AI Gigafactories tender: measurement buyers can trust.

1
4
753
MLCommons has launched Candela, a benchmarking service that runs AILuminate safety benchmarks where AI systems actually run: a model as released or a system as deployed. Practice on demand, official scores, percentiles comparable over time. mlcommons.org/2026/10/introd…
Image from MLCommons (@MLCommons)
1
2
404
MLPerf Client is in PCMag, StorageReview, and Wccftech, which used it to measure on-device AI performance on new laptops, including GenAI image generation and agentic workloads. Thanks to the reviewers! Try MLPerf Client: github.com/mlcommons/mlperf_…
Releases · mlcommons/mlperf_client

Releases · mlcommons/mlperf_client

MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios. - mlcommons/mlperf_client

github.com
1
2
577
MLCommons retweeted
MLCommons (@MLCommons) profile picture
MLCommons@MLCommonsOct 15
What is MLPerf Endpoints? It measures the served endpoint the way you actually buy it: model, hardware, serving software, and networking together, under production-like load. Guide: mlcommons.org/2026/10/mlperf… #MLPerf #AIInfrastructure #AIBenchmarks
An abstract representation of a cascade of glowing transparent blocks arranged in a descending stair-step pattern against a blue gradient background. The text reads, "MLCommons MLPerf Endpoints v1.0. Buy the capacity you actually need – not the peak score.

ALT An abstract representation of a cascade of glowing transparent blocks arranged in a descending stair-step pattern against a blue gradient background. The text reads, "MLCommons MLPerf Endpoints v1.0. Buy the capacity you actually need – not the peak score.

2
4
301
MLCommons has been selected as the Benchmarking Team for the STRIDE Ventures AI Efficiency Challenge. A $3.5 million, two-year award will fund MLPerf Agents: an industry-standard benchmark for the efficiency of complete agentic AI workflows. mlcommons.org/2026/10/nsf-st…
Image from MLCommons (@MLCommons)
3
199
What is MLPerf Endpoints? It measures the served endpoint the way you actually buy it: model, hardware, serving software, and networking together, under production-like load. Guide: mlcommons.org/2026/10/mlperf… #MLPerf #AIInfrastructure #AIBenchmarks
An abstract representation of a cascade of glowing transparent blocks arranged in a descending stair-step pattern against a blue gradient background. The text reads, "MLCommons MLPerf Endpoints v1.0. Buy the capacity you actually need – not the peak score.

ALT An abstract representation of a cascade of glowing transparent blocks arranged in a descending stair-step pattern against a blue gradient background. The text reads, "MLCommons MLPerf Endpoints v1.0. Buy the capacity you actually need – not the peak score.

2
4
301
Our mission, updated: standardize AI measurement and enable informed decisions. Read the letter from President Peter Mattson: mlcommons.org/2026/10/missio…
The image contains a blue digital representation of a block tower with floating cubes, accompanied by the text: "Our mission, updated: Standardize AI measurement and enable informed decisions." Below, the MLCommons logo is visible.

ALT The image contains a blue digital representation of a block tower with floating cubes, accompanied by the text: "Our mission, updated: Standardize AI measurement and enable informed decisions." Below, the MLCommons logo is visible.

130
A vendor's AI benchmark caught 82% of bugs. A rival re-ran the same test: 45%. An independent lab built its own: 63%. Same products. Only the grading changed. New from MLCommons: Assessing & Managing AI Risk for Business and Commercial Deployments. mlcommons.org/2026/10/ai-ris…
A business guide titled "Assessing & Managing AI Risk in Business" by ML Commons. The accompanying risk register lists "Credit risk," "Currency exposure," and "Workplace safety" with marked columns for measure, price, and manage. "AI risk" is unchecked in all columns.

ALT A business guide titled "Assessing & Managing AI Risk in Business" by ML Commons. The accompanying risk register lists "Credit risk," "Currency exposure," and "Workplace safety" with marked columns for measure, price, and manage. "AI risk" is unchecked in all columns.

127
A chatbot's data protection risks are, for the most part, limited to the individual user. For an agent, the scope is vast. MLCommons releases the Agent Privacy Risk Taxonomy v0.1 - five risk areas specific to agents. Read more: mlcommons.org/2026/10/agent-… #AIPrivacy #AgenticAI
Image from MLCommons (@MLCommons)
160
MLPerf Training introduces DLRMv4: HSTU sequence modeling + Yambda-5B (4.79B real interactions) + a 560 GB embedding footprint. Production-scale recommenders, now benchmarked. Full breakdown from the AMD, Meta, NVIDIA, and ByteDance task force: More: mlcommons.org/2026/10/dlrmv4…
Image from MLCommons (@MLCommons)
1
2
321
MLPerf Training v6.1 adds the suite's first LLM post-training benchmark: agentic RL that teaches a 397B-parameter open-weight model to repair real software, scored on pass@4 quality - not just throughput. Details from the task force: mlcommons.org/2026/09/mlperf…
Image from MLCommons (@MLCommons)
1
2
1
8
642
MLCommons joins the EU-funded AIRIS consortium to benchmark next-generation biomedical AI. We're building an evaluation framework to measure mechanism-informed generative AI across accuracy, robustness, fairness, interpretability, and usability. More: mlcommons.org/2026/09/join-a…
Image from MLCommons (@MLCommons)
1
1
188
MLPerf Inference v6.1 WG chairs Miro Hodak and Frank Han walk through the record round, new silicon (AMD MI350P, Intel Arc Pro B70, NVIDIA Vera Rubin), the first cross-vendor heterogeneous submission, and what it signals for inference engineering. mlcommons.org/2026/09/chairs…
Image from MLCommons (@MLCommons)
1
1
357
🧵 1/ @MLPerf Inference v6.1 is here. Record participation, new benchmarks, and substantial performance gains. 30 organizations submitted — the most ever. Details: mlcommons.org/2026/09/mlperf…
Image from MLCommons (@MLCommons)
1
3
2
6
897
more replies
6/ Orrick, @QuantaQCT, @RedHat, @scitix, @Supermicro, @withtta, VibeHPC, @WiwynnCorp, @NaeemKhoshnevis.
1
2
86
7/ 50%+ used our new API-centric harness — the LoadGen++ foundation for MLPerf Endpoints. The transition is happening. mlcommons.org/2026/09/mlperf…
MLCommons Sets Participation Record with New MLPerf Inference v6.1 Benchmark Results - MLCommons

MLCommons Sets Participation Record with New MLPerf Inference v6.1 Benchmark Results - MLCommons

Latest version of the benchmark introduces two new tests for emerging AI deployment patterns, including Agentic Inference

mlcommons.org
1
54
Load more