Alice The Ai Expert

More and more, image models get ranked by human vote. A vote can miss that your font changed. Today @DavidZats and I are releasing VybBench, an open benchmark that scores design fidelity with numbers instead of votes. Ask a model to change one headline and it can nudge your font, shift your blue and redraw a corner of your logo too. Each edit changes a little more, until the design isn't yours. VybBench scores each piece: 145 fonts, matched pixel by pixel against the real font 100 hex codes, scored on how far each color drifts 200 small edits, scored on how many pixels changed, with a judge checking the edit was made We are not including model scores in the post, but you can see how each model scores on the Hugging Face. Every prompt, output, judge verdict and the scorer is on Hugging Face, link in the reply. Full Disclosure: At @cocoailabs we also build Vyb - our first design model built to preserve design fidelity and taste.