Patrick (@PatrickNBaron) header
Patrick (@PatrickNBaron) profile picture
San Francisco, CA
Joined July 2011
Patrick retweeted
Today we're releasing DeepFinance, the first ultra-long horizon benchmark for high finance work. A set of 21 problems that reflect work at top PE and IB firms, DeepFinance is built using real deal data. Problems are constructed by experts with backgrounds from top firms like Evercore, JPM and UBS, and institutions like HBS and Wharton. Problems represent work that would take human professionals 20-40 hours to complete. Can AI really diligence a $100M+ deal? Finance benchmarks today are limited to evaluating agents on QA on financial docs or grading the numerical correctness of simple financial models. However, real world high finance work is full of assumptions and conflicting evidence. We built DeepFinance to realistically evaluate agents on those end-to-end finance workflows. DeepFinance leaderboard: juliusresearch.ai/deep-finan…
109
66
42
705
114,746