Paul Decaire (@DecairePaul) header
Paul Decaire (@DecairePaul) profile picture

Assistant professor of Finance @WPCareySchool. French Canadian lost in the middle of the desert. Far from snow, moose and maple syrup!

Phoenix, AZ
Joined March 2021
We knew very little about how LLMs actually work...until now. @AnthropicAI just dropped the most insane research paper, detailing some of the ways AI "thinks." And it's completely different than we thought. Here are their wild findings: 🧵
80
1,276
86
10,235
1,523,763
Paul Decaire retweeted
rodneywhitecenter.wharton.up… 12 more days to apply to our summer school in structural estimation! It's a hands-on course in which you learn how to do SMM and then work on a problem set with your classmates. Open to PhD students in finance, accounting, econ. And faculty.
1
12
70
7,555
🚨Announcement: Virtual Workshop on Demand System Asset Pricing🚨 @motoyogo and I will organize a virtual workshop on using asset demand systems to answer questions in asset pricing and macro finance using modern AI and machine learning tools.
3
31
1
91
12,117
I’m glad we never have to vote again. This was so stressful.
81
242
28
3,416
301,006
Paul Decaire retweeted
POV: the senior engineer is giving you a tour of the data stack
10
93
11
1,133
83,110
Paul Decaire retweeted
Super excited to read this!
📢 AI Snake Oil is out today! I have too many feelings because this book has been five years in the making. In 2019 I gave a talk on AI Snake Oil and tweeted out the slides. I had no idea my career was about to change. Within a couple of days I had 30 or 40 invites to write a book or an article. I said no to all of them because I felt I needed to do more research to be able to write a book. So when @sayashk joined my team I knew this was the topic we were going to work on. The book is based on our research on limits to prediction, the dangers of predictive decision making, the reproducibility crisis in machine learning based science, the limits of large language models, and the risks of social media algorithms. The book is not an anti-technology screed. If our point was that all AI is useless, we wouldn’t need a book to say it. It’s precisely because of AI’s usefulness in many areas that overhyped claims and outright snake oil have been so successful in the market. It’s hard for people to tell these apart, and we hope our book can help. And while we think the tech industry should have much more accountability, the harms we describe are usually not solely due to tech, and much more often due to AI being an amplifier of existing problems in our society. A recurring pattern we point out in the book is that "broken AI is appealing to broken institutions" (Chapter 8). Since our book talks about what AI can’t do, AI boosters often tell us it’s going to be outdated soon. If you think so, I’d love to have a friendly bet! Read the book and tell us what you think will be wrong in two years or five years. (You can start with the intro chapter, which is available online; the link is in my pinned tweet.) The reason we’re confident of our assessments is that they are not based on limitations of the technology. Instead, they are based on inherent limits to prediction grounded in our sociological analysis. (The book owes a huge debt to Princeton sociologist @msalganik; our collaboration with him informed and inspired the book.) We also talk a lot about what we shouldn’t use AI for, even if we can. We’ve had many moments of hope and trepidation for the book as we worked on it over the years. We’re so grateful for the early interest the book has had, especially to the 40,000 people who subscribe to the AI Snake Oil newsletter, and the many podcasts that have had us on to talk about the book. We’ve had great reviews in The New Yorker, Publishers' Weekly (featured in the Top 10 science books for Fall 2024), and many other outlets. And we’ve had such a wonderful experience working with Princeton University Press. We’re also fortunate to have received incisive peer reviews from @MelMitchell1 , @mollycrockett , @chris_bail, and three anonymous reviewers. The book is so much better as a result. What's in the book Chapter 1: Introduction. We begin with a summary of our main arguments in the book. We discuss the definition of AI (and more importantly, why it is hard to come up with one), how AI is an umbrella term, what we mean by AI Snake Oil, and who the book is for. The entire introduction is available online. See the link in my pinned tweet. Chapter 2: How predictive AI goes wrong. Predictive AI is used to make predictions about people—will a defendant fail to show up for trial? Is a patient at high risk of negative health outcomes? Will a student drop out of college? These predictions are then used to make consequential decisions. Developers claim predictive AI is groundbreaking, but in reality it suffers from a number of shortcomings that are hard to fix. Chapter 3: Can AI predict the future? Are the shortcomings of predictive AI inherent, or can they be resolved? In this chapter, we look at why predicting the future is hard — with or without AI. While we have made consistent progress in some domains such as weather prediction, we argue that this progress cannot translate to other settings, such as individuals' life outcomes, the success of cultural products like books and movies, or pandemics. Chapter 4: The long road to generative AI. Recent advances in generative AI can seem sudden, but they build on a series of improvements over seven decades. In this chapter, we retrace the history of computing advances that led to generative AI. Chapter 5: Is advanced AI an existential threat? Claims about AI wiping out humanity are common. Here, we critically evaluate claims about AI's existential risk and find several shortcomings and fallacies in popular discussion of x-risk. We discuss approaches to defending against AI risks that improve societal resilience regardless of the threat of advanced AI. Chapter 6: Why can't AI fix social media? One area where AI is heavily used is content moderation on social media platforms. We discuss the current state of AI use on social media, and highlight seven reasons why improvements in AI alone are unlikely to solve platforms' content moderation woes. Chapter 7: Why do myths about AI persist? Companies, researchers, and journalists all contribute to AI hype. We discuss how myths about AI are created and how they persist. In the process, we hope to give you the tools to read AI news with the appropriate skepticism and identify attempts to sell you snake oil. Chapter 8: Where do we go from here? While the previous chapter focuses on the supply of snake oil, in the last chapter, we look at where the demand for AI snake oil comes from. We also look at the impact of AI on the future of work, the role and limitations of regulation, and conclude with vignettes of the many possible futures ahead of us. We have the agency to determine which path we end up on, and each of us can play a role. ------- We hope you find the book useful and look forward to hearing what you think.
1
12
1,181
Paul Decaire retweeted
Imagine not being from the US and watching this as part of our presidential election process
17,095
14,551
6,085
187,817
20,324,433
Submissions to the FRA went live on July 1. You can submit your paper here (deadline Aug 31). fraconference.com/submit As with last year, we're delighted to partner with @J_Fin_Economics with a dual submission. Full details here: fraconference.com/fra-jfe-du…
12
2
48
6,989
Paul Decaire retweeted
this remains to me one of the best intern szn stories I’ve ever read
37
146
46
3,363
688,736
Paul Decaire retweeted
"It’s a timely book and, despite the nerdy statistical theories, is often quite funny." @hwallop's review of May Contain Lies in @thetimes: thetimes.co.uk/article/2f0d1…
4
21
3,020
Language models’ pretraining data includes information about historical events When we use LLMs to make economic predictions, do they leak information about the future? @keyonV and I develop tests that find evidence of lookahead bias in LLMs, and identify ways forward (1/n)
2
12
7
73
24,630
Hey @AmericanAir I am traveling with my daugther and I missed my connection because of a mechanical breakdown my flight was delayed! Your people on the phone told us that we would get our luggages to get my daughter clean clothes but the luggages never made it to the terminal!
1
2
707
Do you have a paper at the intersection of AI and finance? Please respond or DM. I am doing review of this fast moving research for the upcoming AFA panel on AI and the Future of Finance. aeaweb.org/conference/2024/p…
8
13
2
57
26,668
Paul Decaire retweeted
This means, by the way, that AI can conduct scientific fraud on command. Just tell GPT to “fix” a dataset by making & justifying changes to make a regression work better. It will give a “better” CSV. Not showing prompts, but it is trivial & another threat to academic integrity.
A thing that makes AI so revolutionary for data analytics is its ability to "creatively" solve problems when facing a barrier. I ask it to create a dataset with an r-squared of .02. First, it tries brute force, but then comes up many better approaches, solving issues as it goes.
10
39
2
208
53,034
🚨NEW PAPER🚨 "Anonymity and Identity Online" We geolocate the majority of EJMR posters and show that posting on EJMR is wide-spread at US universities and also frequent in other organizations employing economists. Presentation at NBER SI (7/20/2023): nber.org/conferences/si-2023…
67
223
243
1,300
1,808,090
Paul Decaire retweeted
Leaked Google document: “We Have No Moat, And Neither Does OpenAI” The most interesting thing I've read recently about LLMs - a purportedly leaked document from a researcher at Google talking about the huge strategic impact open source models are having simonwillison.net/2023/May/4…
113
1,112
255
4,786
1,944,901