The DBOT Test — Orange Pill Wiki
EVENT

The DBOT Test

The 2024 NYU experiment in which Vasant Dhar built an AI trained on Damodaran's entire output — a bot that imitated his voice but failed to replicate his judgment, becoming the empirical demonstration of where the AI moat actually sits.

DBOT is the AI entity built by NYU machine learning professor Vasant Dhar and his team in 2024, trained on every blog post, lecture, valuation, and book Damodaran has published over four decades. It can value any publicly traded company, produce comprehensive reports in Damodaran's prose style, and follow Damodaran's stated methodology. When tested against Damodaran's own published valuations, DBOT's outputs came within plus-or-minus fifty percent of market value — a range its creators considered encouraging. But DBOT has a specific limitation that the research team itself documented: "produced reports in the linguistic style of Damodaran, but failed to capture his analysis and thus lacked credible valuations." The bot replicated voice; it did not replicate framing. This gap — between voice and judgment — is the empirical demonstration of where AI-resistant moats actually sit, and it became the founding case study for Damodaran's 2024 "Beat Your Bot" essay.

In the AI Story

Hedcut illustration for The DBOT Test
The DBOT Test

The DBOT case is illuminating because Damodaran's published output is unusually voluminous and consistent — perhaps the largest, most coherent body of valuation writing by a single author in the field. If any expert's work could be successfully replicated by AI training on text alone, his could be. The fact that DBOT failed at the analytical layer despite succeeding at the prose layer suggests that the analytical layer involves something not captured in the text itself — judgment about which narrative to test, which comparable companies illuminate, which risks deserve weight.

Damodaran's specific framing diagnoses what DBOT cannot do. When Damodaran valued Nvidia in June 2023, he started not with financial statements but with a framing question: is AI revolutionary, incremental, or minimalist technology? The framing determined the entire structure of what followed. When he grouped Walgreens, Starbucks, and Intel together, he framed them as "aging companies refusing to age gracefully" — a narrative lens requiring integration of pattern recognition, industry context, and aesthetic judgment about which comparisons illuminate rather than merely group. DBOT cannot generate these framings because the text it was trained on contains the framings as outputs, not as the cognitive processes that produced them.

The DBOT test connects directly to corporate valuation. Every software company faces a DBOT moment: can a competent team with AI tools replicate the function this company performs? The answer locates the moat. For the basic CRM functionality of Salesforce, the answer is yes — and the code-dependent revenue is repriced accordingly. For the integration layer that connects Salesforce to hundreds of enterprise systems for hundreds of thousands of specific customer workflows, the answer is no — the function requires judgment about which integrations matter for which customers, the kind of judgment DBOT failed to replicate.

Damodaran's response to DBOT — that he has perhaps a decade to stay ahead of it — is the personal version of the corporate question every CEO and every investor must now answer. The clock is ticking on every advantage built at the mechanical layer. The advantages built at the judgment layer have longer time horizons, but they are not infinite, and the practices that produce them must be deliberately maintained against the AI tools that erode them as a side effect of their utility.

Origin

Vasant Dhar, professor of business and machine learning at NYU Stern, called Damodaran in spring 2024 with the news that his team had constructed DBOT. The bot was tested through 2024 and the results published in the AI and finance literature, prompting Damodaran's August 2024 essay.

Key Ideas

Voice replication, judgment failure. DBOT mimicked Damodaran's prose with high fidelity; it could not replicate his framing decisions or analytical choices.

The framing layer is the moat. Damodaran's distinctive contribution is not running DCF models — anyone can do that — but deciding which narrative to test before the model runs.

Empirical demonstration of the principle/rules distinction. DBOT excels at rules-based execution; it underperforms at principle-based judgment.

The corporate analog. Every company faces its own DBOT moment; the answer to "what could a competent AI-augmented team replicate?" locates the moat.

Appears in the Orange Pill Cycle

Further reading

  1. Aswath Damodaran, "Beat Your Bot: Building Your Moat Against AI," Musings on Markets blog (August 2024)
  2. Vasant Dhar et al., Research papers on cognitive computing applications to financial analysis (NYU Stern, 2024-2025)
  3. Aswath Damodaran, Narrative and Numbers (Columbia Business School Publishing, 2017)
Part of The Orange Pill Wiki · A reference companion to the Orange Pill Cycle.
0%
EVENT