Why 70% of Stock Pickers Underperform Simple Index Funds

The financial industry has a dirty little secret that Wall Street would prefer stayed buried in fine print. Roughly 70% of actively managed funds fail to beat their benchmark indexes over any meaningful time horizon. That number climbs even higher-approaching 90%-when measured across 15 or 20 years.

This isn’t speculation. It’s documented fact, repeatedly confirmed by S&P Global’s SPIVA reports, academic research, and decades of market data.

The Numbers Tell an Uncomfortable Story

S&P Global publishes semiannual SPIVA (S&P Indices Versus Active) scorecards tracking how actively managed funds perform against their benchmarks. The 2023 year-end report revealed that 60% of large-cap U. S. equity funds underperformed the S&P 500 over one year. Stretch that window to 20 years, and 93% of those same funds lagged behind.

Mid-cap and small-cap categories fare even worse. Over 20 years, 95% of mid-cap funds and 96% of small-cap funds failed to match their respective indexes.

These aren’t cherry-picked statistics. They represent the entire universe of actively managed mutual funds available to U. S - investors.

Why Stock Pickers Struggle

The underperformance of active management stems from several structural disadvantages that compound over time.

**Fee drag creates a persistent headwind. ** The average actively managed equity fund charges an expense ratio around 0. 68% annually, according to Morningstar data. Compare that to index funds averaging 0. 06% - that 0. 62% difference doesn’t sound like much until you calculate its impact over decades. On a $100,000 investment earning 7% annually, that fee differential costs approximately $178,000 over 30 years.

But fees only tell part of the story.

**Trading costs eat into returns. ** Active managers buy and sell frequently, generating transaction costs, bid-ask spreads, and market impact costs that don’t appear in expense ratios. Research by finance professors Roger Edelen, Richard Evans, and Gregory Kadlec estimated these hidden costs add another 1. 44% annually for the average active fund.

**Taxes compound the damage. ** Frequent trading generates short-term capital gains taxed at ordinary income rates-up to 37% federally. Index funds, with their buy-and-hold approach, defer most gains until the investor sells. A Vanguard study found tax-managed index funds outperformed comparable active funds by 1. 3% annually on an after-tax basis.

Add these factors together and active managers need to beat the market by 2-3% annually just to break even with index investors. Few manage that feat consistently.

The Arithmetic of Active Management

William Sharpe, Nobel laureate and creator of the Sharpe ratio, explained this phenomenon elegantly in his 1991 paper “The Arithmetic of Active Management.”

His logic is simple. All investors collectively own the entire market. Index investors own the market at low cost. Active investors, as a group, also own the market-but at high cost. Since active investors can only buy what other active investors sell, their aggregate return before costs must equal the market return.

After costs? They must underperform by exactly the amount of those costs.

This isn’t a theory requiring belief. It’s arithmetic.

Survivorship Bias Masks Even Worse Results

The 70% underperformance figure actually understates the problem due to survivorship bias.

Funds that perform poorly often merge with better-performing funds or close entirely. They disappear from historical databases. A 2020 study by Dimensional Fund Advisors found that of all U. S. equity funds available in 2005, only 51% still existed 15 years later. The worst performers disproportionately vanished.

When researchers tracked the original cohort of funds-including those that closed-the percentage underperforming their benchmarks jumped from 73% to 88%.

The Persistence Problem

Defenders of active management often point to star fund managers who beat the market for years. Peter Lynch’s Fidelity Magellan fund. Bill Miller’s 15-year streak at Legg Mason Value Trust.

But here’s the problem: identifying those managers before their winning streaks proves nearly impossible.

Mark Carhart’s influential 1997 study examined mutual fund persistence using 30 years of data. His conclusion? Past performance has virtually no predictive value for future returns beyond what can be explained by random chance and factor exposures. The few funds that outperformed consistently over short periods showed no persistence over longer horizons.

More recently, S&P’s “Persistence Scorecard” tracked top-quartile funds to see how many remained top-quartile over subsequent periods. After five years, only 2. 9% of large-cap funds maintained top-quartile performance. Random chance would predict 6 - 25%.

Star managers appear to be lucky rather than skilled. And luck, by definition, doesn’t persist.

Behavioral Factors Worsen Investor Outcomes

Even if investors could identify skilled managers, their own behavior often sabotages returns.

Morningstar’s annual “Mind the Gap” study measures the difference between funds’ reported returns and the actual returns investors experience. The gap exists because investors chase performance-buying after funds rise and selling after they fall.

In 2023, Morningstar found investors in U. S - equity funds earned 1. 1% less annually than the funds themselves returned over the previous decade. For sector funds, the gap widened to 2. 6% annually.

Index fund investors show smaller behavior gaps. The strategy’s simplicity-own everything, hold forever-provides less temptation to tinker. And there’s no manager to fire when short-term performance disappoints.

What About Factor Investing and Smart Beta?

Recent decades have seen the rise of “smart beta” or factor-based strategies promising index-like fees with above-market returns. These approaches tilt toward characteristics like value, momentum, or low volatility that academic research associates with higher expected returns.

The evidence here is more nuanced.

Certain factors have demonstrated persistent premiums across markets and time periods. Value stocks have outperformed growth stocks over the very long term. Small companies have edged out large companies. Momentum strategies have generated excess returns in nearly every asset class studied.

But factor premiums can disappear for decades. Value investing underperformed from 2007 through 2020-thirteen years of patience-testing drought. Many investors who bought value funds at the peak of the factor’s popularity capitulated before the 2021-2022 recovery.

Factor investing occupies a middle ground between pure indexing and traditional active management. The theoretical foundation is stronger than stock picking, but use challenges and cyclical underperformance test investor discipline.

The Simple Path Forward

For most investors, the evidence points toward a straightforward approach: own broad market index funds, minimize costs, maintain consistent asset allocation, and resist the urge to tinker.

John Bogle, Vanguard’s founder and index fund pioneer, summarized it this way: “Don’t look for the needle in the haystack. Just buy the haystack.

This doesn’t mean active management is worthless. Professional investors with significant tax advantages, institutional resources, and 20-year time horizons might extract value from skilled managers. But for retail investors building retirement portfolios? The math doesn’t support the attempt.

A three-fund portfolio-U - s. total market index, international developed markets index, and bond market index-captures global market returns at costs under 0. 10% annually - no manager selection. No style drift. No star managers to chase or abandon.

That simplicity is a feature, not a bug. Investment returns come from markets. Investment losses come from trying to be clever.