Chapter 11Mechanism Design and Market Design

Introduction

Chapter 10 asked: given preferences and endowments, do competitive markets produce efficient outcomes? The answer — yes, under the welfare theorem conditions — takes the market mechanism as given. This chapter inverts the question: given a desired outcome, can we design a mechanism to achieve it?

Mechanism design is often called "reverse game theory." Instead of predicting the outcome of a game, we design the game to produce a desired outcome. Market design applies these ideas to real institutions — auctions, matching markets, spectrum allocation, kidney exchange.

By the end of this chapter, you will be able to:
  1. State the revelation principle and explain why it simplifies mechanism design
  2. Define incentive compatibility and apply it to mechanism design problems
  3. Derive the optimal auction (Myerson) and revenue equivalence
  4. State the Gibbard-Satterthwaite impossibility result
  5. Apply the Gale-Shapley algorithm to matching markets
  6. Evaluate the design of real market institutions

Prerequisites: Chapters 7 (game theory basics, Nash equilibrium) and 10 (welfare theorems, general equilibrium).

Named literature: Myerson (1981); Vickrey (1961); Clarke (1971); Groves (1973); Gale & Shapley (1962); Roth (2002); Milgrom (2004).

11.1 Social Choice and the Revelation Principle

Social Choice Functions

Social choice function (SCF). A mapping from agents' types (private information — valuations, preferences) to outcomes: $$f: \Theta_1 \times \cdots \times \Theta_n \to \mathcal{A}$$ where $\Theta_i$ is agent $i$'s type space and $\mathcal{A}$ is the set of possible allocations.

The challenge: agents' types are private. How do we get them to reveal their types truthfully?

Mechanisms

Mechanism. A pair $(\mathcal{M}, g)$ consisting of a message (strategy) space $\mathcal{M}_i$ for each agent and an outcome function $g: \mathcal{M}_1 \times \cdots \times \mathcal{M}_n \to \mathcal{A}$. A mechanism implements the SCF $f$ if, in equilibrium, the outcome of the mechanism equals $f(\theta)$ for all type profiles $\theta$.

Figure 11.1. Mechanism design timeline.

The mechanism designer chooses the rules (message space and outcome function) to achieve a desired social choice function.

The Revelation Principle

The Revelation Principle. Any SCF implementable by any mechanism in any equilibrium concept can also be implemented by a direct mechanism in which agents report their types truthfully.
Direct mechanism. A mechanism in which each agent's message space equals their type space ($\mathcal{M}_i = \Theta_i$). Agents are simply asked to report their private information directly. The revelation principle guarantees that restricting attention to direct mechanisms is without loss of generality.
Incentive compatibility (IC). A mechanism is incentive compatible if truthful reporting is an equilibrium strategy for every agent — no agent can gain by misrepresenting their type. IC comes in two strengths: dominant-strategy (DSIC) and Bayesian (BIC).
Dominant strategy incentive compatibility (DSIC). Truthful reporting is optimal for each agent regardless of what other agents report. DSIC mechanisms are robust to beliefs about others' behavior: $U_i(\theta_i, \theta_i) \geq U_i(\hat{\theta}_i, \theta_i)$ for all $\hat{\theta}_i$ and all $\theta_{-i}$.
Bayesian incentive compatibility (BIC). Truthful reporting is optimal in expectation over others' types (assuming others also report truthfully). Weaker than DSIC but allows a richer set of implementable outcomes. Requires agents to have correct beliefs about the type distribution.

A direct mechanism asks each agent to simply report their type (their private information). It is incentive compatible (IC) if truthful reporting is an equilibrium strategy — no agent benefits from lying.

This is the most powerful simplification in mechanism design — arguably the most powerful simplification in all of economic theory. In principle, the space of possible mechanisms is infinitely large. An auction could have any number of rounds, any bidding rules, any payment formula. A matching algorithm could work in any conceivable way. Searching over all possible mechanisms for the best one seems hopeless.

The revelation principle says: you don't have to search. Whatever outcome any mechanism can achieve, a direct mechanism (just ask everyone to report truthfully) can achieve the same outcome. So the mechanism design problem reduces to: find the best allocation rule and payment rule as functions of reported types, subject to the constraint that truth-telling is optimal. This transforms an impossibly broad search into a well-defined optimization problem.

Dominant-strategy incentive compatible (DSIC): $$U_i(\theta_i, \theta_i) \geq U_i(\hat{\theta}_i, \theta_i) \quad \forall \hat{\theta}_i, \forall \theta_{-i}$$ (Eq. 11.1)
Bayesian incentive compatible (BIC): $$E_{\theta_{-i}}[U_i(\theta_i, \theta_i)] \geq E_{\theta_{-i}}[U_i(\hat{\theta}_i, \theta_i)] \quad \forall \hat{\theta}_i$$ (Eq. 11.2)

DSIC is stronger but harder to achieve. BIC is weaker but allows more mechanisms.

11.2 The Gibbard-Satterthwaite Theorem

Gibbard-Satterthwaite Theorem. If there are at least 3 alternatives and the SCF is onto (every alternative is achievable), then the only DSIC SCF is a dictatorship — one agent's preference determines the outcome regardless of others.

This is the mechanism design analog of Arrow's impossibility theorem. It says that in general social choice settings, no non-dictatorial mechanism can elicit truthful preferences in dominant strategies.

The escape: restrict the domain. With quasi-linear preferences ($U_i = v_i(a) + t_i$, where $t_i$ is a monetary transfer), the Gibbard-Satterthwaite barrier falls. The VCG mechanism achieves efficiency and DSIC with transfers.

11.3 The VCG Mechanism

VCG mechanism. The Vickrey-Clarke-Groves mechanism allocates efficiently ($\max \sum_i v_i$) and charges each agent a payment equal to the externality they impose on others. Truth-telling is a dominant strategy because each agent's payment depends only on others' reports.
Vickrey auction (second-price sealed-bid). The simplest VCG mechanism for a single object: the highest bidder wins and pays the second-highest bid. Truthful bidding is dominant because the payment is independent of the winner's bid. Introduced by Vickrey (1961).
Clarke pivot rule. The VCG payment formula: agent $i$ pays the difference between the social welfare that others would achieve without $i$ and the welfare others actually achieve with $i$ present. Each agent is "pivotal" to the extent they change the outcome for others.

The Vickrey-Clarke-Groves (VCG) mechanism achieves efficient allocation with truth-telling as a dominant strategy, using monetary transfers.

Efficient allocation: $a^*(\theta) = \arg\max_a \sum_i v_i(a, \theta_i)$ — maximize total value.

VCG payment for agent $i$: $$t_i(\theta) = \sum_{j \neq i} v_j(a^*(\theta_{-i}), \theta_j) - \sum_{j \neq i} v_j(a^*(\theta), \theta_j)$$ (Eq. 11.3)

Agent $i$ pays the externality she imposes on others — the difference between others' welfare with and without $i$.

Why is truth-telling dominant? Under truthful reporting, agent $i$'s payoff is:

$$v_i(a^*(\theta)) + t_i = v_i(a^*(\theta)) + \sum_{j \neq i} v_j(a^*(\theta_{-i})) - \sum_{j \neq i} v_j(a^*(\theta))$$

This simplifies to $\sum_j v_j(a^*(\theta)) - \sum_{j \neq i} v_j(a^*(\theta_{-i}))$. The second term doesn't depend on $i$'s report. So $i$ maximizes her payoff by choosing her report to maximize $\sum_j v_j(a^*(\theta))$ — which happens when she reports truthfully, since $a^*$ already maximizes total value.

Interactive: VCG Payment Calculator

Enter agent values for a single indivisible object. The calculator computes VCG payments (equivalent to a second-price auction for a single item).

Click "Compute" to see results.

Figure 11.2. Agent values and VCG payments. Each agent pays the externality they impose on others. The winner pays the second-highest value (in a single-item auction, VCG reduces to the Vickrey auction).

Example 11.1 — VCG for a Public Good

Three citizens value a bridge at $v_1 = 30$, $v_2 = 25$, $v_3 = 15$. The cost is $C = 60$.

Build if $\sum v_i > C$: \$10 > 60$ → yes.

Clarke tax payments:

Total collected: \$10 + 15 + 5 = 40 < 60$. There's a budget deficit of 20 — VCG does not generally achieve budget balance. Each agent pays their "pivotal" contribution.

11.4 Optimal Auctions and Revenue Equivalence

Auction Formats

FormatRulesWinner pays
English (ascending)Bidders raise bids; last bidder winsSecond-highest value (approx.)
Dutch (descending)Price drops until someone claimsTheir bid
First-price sealed-bidHighest bid winsTheir bid
Second-price sealed-bid (Vickrey)Highest bid winsSecond-highest bid

The Vickrey auction (second-price sealed-bid) is DSIC: each bidder's dominant strategy is to bid their true value $v_i$. Bidding above $v_i$ risks winning at a price above value; bidding below risks losing when the second-highest bid is below $v_i$.

Revenue Equivalence

Revenue Equivalence Theorem (Myerson, 1981). If bidders are risk-neutral with independent private values drawn from the same distribution, any auction mechanism that: (a) allocates the object to the highest-value bidder, and (b) gives zero expected payoff to the bidder with the lowest possible value — yields the same expected revenue to the seller.

This is a stunning result. It says that the seemingly vast differences between auction formats — open vs sealed bid, ascending vs descending, first-price vs second-price — are irrelevant for expected revenue under these conditions.

When revenue equivalence breaks down:

Interactive: Auction Simulator

Set the number of bidders and their value distribution. Run single auctions to see individual outcomes, or run 100 rounds to observe revenue equivalence (average revenues converge across formats). Adjust the risk aversion slider to break equivalence.

Risk-neutral (0) Moderate (0.4) High (0.8)
Click a button to run the auction simulator.

Figure 11.3. Auction outcomes. In single runs, revenues differ across formats due to randomness. Over 100 runs, average revenues converge — demonstrating revenue equivalence. Increase risk aversion ($\rho > 0$) to break equivalence: first-price revenue rises above second-price.

Myerson's Optimal Auction

Virtual value. A bidder's virtual value $\psi(\theta_i) = \theta_i - (1 - F(\theta_i))/f(\theta_i)$ adjusts the true value downward to account for the informational rent the seller must leave to incentivize truthful bidding. The optimal auction maximizes expected virtual surplus rather than expected true surplus.
Optimal reserve price. The minimum bid below which the seller refuses to sell, even if the object has zero value to the seller. Set where the virtual value equals zero: $\psi(r^*) = 0$. The optimal reserve trades off the probability of sale against the revenue extracted from high-value bidders.

When the seller wants to maximize revenue (not efficiency), Myerson showed the optimal mechanism uses the virtual value:

$$\psi(\theta_i) = \theta_i - \frac{1 - F(\theta_i)}{f(\theta_i)}$$ (Eq. 11.4)

where $F$ is the CDF and $f$ is the PDF of the bidder's value distribution.

$$\text{Allocate to highest virtual value if } \psi(\theta_i) > 0$$ (Eq. 11.5)

The optimal auction allocates to the bidder with the highest virtual value, provided it is positive. If all virtual values are negative, the seller retains the object. This implies a reserve price — the seller sets a minimum bid equal to $\psi^{-1}(0)$.

$$r^*: \quad \psi(r^*) = r^* - \frac{1 - F(r^*)}{f(r^*)} = 0$$ (Eq. 11.6)
$$\text{All mechanisms with the same allocation rule yield the same expected revenue}$$ (Eq. 11.7)
Example 11.2 — Optimal Reserve Price

Values uniformly distributed on $[0, 1]$: $F(\theta) = \theta$, $f(\theta) = 1$.

$\psi(\theta) = \theta - (1-\theta)/1 = 2\theta - 1$

$\psi(\theta) = 0 \implies \theta = 1/2$. Optimal reserve price = \$1/2$.

A second-price auction with reserve \$1/2$ is optimal: the item is sold only if at least one bidder values it above \$1/2$.

Interactive: Myerson Optimal Auction

For values drawn from Uniform$[0, V_{\max}]$, the virtual value is $\psi(\theta) = 2\theta - V_{\max}$. Drag the reserve price slider. The revenue curve shows expected revenue as a function of the reserve. The optimal reserve (maximizing expected revenue) is highlighted.

No reserve (0) Optimal ($r^*$) Maximum (1)
Loading...

Figure 11.4a. Virtual value function $\psi(\theta) = 2\theta - 1$ (for $U[0,1]$). The reserve price is set where $\psi(r) = 0$. Bidders with $\theta < r$ are excluded (shaded red).

Figure 11.4b. Expected revenue as a function of reserve price. The green dot marks the optimal reserve that maximizes expected revenue. Your chosen reserve is shown as a blue dot.

Example 11.4 — Incentive Compatibility Check

A government allocates a license to one of two firms. Firm $i$ has private value $\theta_i \in \{L, H\} = \{10, 50\}$, each equally likely.

Proposed mechanism: Allocate to the firm reporting higher value; in case of a tie, allocate to firm 1. Payment: the winner pays 30.

Check IC for a high-value firm ($\theta = 50$):

Truthful is better. IC holds for type $H$.

Check IC for a low-value firm ($\theta = 10$):

Truthful is better. IC holds for type $L$. The mechanism is incentive compatible.

Example 11.5 — Revenue Equivalence Verification

Two bidders with values drawn independently from $U[0, 100]$.

Second-price auction: Expected revenue = $E[\text{2nd highest value}] = 100/3 \approx 33.33$.

First-price auction: Optimal bid with 2 bidders: $b(\theta) = \theta/2$. Expected revenue = $E[\max(b_1, b_2)] = E[\max(\theta_1/2, \theta_2/2)] = E[\max(\theta_1, \theta_2)]/2 = (200/3)/2 = 100/3 \approx 33.33$.

Both formats yield expected revenue of \$100/3$, confirming revenue equivalence. The first-price auction generates less variable revenue (each winner pays exactly half their value) while the second-price auction has higher variance (the payment depends on the second-highest value, which can vary widely).

Myerson-Satterthwaite Impossibility

Myerson-Satterthwaite Theorem (1983). In bilateral trade with private information — one buyer and one seller, each knowing only their own valuation — there is no mechanism that simultaneously achieves all four of:
  1. Individual rationality (IR): Both parties voluntarily participate
  2. Incentive compatibility (IC): Both parties report truthfully
  3. Budget balance (BB): No outside subsidies needed
  4. Efficiency: Trade occurs if and only if $v_B > c_S$

Intuition: The seller wants to overstate her cost (to extract a higher price). The buyer wants to understate his value (to pay less). Incentive compatibility requires leaving "information rents" to both parties. These rents are costly, and with budget balance, there isn't enough surplus to pay both rents and ensure all efficient trades occur.

Real-world bargaining under private information — salary negotiations, used car purchases, M&A deals — always involves some inefficiency. Institutions like posted prices, reputation systems, and standardized contracts mitigate the problem but cannot fully eliminate it.

11.5 Matching Markets

Market design. The branch of economics that designs real-world institutions and allocation mechanisms, applying mechanism design and matching theory to practical problems. Key applications include medical residency matching (NRMP), school choice, kidney exchange, and spectrum auctions. Roth described this as the "economist as engineer."

Some goods cannot be allocated by prices — we don't (or shouldn't) sell school admissions, organ transplants, or residency positions. Matching markets use algorithms instead.

Gale-Shapley Deferred Acceptance Algorithm

Stable matching. A matching in which no unmatched pair both prefer each other to their current partners. Stability ensures no "elopements" — no pair has the incentive and ability to deviate from the assigned matching.
Deferred acceptance algorithm. The Gale-Shapley algorithm for finding a stable matching: proposers make offers in order of preference, responders tentatively hold their best offer and reject the rest, rejected proposers move to their next choice. The algorithm terminates in at most $n^2$ rounds.
Proposer-optimal stable matching. The stable matching produced when one side proposes in the deferred acceptance algorithm. It is the best stable matching for proposers and the worst for responders. This asymmetry means the choice of who proposes has significant distributional consequences.
Strategy-proofness. A mechanism is strategy-proof if truthful reporting is a dominant strategy for every participant. The deferred acceptance algorithm is strategy-proof for the proposing side but not for the responding side.
Setup: Two sides of a market (e.g., students and schools). Each agent ranks the other side.

Algorithm (proposer-optimal version):
  1. Each proposer proposes to their top-ranked partner
  2. Each responder tentatively accepts the best proposal and rejects the rest
  3. Rejected proposers propose to their next choice
  4. Repeat until no rejections occur
$$\text{GS terminates in } \leq n^2 \text{ rounds and produces the proposer-optimal stable matching}$$ (Eq. 11.8)

Theorem (Gale & Shapley, 1962). The algorithm terminates in at most $n^2$ rounds and produces a stable matching — no unmatched pair both prefer each other to their current match.

Properties:

Interactive: Gale-Shapley Step-by-Step

Enter preference lists for students and schools. The algorithm animates each round: proposals, tentative holds, and rejections. Enter preferences as comma-separated names (e.g., "W,X,Y,Z").

Example 11.3 — Gale-Shapley with Four Students

Four students (A, B, C, D) and four schools (W, X, Y, Z). Students propose.

StudentPreferencesSchoolPreferences
AW > X > Y > ZWB > A > D > C
BX > W > Y > ZXA > B > C > D
CW > Y > X > ZYC > D > A > B
DY > W > X > ZZD > C > B > A

Final matching: A-W, B-X, C-Y, D-Z. This is stable: no pair wants to deviate. Use the interactive above to verify step by step.

Interactive: Proposer Advantage

Run Gale-Shapley with students proposing vs. schools proposing. Compare the two stable matchings. The proposing side always gets their best stable matching; the responding side gets their worst.

Real-World Market Design

Alvin Roth (Nobel 2012, shared with Lloyd Shapley) describes this as "the economist as engineer" — using economic theory not just to explain the world but to design real institutions that improve people's lives.

The broader lesson: Markets are not natural objects that arise spontaneously. They are designed institutions — rules, algorithms, and enforcement mechanisms that determine who gets what, at what price, and through what process. The design matters enormously.

Thread Example: Maya's Enterprise

The city decides to auction the exclusive right to operate a lemonade stand at the prime downtown corner. Three potential vendors: Maya ($v_M = 50$/day), Nate ($v_N = 35$/day), Olivia ($v_O = 20$/day). Values drawn from $U[0, 60]$.

Second-price auction (Vickrey): Dominant strategy is to bid truthfully. Maya bids 50, Nate bids 35, Olivia bids 20. Maya wins, pays 35.

Optimal auction (Myerson): Virtual values with $F(\theta) = \theta/60$, $f(\theta) = 1/60$:

$\psi(\theta) = \theta - (60 - \theta) = 2\theta - 60$

Reserve price: $\psi(\theta) = 0 \implies \theta = 30$.

Maya's virtual value: \$1(50) - 60 = 40$. Nate's: \$10$. Olivia's: $-20$ (excluded by optimal auction).

In a second-price auction with reserve 30: Maya wins, pays $\max(35, 30) = 35$.

The Historical Lens

Roth as "Economist as Engineer." Alvin Roth (Nobel Prize 2012) transformed mechanism design from pure theory into a practical discipline that redesigns real markets. His work demonstrates that markets are designed institutions, not natural phenomena.

The National Residency Matching Program (NRMP): Roth diagnosed why the original medical residency match was failing (instability, strategic manipulation) and redesigned it using deferred acceptance. The new system matches ~40,000 medical residents annually.

Kidney exchange: Roth, Sonmez, and Unver designed exchange protocols allowing incompatible donor-patient pairs to swap donors through chains of transplants, saving thousands of lives. This was pure market design — creating a market where none existed, without using prices.

School choice: Roth and colleagues replaced Boston's manipulable school assignment mechanism with a strategy-proof system. Under the old system, parents who reported their true preferences were punished; under the new system, honesty is always optimal.

Spectrum auctions: Milgrom and Wilson (Nobel Prize 2020) designed combinatorial auctions for the FCC, raising billions of dollars while efficiently allocating spectrum licenses. The 2017 incentive auction alone raised \$19.8 billion.

The common thread: economic theory provides the blueprint, but implementation requires understanding the specific institutional context — the "details" that pure theory abstracts away.

Summary

Key Equations

LabelEquationDescription
Eq. 11.1$U_i(\theta_i, \theta_i) \geq U_i(\hat{\theta}_i, \theta_i)$ for all $\hat{\theta}_i, \theta_{-i}$DSIC
Eq. 11.2$E[U_i(\theta_i, \theta_i)] \geq E[U_i(\hat{\theta}_i, \theta_i)]$BIC
Eq. 11.3$t_i = \sum_{j \neq i} v_j(a^*(\theta_{-i})) - \sum_{j \neq i} v_j(a^*(\theta))$VCG payment
Eq. 11.4$\psi(\theta) = \theta - (1-F(\theta))/f(\theta)$Myerson virtual value

Exercises

Practice

  1. A single indivisible object is auctioned to two bidders with values $v_1 = 10$, $v_2 = 7$. Compute the winner and payment under: (a) first-price sealed-bid (assume each bidder shades bid by half), (b) second-price sealed-bid, (c) English auction.
  2. Three voters rank three alternatives {A, B, C}. Construct preference profiles where: (a) majority rule produces a cycle (Condorcet paradox), (b) a dictatorial rule avoids the cycle.
  3. Run Gale-Shapley (students propose) on: Students {1,2,3}, Schools {X,Y,Z}. Preferences: 1: X>Y>Z, 2: Y>X>Z, 3: X>Y>Z. Schools: X: 1>2>3, Y: 2>3>1, Z: 3>1>2.

Apply

  1. A government wants to allocate carbon emission permits efficiently. Compare: (a) a VCG mechanism (firms report abatement costs), (b) a standard auction, (c) a cap-and-trade market. Under what conditions do they produce the same allocation?
  2. Explain why eBay uses a second-price auction (proxy bidding) rather than a first-price auction. How does the Vickrey result relate to eBay's design?
  3. The Boston school choice mechanism (pre-reform) penalized parents who listed popular schools if they weren't high-priority. Explain why this is not strategy-proof and how deferred acceptance fixes it.
  4. The Myerson-Satterthwaite theorem says efficient bilateral trade is impossible with private information. Yet eBay, Craigslist, and used car markets facilitate millions of trades daily. How do these institutions mitigate the impossibility result?

Challenge

  1. Derive the optimal reserve price for a second-price auction with $n$ bidders whose values are drawn i.i.d. from $U[0, 1]$. Show that the reserve is \$1/2$ regardless of $n$. What is the expected revenue as a function of $n$?
  2. Prove that the Gale-Shapley algorithm produces a stable matching. (Hint: suppose there exists a blocking pair. Show this leads to a contradiction with the algorithm's rejection logic.)
  3. A seller has two identical items and three bidders with values $v_1 > v_2 > v_3$. Design a VCG mechanism for this multi-unit auction. What does each winner pay?
  4. Consider a matching market where one side has strict preferences but the other side is indifferent among some matches (ties). Does Gale-Shapley still produce a stable matching? If ties are broken randomly, is the result unique?