Poisson Processes and the Value of an Asset#
Introduction#
In the search and matching notebooks, we wrote down Bellman equations for workers and firms directly, motivating them through the asset pricing analogy. Here we derive these equations rigorously from first principles, grounding them in the theory of Poisson processes. This serves two purposes: it provides a precise mathematical foundation for the continuous-time Bellman equations used throughout the course, and it illustrates how Poisson processes arise naturally as the appropriate model for the timing of stochastic events in continuous time.
The notebook proceeds in three steps. We first review the Poisson distribution and its origins in the law of rare events. We then define the Poisson process and establish its key property: that the waiting times between events are exponentially distributed. Finally, we use this property to derive the Bellman equation for a filled job directly from the expected discounted value integral, without appealing to the heuristic asset pricing argument.
The Poisson Distribution#
Definition and Basic Properties#
Definition: Poisson Distribution
A discrete random variable \(X\) with possible values \(0, 1, 2, 3, \ldots\) is called Poisson with parameter \(\lambda > 0\) if its probability mass function is:
Proposition: Mean and Variance
The mean and variance of a Poisson random variable are both equal to \(\lambda\):
The coincidence of mean and variance is a distinctive feature of the Poisson distribution and has a direct interpretation: \(\lambda\) simultaneously controls the average number of events and the dispersion around that average. A large \(\lambda\) means many events on average and high variability; a small \(\lambda\) means few events and low variability.
The Law of Rare Events#
Poisson processes arise naturally from the law of rare events, which provides an intuitive justification for why the Poisson distribution appears so frequently in applications involving counts of random arrivals.
Consider a large number \(N\) of independent Bernoulli trials, where the probability of success on each trial is \(p\) — small and constant. The total number of successes in \(N\) trials, \(X_{N,p}\), follows the binomial distribution:
Now take the limiting case in which the number of trials grows without bound and the probability of success on each trial shrinks proportionally, so that the expected number of successes \(Np = \lambda\) remains fixed. Formally, let \(N \to \infty\) and \(p \to 0\) with \(Np \to \lambda > 0\). In this limit, the binomial distribution converges to the Poisson distribution with parameter \(\lambda\).
The intuition is direct: when there are many opportunities for an event to occur but each individual opportunity is unlikely to produce one, the total count of events follows the Poisson law. This is precisely the structure of job matching in continuous time: at any instant, there are many worker-firm pairs that could potentially match, but the probability of any specific pair matching in a given instant is vanishingly small. The Poisson distribution is therefore the natural model for the count of matches formed over any interval of time.
Numerical Illustration#
The following code illustrates the convergence of the binomial to the Poisson distribution as \(N \to \infty\) with \(Np = \lambda\) fixed, and plots the Poisson PMF for several values of \(\lambda\).
The left panel confirms the law of rare events numerically: as \(N\) increases with \(\lambda = Np\) held fixed at 3, the binomial PMF converges to the Poisson PMF (black dashed line). The convergence is rapid — already at \(N = 100\) the two distributions are nearly indistinguishable. The right panel shows how the shape of the Poisson distribution changes with \(\lambda\). For small \(\lambda\) the distribution is concentrated near zero and strongly right-skewed; as \(\lambda\) grows the distribution becomes more symmetric and bell-shaped, reflecting the central limit theorem applied to the sum of many Bernoulli trials.
The Poisson Process#
Definition#
A single Poisson random variable counts events over a fixed interval. A Poisson process extends this to a continuous-time stochastic process that counts events as they accumulate over time.
Definition: Poisson Process
A Poisson process is an integer-valued stochastic process \(\{X(t);\, t \geq 0\}\) satisfying:
Independent increments: for any \(0 = t_0 < t_1 < \cdots < t_n\), the increments \(X(t_1) - X(t_0),\, X(t_2) - X(t_1),\, \ldots,\, X(t_n) - X(t_{n-1})\) are independent random variables.
Stationary Poisson increments: for \(s \geq 0\) and \(t \geq 0\), the increment \(X(s+t) - X(s)\) has the Poisson distribution: $\(\Pr(X(s+t) - X(s) = k) = \frac{e^{-\lambda t}(\lambda t)^k}{k!}, \qquad k = 0, 1, 2, \ldots\)$
Zero initial value: \(X(0) = 0\).
The process \(X(t)\) counts the cumulative number of events — job destructions, productivity shocks, matches — that have occurred up to time \(t\). The parameter \(\lambda\) is the arrival rate. On average, \(\lambda\) events occur per unit time, and the number of events in any interval of length \(t\) has mean \(\lambda t\).
Sojourn Times and the Exponential Distribution#
The most important property of the Poisson process for our purposes concerns the sojourn times — the waiting times between consecutive events. If events arrive according to a Poisson process with rate \(\lambda\), how long does one typically wait for the next event?
Theorem: Exponential Sojourn Times
Let \(S_0, S_1, S_2, \ldots\) denote the sojourn times (waiting times between consecutive events) of a Poisson process with rate \(\lambda\). Then \(S_0, S_1, \ldots\) are independent random variables, each with the exponential density:
Proposition: Mean and Variance of Exponential
If \(S \sim \text{Exp}(\lambda)\), then:
The mean sojourn time \(1/\lambda\) is the reciprocal of the arrival rate — a natural and intuitive result. If events arrive at rate \(\lambda = 2\) per month, the average waiting time between events is \(1/2\) a month.
Connection to the Labor Market#
The sojourn time result connects directly to the search and matching model. Recall that the rate at which a vacant firm fills its job is \(q(\theta)\). In the language of Poisson processes, matches arrive at rate \(q(\theta)\). The firm experiences a Poisson process of potential workers, and the sojourn time until the next match is exponentially distributed with rate \(q(\theta)\). The average time the firm waits to fill its vacancy is therefore:
By the symmetric argument, the rate at which an unemployed worker finds a job is \(f(\theta) = \theta q(\theta)\), and the average unemployment duration is:
Similarly, filled jobs are destroyed at Poisson rate \(s\). Each filled job experiences an independent Poisson process of destruction shocks, and the sojourn time until destruction — the employment spell duration — is exponentially distributed with mean \(1/s\).
These are not assumptions imposed on the model for convenience. They follow necessarily from modeling the timing of matches and separations as Poisson processes, which is itself justified by the law of rare events: at any instant, there are many potential pairings of workers and firms, each individually unlikely to result in a match, so the total arrival of matches follows the Poisson law.
Numerical Illustration#
The left panel shows a simulated sample path of a Poisson process with rate \(\lambda = 2\): the process jumps by one at each event time (red dashed lines) and is constant between events. The middle panel confirms that the sojourn times between events follow the exponential distribution: the histogram of 10,000 simulated waiting times matches the theoretical \(\text{Exp}(\lambda)\) density closely, with the mean at \(1/\lambda = 0.5\). The right panel translates this into the labor market context: mean vacancy duration \(1/q(\theta)\) is increasing in tightness (harder for firms to fill vacancies in tight markets) while mean unemployment duration \(1/f(\theta)\) is decreasing in tightness (easier for workers to find jobs in tight markets).
Deriving the Bellman Equation for a Filled Job#
We now use the Poisson process framework to derive the Bellman equation for the value of a filled job rigorously, without the heuristic asset pricing argument used in the main notebooks.
A filled job can be viewed as an asset that:
generates a flow payoff \(x(t) - w(t)\) at each instant — the difference between output and the wage,
is destroyed at a Poisson arrival rate \(\lambda \equiv s\) — the job destruction process — at which point it transitions to the vacancy state with value \(J_v\).
Let \(T(t)\) denote the (random) time at which the job is destroyed, given that it is filled at time \(t\). By the sojourn time theorem, \(T(t) - t\) is exponentially distributed with rate \(\lambda\). The present discounted value of the filled job is therefore:
The first term is the discounted flow of profits accumulated until destruction; the second is the discounted value of the vacancy state entered at destruction.
Evaluating the Expected Value#
Since \(T(t) - t \sim \text{Exp}(\lambda)\) with density \(\lambda e^{-\lambda y}\) for \(y \geq 0\), we evaluate the expectation by integrating over all possible destruction times \(y = T(t) - t\):
We simplify the first term using integration by parts with:
so that:
Applying \(\int u\,dv = uv - \int v\,du\):
The boundary term vanishes at \(y = 0\) (the integral is zero) and at \(y \to \infty\) (the exponential \(e^{-\lambda y}\) dominates, provided the flow payoff is bounded). Substituting back:
Combining the two integrals:
Substituting \(s = t + y\):
From Integral to Differential Equation#
Expression (1) is an integral equation for \(J_\pi(t)\). To convert it to the familiar Bellman ODE, we differentiate with respect to \(t\).
Applying the Leibniz rule — differentiating under the integral sign and accounting for the moving lower limit:
Recognizing the integral as \(J_\pi(t)\) from (1):
Rearranging:
This is the Bellman equation for a filled job. Its terms now have precise meanings grounded in the Poisson process derivation:
\(x(t) - w(t)\): the instantaneous flow profit from production.
\(\lambda(J_v(t) - J_\pi(t))\): the expected capital loss from job destruction, which arrives at Poisson rate \(\lambda\) and reduces the firm’s value from \(J_\pi\) to \(J_v\).
\(\dot{J}_\pi(t)\): the capital gain from any anticipated change in the value of the filled job over time.
\(rJ_\pi(t)\): the required flow return — the opportunity cost of holding an asset worth \(J_\pi(t)\) rather than investing at rate \(r\).
In steady state, \(\dot{J}_\pi = 0\), and the equation reduces to:
which is exactly the Bellman equation written down by inspection in the main notebook. The derivation here confirms that this equation is not merely a convenient approximation but an exact consequence of modeling job destruction as a Poisson process.
Numerical Illustration#
The following code verifies the Bellman equation numerically by simulating many job spell trajectories, computing the expected discounted value directly from the definition, and comparing it to the closed-form solution of the Bellman ODE.
Analytical J_pi = 1.304348
Simulated J_pi = 1.299873
Difference = 0.004475
The left panel shows the distribution of discounted job spell values across 100,000 simulated spells. Each spell ends at a randomly drawn destruction time \(T \sim \text{Exp}(\lambda)\); the discounted value of each spell is \(\int_0^T (x-w)e^{-rt}dt + J_v e^{-rT}\), which can be computed in closed form as \((x-w)/r \cdot (1 - e^{-rT}) + J_v e^{-rT}\). The average across spells converges to the analytical solution of the Bellman equation (red vertical line) with negligible simulation error, confirming the derivation.
The middle and right panels illustrate how \(J_\pi\) varies with the wage and the destruction rate. \(J_\pi\) is linearly decreasing in \(w\): a higher wage reduces the flow profit \(x - w\) proportionally, and since \(w\) enters the numerator of \(J_\pi = (x - w + \lambda J_v)/(r + \lambda)\) additively, the relationship is exactly linear.
The relationship with \(\lambda\) is different. With \(J_v = 0\) under free entry, \(J_\pi = (x-w)/(r+\lambda)\): the value of the filled job is the flow profit discounted at the effective rate \(r + \lambda\), where \(\lambda\) enters the denominator. The relationship is therefore decreasing and convex in \(\lambda\): as the destruction rate rises, \(J_\pi\) falls at a diminishing rate, asymptoting toward zero as \(\lambda \to \infty\). The convexity has an intuitive interpretation — when jobs are already very fragile (high \(\lambda\)), a further increase in the destruction rate has a smaller proportional effect on \(J_\pi\) than when jobs are relatively secure, because the expected spell duration \(1/(r+\lambda)\) is already short and additional fragility shortens it by proportionally less.
Conclusion#
This notebook has derived the Bellman equation for a filled job from first principles, proceeding in three steps. The Poisson distribution arises naturally from the law of rare events as the appropriate model for counting random arrivals in continuous time. The Poisson process extends this to a continuous-time stochastic counting process whose sojourn times are exponentially distributed — a result that immediately pins down the mean durations of vacancies, unemployment spells, and employment spells in the search and matching model. Finally, by writing the value of a filled job as an expected discounted integral over a random spell length drawn from the exponential distribution, and differentiating to obtain a differential equation, we recover the Bellman ODE used throughout the course.
The derivation makes explicit what the asset pricing heuristic leaves implicit: the term \(\lambda(J_v - J_\pi)\) in the Bellman equation is not merely an “expected capital loss” but the precise consequence of job destruction arriving as a Poisson process with rate \(\lambda\). The same logic extends to all the other Bellman equations in the model — for vacant jobs, employed workers, and unemployed workers — since each involves a state variable that transitions at a Poisson rate. The exponential distribution of sojourn times is the mathematical thread connecting the stochastic timing of labor market events to the continuous-time value functions that characterize equilibrium.