Relationship between Probability Density Function and Cumulative Distribution Function

Introduction

The Probability Density Function (PDF) and the Cumulative Distribution Function (CDF) are foundational concepts in probability theory and statistics. The PDF describes the likelihood of a continuous random variable taking on a particular value, while the CDF provides the probability that the variable is less than or equal to a given value. These two functions are intrinsically linked, with the CDF being the integral of the PDF over a specific interval. This relationship is critical for understanding the behavior of continuous distributions and is essential in both theoretical and applied contexts.

Mathematical Foundations

The CDF, denoted as $ F(x) $, is defined as the probability that a random variable $ X $ is less than or equal to $ x $:
$$ F(x) = \mathbb{P}(X \leq x) $$
The PDF, $ f(x) $, is the derivative of the CDF with respect to $ x $:
$$ f(x) = \frac{d}{dx} F(x) $$
This relationship underscores the fundamental connection between the two functions. For a continuous random variable, the PDF must satisfy two key properties:

  1. Non-negativity: $ f(x) \geq 0 $ for all $ x $.
  2. Integrability: The integral of the PDF over the entire real line equals 1:
    $$ \int_{-\infty}^{\infty} f(x) , dx = 1 $$
    The CDF is a monotonically increasing function, continuous, and bounded between 0 and 1. Its continuity ensures that the PDF is differentiable, allowing for the precise description of probabilistic outcomes.

Core Content

Derivation of the CDF from the PDF

The CDF is derived from the PDF through integration. For a given value $ x $, the cumulative probability up to $ x $ is obtained by integrating the PDF from negative infinity to $ x $:
$$ F(x) = \int_{-\infty}^{x} f(t) , dt $$
This integral represents the area under the PDF curve from $ -\infty $ to $ x $, which directly corresponds to the probability of the random variable falling within that interval. The process of integration ensures that the CDF is a function that accumulates probability as $ x $ increases.

Properties of the CDF and PDF

The CDF and PDF share several key properties that govern their behavior:

  • Monotonicity: The CDF is strictly increasing because the PDF is non-negative.
  • Continuity: The CDF is continuous, ensuring that there are no jumps or breaks in the probability accumulation.
  • Limits: As $ x \to -\infty $, $ F(x) \to 0 $, and as $ x \to \infty $, $ F(x) \to 1 $.
  • Differentiability: The PDF is differentiable everywhere, and its derivative is the CDF. This relationship is critical in calculus and probability theory, enabling the use of differentiation to analyze cumulative probabilities.

Examples and Applications

The relationship between the PDF and CDF is particularly evident in well-known distributions such as the normal distribution. For a standard normal distribution with PDF $ f(x) = \frac{1}{\sqrt{2\pi}} e^{-x^2/2} $, the C