Probability Density Function and Distribution Function's Mathematical Characteristics

Introduction

Probability density functions (PDFs) and cumulative distribution functions (CDFs) are fundamental constructs in probability theory and statistics. The PDF describes the likelihood of a continuous random variable taking on a particular value, while the CDF provides the probability that the random variable is less than or equal to a given value. These functions are inextricably linked, with the CDF being the integral of the PDF over a specific interval. This article explores the mathematical characteristics of PDFs and CDFs, emphasizing their definitions, properties, and interrelationships.

Probability Density Function (PDF)

A PDF is a non-negative function $ f(x) $ defined over a real interval $ (-\infty, \infty) $, such that the total integral over the entire domain equals 1:
$$ \int_{-\infty}^{\infty} f(x) , dx = 1. $$
The PDF quantifies the relative likelihood of a continuous random variable $ X $ taking on a specific value $ x $. For a continuous variable, the probability of $ X $ falling within a particular interval $ [a, b] $ is given by the integral of the PDF over that interval:
$$ P(a \leq X \leq b) = \int_{a}^{b} f(x) , dx. $$
The PDF must satisfy the following properties:

  1. Non-negativity: $ f(x) \geq 0 $ for all $ x $.
  2. Normalization: The integral of the PDF over the entire real line equals 1.
  3. Measurability: The PDF must be measurable and integrable.

The behavior of the PDF is critical to understanding the distribution of the random variable. For example, in the case of the uniform distribution on $ [a, b] $, the PDF is constant:
$$ f(x) = \frac{1}{b - a}, \quad \text{for } a \leq x \leq b. $$
This uniform distribution exhibits a flat PDF, indicating equal probability across the interval.

Cumulative Distribution Function (CDF)

The CDF, denoted $ F(x) $, is defined as the probability that a random variable $ X $ is less than or equal to $ x $:
$$ F(x) = P(X \leq x). $$
The CDF is a right-continuous function that increases monotonically with $ x $, and it is always bounded between 0 and 1. Key properties of the CDF include:

  1. Right-continuity: $ F(x) $ is continuous from the right.
  2. Monotonicity: $ F(x) $ is non-decreasing.
  3. Limit at Infinity: $ \lim_{x \to \infty} F(x) = 1 $, and $ \lim_{x \to -\infty} F(x) = 0 $.

The relationship between the PDF and CDF is fundamental. The CDF is derived by integrating the PDF over all values less than or equal to $ x $:
$$ F(x) = \int_{-\infty}^{x} f(t) , dt. $$
Conversely, the PDF is the derivative of the CDF with respect to $ x $, provided the CDF is differentiable:
$$ f(x) = \frac{d}{dx} F(x). $$
This relationship underscores the inverse relationship between the PDF and CDF, highlighting their complementary roles in describing the distribution of a random variable.

Mathematical Properties of PDF and CDF

The PDF and CDF share several key mathematical properties that govern their behavior. For instance, the PDF must satisfy the condition that it is non-negative and integrates to 1, while the CDF must be continuous and right-continuous. Additionally, the PDF’s shape is determined by the distribution of the random variable, and the CDF’s monotonicity reflects the underlying distribution’s order statistics.

Another critical property is the linearity of the CDF. The CDF is a function that can be expressed in terms of the PDF, and its behavior is entirely determined by the PDF’s characteristics. For example, in the case of the exponential distribution, the PDF is $ f(x) = \lambda e^{-\lambda x} $ for $ x \geq 0 $, and the CDF is $ F(x) = 1 - e^{-\lambda x} $. This exponential distribution exhibits a decreasing PDF and a CDF that increases exponentially, reflecting the memoryless property of the distribution.

The relationship between the PDF and CDF is also pivotal in statistical inference. The PDF provides the density of probability at each point, while the CDF offers the cumulative probability up to a given value. Together, they allow for the computation of probabilities, expectations, and moments of random variables. For instance, the expected value $ \mathbb{E}[X] $ can be calculated as the integral of $ x f(x) , dx $ over the entire domain, and the variance $ \text{Var}(X) $ can be derived from the second moment $ \mathbb{E}[X^2] $, which involves integrating $ x^2 f(x) , dx $.

Applications in Probability and Statistics

The mathematical characteristics of PDFs and CDFs find extensive applications in fields such as actuarial science, econometrics, and data analysis. For example, in the context of the normal distribution, the PDF is bell-shaped and symmetric, while the CDF is