The extrema of multivariable functions and conditional extrema

Introduction

In multivariable calculus, the concept of extrema—both global and local—becomes significantly more complex than in single-variable calculus. While single-variable functions can be analyzed using the first and second derivative tests, multivariable functions require additional tools to identify critical points and determine whether these points correspond to maxima, minima, or saddle points. The study of extrema in multiple variables introduces new challenges, such as the interplay between partial derivatives and the geometric structure of the domain. This article explores the foundational principles of finding extrema for functions of multiple variables and delves into the concept of conditional extrema, where constraints play a pivotal role.

Finding Extrema of Multivariable Functions

A function $ f: \mathbb{R}^n \to \mathbb{R} $ has extrema at points $ \mathbf{x} \in \mathbb{R}^n $ if the function achieves a maximum or minimum value at that point. These extrema are classified as global if the function attains the maximum or minimum value over the entire domain, and local if the function achieves such a value within a neighborhood of $ \mathbf{x} $.

To locate extrema, the first step is to identify critical points, which are points where the gradient of $ f $ is zero or undefined. The gradient $ \nabla f $ is a vector of partial derivatives:
$$ \nabla f = \left( \frac{\partial f}{\partial x_1}, \frac{\partial f}{\partial x_2}, \dots, \frac{\partial f}{\partial x_n} \right) $$
A critical point occurs when $ \nabla f(\mathbf{x}) = \mathbf{0} $. For a function $ f $ to have a local extremum at a critical point, the following conditions must hold:

  1. The function must attain a maximum or minimum at that point.
  2. The second partial derivatives must be continuous in a neighborhood of the point.

The second derivative test for multivariable functions involves the Hessian matrix, which is the square matrix of second partial derivatives:
$$ H(f)(\mathbf{x}) = \begin{bmatrix} \frac{\partial^2 f}{\partial x_1^2} & \frac{\partial^2 f}{\partial x_1 \partial x_2} & \cdots & \frac{\partial^2 f}{\partial x_1 \partial x_n} \ \frac{\partial^2 f}{\partial x_2 \partial x_1} & \frac{\partial^2 f}{\partial x_2^2} & \cdots & \frac{\partial^2 f}{\partial x_2 \partial x_n} \ \vdots & \vdots & \ddots & \vdots \ \frac{\partial^2 f}{\partial x_n \partial x_1} & \frac{\partial^2 f}{\partial x_n \partial x_2} & \cdots & \frac{\partial^2 f}{\partial x_n^2} \end{bmatrix} $$
The determinant $ D $ of the Hessian and the second partial derivative $ f_{xx} $ determine the nature of