We show that relative entropy decreases for continuous time Markov chains.

# Category: Optimization

## Cross Entropy Method

In the *Cross Entropy Method*, we wish to estimate the likelihood

Here is a random variable whose distribution is known and belongs to a parametrized family of densities . Further is often a solution to an optimization problem.

## Online Convex Optimization

We consider the setting of sequentially optimizing the average of a sequence of functions, so called *online convex optimization*.

## Gradient Descent

We consider one of the simplest iterative procedures for solving the (unconstrainted) optimization

## A Network Decomposition

We consider a decomposition of the following network utility optimization problem

SYS:

## Congestion Control

We argue, in a slightly informal manner, that queueing networks implicitly optimize a utility function subject to constraints on network capacity. We start with the simple example of a closed queueing network and, as we shall discuss, a motivating example is the Transmission Control Protocol which controls the number of packets in transfer on an Internet connection.

## Gale-Eisenberg Market

The Gale-Eisenberg is a nice example were the distributed decisions of buyers and sellers have an equilibrium which solves an optimization problem.