Maximum flow problem

A network with an example of maximum flow. The source is s, and the sink t. The numbers denote flow and capacity.

In optimization theory, maximum flow problems involve finding a feasible flow through a single-source, single-sink flow network that is maximum.

The maximum flow problem can be seen as a special case of more complex network flow problems, such as the circulation problem. The maximum value of an s-t flow (i.e., flow from source s to sink t) is equal to the minimum capacity of an s-t cut (i.e., cut severing s from t) in the network, as stated in the max-flow min-cut theorem.

History

The maximum flow problem was first formulated in 1954 by T. E. Harris and F. S. Ross as a simplified model of Soviet railway traffic flow.^[1]^[2]^[3] In 1955, Lester R. Ford, Jr. and Delbert R. Fulkerson created the first known algorithm, the Ford–Fulkerson algorithm.^[4]^[5]

Over the years, various improved solutions to the maximum flow problem were discovered, notably the shortest augmenting path algorithm of Edmonds and Karp and independently Dinitz; the blocking flow algorithm of Dinitz; the push-relabel algorithm of Goldberg and Tarjan; and the binary blocking flow algorithm of Goldberg and Rao. The electrical flow algorithm of Christiano, Kelner, Madry, and Spielman finds an approximately optimal maximum flow but only works in undirected graphs.^[6]^[7]

Definition

A flow network, with source s and sink t. The numbers next to the edge are the capacities.

Let $\scriptstyle N = (V, E)$ be a network with $\scriptstyle s, t \in V$ being the source and the sink of $\scriptstyle N$ respectively.

The capacity of an edge is a mapping

\scriptstyle c : E \to \mathbb{R}^+

, denoted by

\scriptstyle c_{uv}

\scriptstyle c(u, v)

. It represents the maximum amount of flow that can pass through an edge.

A flow is a mapping

\scriptstyle f : E \to \mathbb{R}^+

, denoted by

\scriptstyle f_{uv}

\scriptstyle f(u, v)

, subject to the following two constraints:

\scriptstyle f_{uv} \leq c_{uv}

, for each

\scriptstyle (u, v) \in E

(capacity constraint: the flow of an edge cannot exceed its capacity)

\scriptstyle \sum_{u:(u, v) \in E} f_{uv} = \sum_{u:(v, u) \in E} f_{vu}

, for each

\scriptstyle v \in V \setminus \{s, t\}

(conservation of flows: the sum of the flows entering a node must equal the sum of the flows exiting a node, except for the source and the sink nodes)

The value of flow is defined by

\scriptstyle |f| = \sum_{v:(s,v) \in E} f_{sv}

, where

\scriptstyle s

is the source of

\scriptstyle N

. It represents the amount of flow passing from the source to the sink.

The maximum flow problem is to maximize $\scriptstyle |f|$ , that is, to route as much flow as possible from $\scriptstyle s$ to $\scriptstyle t$ .

Solutions

We can define the Residual Graph, which provides a systematic way to search for forward-backward operations in order to find the maximum flow.

Given a flow network $G$ , and a flow $f$ on $G$ , we define the residual graph $G_{f}$ of $G$ with respect to $f$ as follows.

The node set of $G_{f}$ is the same as that of $G$ .
Each edge $e = (u, v)$ of $G_{f}$ is with a capacity of $c_{e} - f(e)$ .
Each edge $e' = (v, u)$ of $G_{f}$ is with a capacity of $f(e)$ .

The following table lists algorithms for solving the maximum flow problem.

Method	Complexity	Description
Linear programming		Constraints given by the definition of a legal flow. See the linear program here.
Ford–Fulkerson algorithm	$O (E max\| f \|)$	As long as there is an open path through the residual graph, send the minimum of the residual capacities on the path. The algorithm is only guaranteed to terminate if all weights are rational. Otherwise it is possible that the algorithm will not converge to the maximum value. However, if the algorithm terminates, it is guaranteed to find the maximum value.
Edmonds–Karp algorithm	$O (VE 2)$	A specialization of Ford–Fulkerson, finding augmenting paths with breadth-first search.
Dinic's blocking flow algorithm	$O (V 2 E)$	In each phase the algorithms builds a layered graph with breadth-first search on the residual graph. The maximum flow in a layered graph can be calculated in $O (VE)$ time, and the maximum number of the phases is $n -1$ . In networks with unit capacities, Dinic's algorithm terminates in $O(\min\{V^{2/3}, E^{1/2}\}E)$ time.
MPM (Malhotra, Pramodh-Kumar and Maheshwari) algorithm^[8]	$O (V 3)$	Refer to the Original Paper.
Dinic's algorithm	$O (VE log(V))$	The dynamic trees data structure speeds up the maximum flow computation in the layered graph to $O (E log(V))$ .
General push-relabel maximum flow algorithm	$O (V 2 E)$	The push relabel algorithm maintains a preflow, i.e. a flow function with the possibility of excess in the vertices. The algorithm runs while there is a vertex with positive excess, i.e. an active vertex in the graph. The push operation increases the flow on a residual edge, and a height function on the vertices controls which residual edges can be pushed. The height function is changed with a relabel operation. The proper definitions of these operations guarantee that the resulting flow function is a maximum flow.
Push-relabel algorithm with FIFO vertex selection rule	$O (V 3)$	Push-relabel algorithm variant which always selects the most recently active vertex, and performs push operations until the excess is positive or there are admissible residual edges from this vertex.
Push-relabel algorithm with dynamic trees	$O\left(VE \log \frac {V^2} E \right)$	The algorithm builds limited size trees on the residual graph regarding to height function. These trees provide multilevel push operations.
KRT (King, Rao, Tarjan)'s algorithm^[9]	$O(EV \log_{\frac E {V \log V}}V)$
Binary blocking flow algorithm^[10]	$O\left(E \cdot \min(V^{\frac 2 3},\sqrt{E}) \cdot \log \frac {V^2} E \log{U}\right)$	The value U corresponds to the maximum capacity of the network.
James B Orlin's + KRT (King, Rao, Tarjan)'s algorithm^[11]	$O(VE)$	Orlin's algorithm solves max-flow in $O (VE)$ time for $E \leq O(V^{{16 \over 15} - \epsilon})$ while KRT solves it in $O (VE)$ for $E > V^{1+\epsilon}$ .

For a more extensive list, see^[12]

Integral flow theorem

The integral flow theorem states that

If each edge in a flow network has integral capacity, then there exists an integral maximal flow.

Application

Multi-source multi-sink maximum flow problem

Fig. 4.1.1. Transformation of a multi-source multi-sink maximum flow problem into a single-source single-sink maximum flow problem

Given a network N = (V,E) with a set of sources S = {s₁, ..., s_n} and a set of sinks T = {t₁, ..., t_m} instead of only one source and one sink, we are to find the maximum flow across N. We can transform the multi-source multi-sink problem into a maximum flow problem by adding a consolidated source connecting to each vertex in S and a consolidated sink connected by each vertex in T (also known as supersource and supersink) with infinite capacity on each edge (See Fig. 4.1.1.).

Minimum path cover in directed acyclic graph

Given a directed acyclic graph G = (V, E), we are to find the minimum number of vertex-disjoint paths to cover each vertex in V. We can construct a bipartite graph G' = (V_out∪V_in, E' ) from G, where

V_out = {v∈V: v has positive out-degree}.
V_in = {v∈V: v has positive in-degree}.
E' = {(u,v)∈V_out×V_in: (u,v)∈E}.

Then it can be shown, via König's theorem, that G' has a matching of size m if and only if there exists n-m vertex-disjoint paths that cover each vertex in G, where n is the number of vertices in G. Therefore, the problem can be solved by finding the maximum cardinality matching in G' instead.

Maximum cardinality bipartite matching

Fig. 4.3.1. Transformation of a maximum bipartite matching problem into a maximum flow problem

Given a bipartite graph G = (X∪Y, E), we are to find a maximum cardinality matching in G, that is a matching that contains the largest possible number of edges. This problem can be transformed into a maximum flow problem by constructing a network N = (X∪Y∪{s,t), E' }, where

E' contains the edges in G directed from X to Y.
(s,x)∈E' for each x∈X and (y,t)∈E' for each y∈Y.
c(e) = 1 for each e∈E' (See Fig. 4.3.1).

Then the value of the maximum flow in N is equal to the size of the maximum matching in G.

Maximum flow problem with vertex capacities

Fig. 4.4.1. Transformation of a maximum flow problem with vertex capacities constraint into the original maximum flow problem by node splitting

Given a network $N = (V, E)$ , in which there is capacity at each node in addition to edge capacity, that is, a mapping $c: V\mapsto \mathbb{R}^{+}$ , denoted by $c(v)$ , such that the flow $f$ has to satisfy not only the capacity constraint and the conservation of flows, but also the vertex capacity constraint

\sum_{i\in V} f_{iv} \le c(v) \qquad \forall v \in V \backslash \{s,t\}

In other words, the amount of flow passing through a vertex cannot exceed its capacity. To find the maximum flow across $N$ , we can transform the problem into the maximum flow problem in the original sense by expanding $N$ . First, each $v\in V$ is replaced by $v_{\text{in}}$ and $v_{\text{out}}$ , where $v_{\text{in}}$ is connected by edges going into $v$ and $v_{\text{out}}$ is connected to edges coming out from $v$ , then assign capacity $c(v)$ to the edge connecting $v_{\text{in}}$ and $v_{\text{out}}$ (see Fig. 4.4.1). In this expanded network, the vertex capacity constraint is removed and therefore the problem can be treated as the original maximum flow problem.

Maximum edge-disjoint path

Given a directed graph G = (V, E) and two vertices s and t, we are to find the maximum number of edge-disjoint paths from s to t. This problem can be transformed to a maximum flow problem by constructing a network N = (V, E) from G with s and t being the source and the sink of N respectively and assign each edge with unit capacity.

Maximum independent (vertex-disjoint) path

Given a directed graph G = (V, E) and two vertices s and t, we are to find the maximum number of independent paths from s to t. Two paths are said to be independent if they do not have a vertex in common apart from s and t. We can construct a network N = (V, E) from G with vertex capacities, where

s and t are the source and the sink of N respectively.
c(v) = 1 for each v∈V.
c(e) = 1 for each e∈E.

Then the value of the maximum flow is equal to the maximum number of independent paths from s to t.

Real world applications

Baseball elimination

Construction of network flow for baseball elimination problem

In the baseball elimination problem there are n teams competing in a league. At a specific stage of the league season, w_i is the number of wins and r_i is the number of games left to play for team i and r_ij is the number of games left against team j. A team is eliminated if it has no chance to finish the season in the first place. The task of the baseball elimination problem is to determine which teams are eliminated at each point during the season. Schwartz^[13] proposed a method which reduces this problem to maximum network flow. In this method a network is created to determine whether team k is eliminated.

Let G = (V, E) be a network with s,t ∈ V being the source and the sink respectively. One adds a game node {i,j} with i < j to V, and connects each of them from s by an edge with capacity r_ij – which represents the number of plays between these two teams. We also add a team node for each team and connect each game node {i,j} with to team nodes i and j to ensure one of them wins. One does not need to restrict the flow value on these edges. Finally, edges are made from team node i to the sink node t and the capacity of w_k+r_k–w_i is set to prevent team i from winning more than w_k+r_k. Let S be the set of all teams participating in the league and let $\scriptstyle r(S - \{k\}) = \sum_{i,j \in \{S-\{k\}\}, i < j} r_{ij}$ . In this method it is claimed team k is not eliminated if and only if a flow value of size r(S − {k}) exists in network G. In the mentioned article it is proved that this flow value is the maximum flow value from s to t.

Airline scheduling

In the airline industry a major problem is the scheduling of the flight crews. The airline scheduling problem can be considered as an application of extended maximum network flow. The input of this problem is a set of flights F which contains the information about where and when each flight departs and arrives. In one version of airline scheduling the goal is to produce a feasible schedule with at most k crews.

In order to solve this problem one uses a variation of the circulation problem called bounded circulation which is the generalization of network flow problems, with the added constraint of a lower bound on edge flows.

Let G = (V, E) be a network with s,t ∈ V as the source and the sink nodes. For the source and destination of every flight i, one adds two nodes to V, node s_i as the source and node d_i as the destination node of flight i. One also adds the following edges to E:

An edge with capacity [0, 1] between s and each s_i.
An edge with capacity [0, 1] between each d_i and t.
An edge with capacity [1, 1] between each pair of s_i and d_i.
An edge with capacity [0, 1] between each d_i and s_j, if source s_j is reachable with a reasonable amount of time and cost from the destination of flight i.
An edge with capacity [0, ∞] between s and t.

In the mentioned method, it is claimed and proved that finding a flow value of k in G between s and t is equal to finding a feasible schedule for flight set F with at most k crews.^[14]

Another version of airline scheduling is finding the minimum needed crews to perform all the flights. In order to find an answer to this problem, a bipartite graph G’ = (A ∪ B, E) is created where each flight has a copy in set A and set B. If the same plane can perform flight j after flight i, i∈A is connected to j∈B. A matching in G’ induces a schedule for F and obviously maximum bipartite matching in this graph produces an airline schedule with minimum number of crews.^[14] As it is mentioned in the Application part of this article, the maximum cardinality bipartite matching is an application of maximum flow problem.

Circulation–demand problem

There are some factories that produce goods and some villages where the goods have to be delivered. They are connected by a networks of roads with each road having a capacity $c$ for maximum goods that can flow through it. The problem is to find if there is a circulation that satisfies the demand. This problem can be transformed into a maximum-flow problem.

Add a source node $s$ and add edges from it to every factory node $f i$ with capacity $p i$ where $p i$ is the production rate of factory $f i$ .
Add a sink node $t$ and add edges from all villages $v i$ to $t$ with capacity $d i$ where $d i$ is the demand rate of village $v i$ .

Let G = (V, E) be this new network. There exists a circulation that satisfies the demand if and only if :

Maximum flow value(G)

= \sum_{i \in v} d_i

If there exists a circulation, looking at the max-flow solution would give the answer as to how much goods have to be sent on a particular road for satisfying the demands.

References

↑ Schrijver, A. (2002). "On the history of the transportation and maximum flow problems". Mathematical Programming 91 (3): 437–445. doi:10.1007/s101070100259.
↑ Gass, Saul I.; Assad, Arjang A. (2005). "Mathematical, algorithmic and professional developments of operations research from 1951 to 1956". An Annotated Timeline of Operations Research. International Series in Operations Research & Management Science 75. pp. 79–110. doi:10.1007/0-387-25837-X_5. ISBN 1-4020-8116-2.
↑ Harris, T. E.; Ross, F. S. (1955). "Fundamentals of a Method for Evaluating Rail Net Capacities" (PDF). Research Memorandum (Rand Corporation).
↑ Ford, L. R.; Fulkerson, D. R. (1956). "Maximal flow through a network". Canadian Journal of Mathematics 8: 399. doi:10.4153/CJM-1956-045-5.
↑ Ford, L.R., Jr.; Fulkerson, D.R., Flows in Networks, Princeton University Press (1962).
↑ Kelner, J. A.; Lee, Y. T.; Orecchia, L.; Sidford, A. (2014). "An Almost-Linear-Time Algorithm for Approximate Max Flow in Undirected Graphs, and its Multicommodity Generalizations". Proceedings of the Twenty-Fifth Annual ACM-SIAM Symposium on Discrete Algorithms (PDF). p. 217. arXiv:1304.2338. doi:10.1137/1.9781611973402.16. ISBN 978-1-61197-338-9.
↑ Knight, Helen (7 January 2014). "New algorithm can dramatically streamline solutions to the ‘max flow’ problem". MIT News. Retrieved 8 January 2014.
↑ Malhotra, V.M.; Kumar, M.Pramodh; Maheshwari, S.N. (1978). "An $O(|V|^3)$ algorithm for finding maximum flows in networks". Information Processing Letters 7 (6): 277–278. doi:10.1016/0020-0190(78)90016-9.
↑ King, V.; Rao, S.; Tarjan, R. (1994). "A Faster Deterministic Maximum Flow Algorithm". Journal of Algorithms 17 (3): 447–474. doi:10.1006/jagm.1994.1044.
↑ Goldberg, A. V.; Rao, S. (1998). "Beyond the flow decomposition barrier". Journal of the ACM 45 (5): 783. doi:10.1145/290179.290181.
↑ Orlin, James B. (2013). "Max flows in O(nm) time, or better". STOC '13 Proceedings of the forty-fifth annual ACM symposium on Theory of computing: 765–774. doi:10.1145/2488608.2488705.
↑ Goldberg, A. V.; Tarjan, R. E. (1988). "A new approach to the maximum-flow problem". Journal of the ACM 35 (4): 921. doi:10.1145/48014.61051.
↑ Schwartz, B. L. (1966). "Possible Winners in Partially Completed Tournaments". SIAM Review 8 (3): 302. doi:10.1137/1008062. JSTOR 2028206.
1 2 Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein (2001). "26. Maximum Flow". Introduction to Algorithms, Second Edition. MIT Press and McGraw-Hill. pp. 643–668. ISBN 0-262-03293-7.