Smart market

A "smart market" is a periodic auction which is cleared by the operations research technique of mathematical optimization, such as linear programming. The smart market is operated by a market manager. Trades are not bilateral, between pairs of people, but rather to or from a pool. A smart market can assist market operation when trades would otherwise have significant transaction costs or externalities.

Most other types of auctions can be cleared by a simple process of sorting bids from lowest to highest. Goods may be divisible, as with milk or flour, or indivisible, as with paintings or houses. Finding a market-clearing allocation corresponds to solution of a simple knapsack problem, and does not require much computation. By contrast, a smart market allows market clearing with arbitrary constraints. During market design, constraints are selected to match the relevant physics and economics of the allocation problem. A good overview is given in.^[1]

Combinatorial auctions are smart markets in which goods are indivisible,^[2] but some smart markets allocate divisible goods such as electricity and natural gas.

Compared to traditional market structures, a smart market substantially reduces transaction costs, allows competition which would not be possible otherwise, and can eliminate externalities. Despite complex constraints, a smart market allows the benefits of a modern financial exchange system. Fulfilment of the contract is backed by the exchange; parties are generally anonymous; the market manager enforces regulation to ensure fairness and transparency; and markets are orderly, especially during stressful conditions.

A smart market may be a one-sided auction in which participants buy from the market manager, a one-sided procurement (reverse auction) in which participants sell to the market manager, or two-sided, in which the market manager balances supplying participants with demanding participants. In a two-sided smart market, the market manager may be a net seller, a net buyer, or simply a revenue-neutral broker.

Smart markets are achievable due to an enabling confluence of technologies: the internet to transmit users’ bids and the resulting prices and quantities, increased computation power to run the simulation and linear program, and real time monitoring.

Examples of smart markets

The term appears to have been first used by Rassenti, Smith, and Bulfin in 1982.^[3] That article proposed a combinatorial auction for airplane take-off and landing slots. The U.S. government is now seeking to implement such an auction.^[4]

The modern electricity market is an important example of a two-sided smart market.,^[5][6] Electricity markets clear every few minutes, and require coordination to ensure that power generation matches demand, and that power flows do not exceed network line capacities. Generators offer to supply tranches of power at a range of prices. Wholesale power distributors bid to buy tranches of power at a range of prices. To clear the market, the market manager solves a linear program in which the decision variables are how much power to accept from each generator, the flow of power on each line, and how much power to provide to each distributor.

After solution, the primal variables prescribe the dispatch (that is, how much power each generator should produce). The dual variables provide the market clearing prices. By clearing the market based on the dual prices, participants are charged on marginal values, rather than as bid. Thus, every seller is guaranteed to receive at least as much as was bid and possibly more. Every buyer is guaranteed to pay no more than was offered, and possibly less. Without the smart market, the line operator, all generators, and all distributors would have to be part of a monopoly in order to guarantee system coordination.

Natural gas markets are sometimes cleared by smart markets,^[7] as in Australia . The system operator serves as the market manager. Operation of the gas pipeline network require coordination to ensure that gas supply matches demand, and that flows do not exceed pipe capacities. Gas suppliers offer a range of quantities at a range of prices. Distributors bid to buy a range of quantities at a range of prices. To clear the market, the market manager solves a linear program in which the decision variables are the gas to accept from each supplier, the flow of gas on each pipe segment, and how much gas to provide to each distributor. As with electricity markets, after solution, the primal variables prescribe the optimal flows, and the dual variables provide the market clearing prices. The objective minimizes the cost of supplying power.

The spectrum auction is a one-sided smart market which is cleared by an integer program.^[8] Participants purchase radio spectrum from government. These combinatorial auctions are cleared as bid, rather than at prices based on dual variables. Only recently have researchers found robust means to obtain dual variables from integer programs.^[9]

Companies and governments sometimes use smart markets in procurement, as for transportation services. The Chilean government, for example, uses a smart market to choose caterers for school meal programs.^[10] The University of Chicago Booth School of Business uses a smart market for course registration. The system ensures that the class seats go to those students who most want them, while ensuring that the number of students in each class stays within the room capacity.^[11]

Smart markets are now being proposed for environmental services, including water.^[12][13] The more sophisticated of these designs rely on hydrological optimization ^[14] and hydrological run-off models.

Formulations

A smart market formulation may be written as a net pool, in which the decision variables explicitly calculate buys and sells, and the market model clears only those quantities. The net pool market can be mathematically infeasible if participants are unwilling to trade sufficient quantities to allow feasibility. Alternatively, the formulation may be a gross pool, in which the decision variables determine total quantities that each participant receives; the market manager calculates net sales after the model's solution, based on participants' initial holdings. The gross pool market will tend to be mathematically feasible, but could have an unacceptably high cost in the optimal objective value, should (buy) bids be too low compared to (sell) offers. The difference between these two formulations is only technical, as the market designs are economically equivalent by the Coase theorem.

See also mechanism design.

References

1. McCabe, Kevin, Stephen Rassenti, and Vernon Smith (1991). Smart computer-assisted markets. Science. 254 534-538.
2. Pekec, Aleksandar and Michael H. Rothkopf (2003), Combinatorial Auction Design, MANAGEMENT SCIENCE, Vol. 49, No. 11, November 2003, pp. 1485-1503.
3. Rassenti, S.J., V.L. Smith, and R.L. Bluffing (1982). “A Combinatorial Auction Mechanism for Airport time Slot Allocation,” Bell J. of Economics, v.13, pp. 402-417.
4. http://www.nytimes.com/2008/12/05/nyregion/05slots.html
5. Alvey T., Goodwin D., Xingwang M., Streiffert D. and Sun D. (1998). A security-constrained bid-clearing system for the NZ wholesale electricity market. IEEE Trans. Power Systems, 13(2), 340-346.
6. Hogan W.W, Read E.G and Ring B.J. (1996). Using Mathematical Programming for Electricity Spot Pricing. Int’l Trans. in Operations Research, 3, (3-4), 243-253.
7. McCabe, Kevin, Stephen Rasenti, and Vernon Smith (1990). Auction Design for Composite Goods: The Natural Gas Industry, J. of Economic Behavior and Organization, September, 127-149.
8. Chakravorti, B., W.W. Sharkey, Y. Spiegel and S. Wilkie (1995). Auctioning the Airwaves: The Contest for Broadband PCS Spectrum, J. Econ. & Mgt Strategy, 4(2), 267-343.
9. O’Neill, R.P., P.M. Sotkiewicz, B.F. Hobbs, M.H. Rothkopf, W.R. Stewart (2005). Effective market-clearing prices in markets with non-convexities. European Journal of Operational Research. 164 269-285.
10. Epstein, Rafael, Lysette Henriquez, Jaime Catalán, Gabriel Y. Weintraub, Cristián Martinez, “A Combinatorial Auction Improves School Meals in Chile,” Interfaces, vol. 32, no. 6, Nov-Dec 2002, pp. 1-14.
11. Graves, R.L., J. Sankaran, and L. Schrage (1993). An Auction Method for Course Registration, Interfaces, 23(5).
12. Murphy, J. J., A. Dinar, et al. (2000). The Design of ‘Smart’ Water Market Institutions Using Laboratory Experiments. Env and Resource Economics 17(4), 375-394.
13. Raffensperger, J. F. and M. Milke (2005). A Design for a Fresh Water Spot Market. Water Science and Technology: Water Supply 5(6), 217-224.
14. Ahlfeld, D., Barlow, P., and Mulligan, A. (2005). GWM–A ground–water mgt process for the USGS modular ground–water model (MODFLOW–2000), U.S. Geological Survey Open–File Report 2005–1072.