History of IBM mainframe operating systems

The history of operating systems running on IBM mainframes is a notable chapter of history of mainframe operating systems, because of IBM's long-standing position as the world's largest hardware supplier of mainframe computers.

Arguably the operating systems which IBM supplied to customers for use on its early mainframes have seldom been very innovative, except for the virtual machine systems beginning with CP-67. But the company's well-known reputation for preferring proven technology has generally given potential users the confidence to adopt new IBM systems fairly quickly. IBM's current mainframe operating systems, z/OS, z/VM, z/VSE, and z/TPF, are backwards compatible successors to operating systems introduced in the 1960s, although of course they have been improved in many ways.

Both IBM-supplied operating systems and those supplied by others are discussed here, if notably used on IBM mainframes.

History of IBM mainframe operating systems

Before System/360

IBM was slow to introduce operating systems: General Motors produced General Motors OS in 1955 and GM-NAA I/O in 1956 for use on its own IBM computers; and in 1962 Burroughs Corporation released MCP and General Electric introduced GECOS, in both cases for use by their customers.[1][2]

In fact the first operating systems for IBM computers were written by IBM customers who did not wish to have their very expensive machines (US$2M in the mid-1950s) sitting idle while operators set up jobs manually, and so they wanted a mechanism for maintaining a queue of jobs.[3]

The operating systems described below ran only on a few processor models and were suitable only for scientific and engineering calculations. Users with other IBM computers or other applications had to manage without operating systems. But one of IBM's smaller computers, the IBM 650, introduced a feature which later became part of OS/360: if processing was interrupted by a "random processing error" (hardware glitch), the machine could automatically resume from the last checkpoint instead of requiring the operators to restart the job manually from the beginning.[4]

From General Motors' GM-NAA I/O to IBSYS

General Motors' Research division produced GM-NAA I/O for its IBM 701 in 1956 (from a prototype, GM Operating System, developed in 1955), and updated it for the 701's successor. In 1960 the IBM user association SHARE took it over and produced an updated version, SHARE Operating System.[3]

Finally IBM took over the project and supplied an enhanced version called IBSYS with the IBM 7090 and IBM 7094 computers. IBSYS required 8 tape drives (fewer if the system had one or more disk drives). Its main components were: a card-based Job Control language, which was the main user interface; compilers for FORTRAN and COBOL; an assembler; and various utilities including a sort program.[5][6]

In 1958, the University of Michigan Executive System adapted GM-NAA I/O to produce UMES, which was better-suited to the large number of small jobs created by students. UMES was used until 1967, when it was replaced by the MTS timesharing system.[7]

BESYS

Bell Labs produced BESYS (sometimes referred to as BELLMON) and used it until the mid-1960s. Bell also made it available to others without charge or formal technical support.[8]

FORTRAN Monitor System

Before IBSYS, IBM produced for its IBM 709, 7090 and 7094 computers a tape-based operating system whose sole purpose was to compile FORTRAN programs—in fact FMS and the FORTRAN compiler were on the same tape.[9][10]

Early time-sharing and virtual machine systems

Main articles: Time-sharing and Virtual machine
Further information: the article History of CP/CMS includes information on early time-sharing and virtual machine systems
For an explanation of time-sharing, virtual memory or virtual machines, see the Technical notes near the end of this article.

MIT's Fernando Corbató produced the first experimental time-sharing systems, such as CTSS, from 1957 to the early 1960s, using slightly modified IBM 704 and IBM 7090 mainframes; these systems were based on a proposal by John McCarthy.[11] In the 1960s IBM's own laboratories created experimental time-sharing systems, using standard mainframes with hardware and microcode modifications to support virtual memory: IBM M44/44X in the early 1960s; CP-40 from 1964 to 1967; CP-67 from 1967 to 1972. The company even released CP-67 without warranty or technical support to several large customers from 1968 to 1972. CP-40 and CP-67 used modified System/360 CPUs, but the M44/44X was based on the IBM 7044, an earlier generation of CPU which was very different internally.[12][13][14]

These experimental systems were too late to be incorporated into the System/360 series which IBM announced in 1964, but encouraged the company to add virtual memory and virtual machine capabilities to its System/370 mainframes and their operating systems in 1972:[12]

In 1968 a consulting firm called Computer Software Systems used the released version of CP-67 to set up a commercial time-sharing service. The company's technical team included 2 recruits from MIT (see CTSS above), Dick Orenstein and Harold Feinleib. As it grew, the company renamed itself National CSS and modified the software to increase the number of paying users it could support until the system was sufficiently different that it warranted a new name, VP/CSS. VP/CSS was the delivery mechanism for National CSS' services until the early 1980s, when it switched to IBM's VM/370 (see below).[16][17]

Universities produced three other S/360 time-sharing operating systems in the late 1960s:

System/360 operating systems

Up to the early 1960s IBM's low-end and high-end systems were incompatible - programs could not easily be transferred from one to another, and the systems often used completely different peripherals (e.g. disk drives).[22] IBM concluded that these factors were increasing its design and production costs for both hardware and software to a level that was unsustainable, and were reducing sales by deterring customers from upgrading. So in 1964 the company announced System/360, a new range of computers which all used the same peripherals and most of which could run the same programs.[23]

IBM originally intended that System/360 should have only one batch-oriented operating system, OS/360. There are at least two accounts of why IBM later decided it should also produce a simpler batch-oriented operating system, DOS/360: because it found that OS/360 would not fit into the limited memory available on the smaller System/360 models;[24] or because it realized that the development of OS/360 would take much longer than expected, and introduced DOS/360 as one of a series of stop-gaps to prevent System/360 hardware sales from collapsing - the others were BOS/360 (Basic Operating System, for the smallest machines) and TOS/360 (Tape Operating System, for machines with only tape drives).[23]

System/360's operating systems were more complex than previous IBM operating systems for several reasons, including:[25]

This was one of the largest software projects anyone had attempted, and it soon ran into trouble, with huge time and cost over-runs and large numbers of bugs.[25] So the company had to release a series of short-lived stop-gaps because:[23]

IBM released four stop-gap operating systems to prevent sales of System/360 from collapsing:[23]

When IBM announced the S/360-67 it also announced a timesharing operating system, TSS/360, that would use the new virtual memory capabilities of the 360/67. TSS/360 was so late and unreliable that IBM canceled it. By this time the alternative operating system CP-67, developed by IBM's Cambridge Scientific Center, was running well enough for IBM to offer it "without warranty" as a timesharing facility for a few large customers.[28] CP-67 would go on to become VM/370 and eventually z/VM.

The traumas of producing the System/360 operating systems gave a boost to the emerging discipline of software engineering, the attempt to apply scientific principles to the development of software and the management of software projects. Frederick P. Brooks, who was a senior project manager for the whole System/360 project and then was given specific responsibility for OS/360 (which was already long overdue), wrote an acclaimed book, The Mythical Man-Month, based on the problems encountered and lessons learned during the project, two of which were:[29]

DOS/360

DOS/360 became the usual operating system for processors less than 256 KB of memory.[26] It had a good set of utility programs, an Assembler, and compilers for FORTRAN, COBOL and eventually PL/I. And it supported a useful range of file organizations with access methods to help in using them:

Sequential and ISAM files could store either fixed-length or variable-length records, and all types could occupy more than one disk volume.

DOS/360 also offered BTAM, a data communications facility which was primitive and hard to use by today's standards. But BTAM could communicate with almost any type of terminal, which was a big advantage at a time when there was hardly any standardization of communications protocols.

But DOS/360 had significant limitations compared with OS/360, which was used to control most larger System/360 machines:

IBM expected that DOS/360 users would soon upgrade to OS/360. But despite its limitations DOS/360 became the world's most widely used operating system because System/360 hardware sold very well, DOS/360 ran well on System/360 processors which medium-sized organizations could afford, and it was better than the "operating systems" these customers had before. As a result, its descendant z/VSE is still widely used today, as of 2005.[30]

OS/360

Main article: OS/360 and successors

OS/360 included multiple levels of support, a single API and much shared code. PCP was a stop-gap version which could run only one program at a time, but MFT ("Multiprogramming with a Fixed number of Tasks") and MVT ("Multiprogramming with a Variable number of Tasks") were used until at least the late 1970s, a good five years after their successors had been launched.[31] It is unclear whether the divisions among PCP, MFT and MVT arose because MVT required too much memory to be usable on mid-range machines or because IBM needed to release a multiprogramming version of OS (MFT) as soon as possible.

PCP, MFT and MVT had different approaches to managing memory (see below), but provided very similar facilities:

Experience indicated that it was not advisable to install MFT on systems with less than 256 KB of memory, which was a common limitation in the 1960s.[26]

MFT

Main article: MFT

When installing MFT, customers would specify up to five "partitions", areas of memory with fixed boundaries, in which application programs could be run simultaneously.[27] MFT Version II (MFT-II) raised the limit to 52.

MVT

Main article: MVT

MVT was considerably larger and more complex than MFT and therefore was used on the most powerful System/360 CPUs. It treated all memory not used by the operating system as a single pool from which contiguous "regions" could be allocated as required by an indefinite number of simultaneous application programs. This scheme was more flexible than MFT's and in principle used memory more efficiently, but was liable to fragmentation - after a while one could find that, although there was enough spare memory in total to run a program, it was divided into separate chunks none of which was large enough.[27]

In 1971 the Time Sharing Option (TSO) for use with MVT was added. TSO became widely used for program development because it provided: an editor; the ability to submit batch jobs, be notified of their completion and view the results without waiting for printed reports; debuggers for some of the programming languages used on System/360. TSO communicated with terminals by using TCAM (Telecommunications Access Method), which eventually replaced the earlier Queued Telecommunications Access Method (QTAM). TCAM's name suggests that IBM hoped it would become the standard access method for data communications, but in fact TCAM was used almost entirely for TSO and was largely superseded by VTAM from the late 1970s onwards.

TP monitors

System/360's hardware and operating systems were designed for processing batch jobs which in extreme cases might run for hours. As a result, they were unsuitable for transaction processing, in which there are thousands of units of work per day and each takes between 30 seconds and a very few minutes. In 1968 IBM released IMS to handle transaction processing, and in 1969 it released CICS, a simpler transaction processing system which a group of IBM's staff had developed for a customer. IMS was only available for OS/360 and its successors, but CICS was also available for DOS/360 and its successors.[32][33] For many years this type of product was known as a "TP (teleprocessing) monitor". Strictly speaking TP monitors were not operating system components but application programs which managed other application programs. In the 1970s and 1980s several third-party TP monitors competed with CICS (notably Taskmaster, Shadow and Intercomm), but IBM gradually improved CICS to the point where most customers abandoned the alternatives.[34][35]

Special systems for airlines

In the 1950s airlines were expanding rapidly but this growth was held back by the difficulty of handling thousands of bookings manually (using card files). In 1957 IBM signed a development contract with American Airlines for the development of a computerized reservations system, which became known as SABRE. The first experimental system went live in 1960 and the system took over all booking functions in 1964 - in both cases using IBM 7090 mainframes. In the early 1960s IBM undertook similar projects for other airlines, and soon decided to produce a single standard booking system, PARS, to run on System/360 computers.

In SABRE and early versions of PARS there was no separation between the application and operating system components of the software, but in 1968 IBM divided it into PARS (application) and ACP (operating system). Later versions of ACP were named ACP / TPF and then TPF (Transaction Processing Facility) as non-airline businesses adopted this operating system for handling large volumes of online transactions. The latest version is z/TPF.

IBM developed ACP and its successors because: in the mid-1960s IBM's standard operating systems (DOS/360 and OS/360) were batch-oriented and could not handle large numbers of short transactions quickly enough; even its transaction monitors IMS and CICS, which run under the control of standard general-purpose operating systems, are not fast enough for handling reservations on hundreds of flights from thousands of travel agents.

The last "public domain" version of ACP, hence its last "free" version, was ACP 9.2, which was distributed on a single mini-reel with an accompanying manual set (about two dozen manuals, which occupied perhaps 48 lineal inches of shelf space) and which could be restored to IBM 3340 disk drives and which would, thereby, provide a fully functional ACP system.

ACP 9.2 was intended, primarily, for bank card (MasterCard®, et al.) and other "financial" applications, but it could also be utilized for airlines reservation systems, too, as by this time ACP had become a more general-purpose OS.

Indeed, ACP had by then incorporated a "hypervisor" module (CHYR) which supported a virtual OS ... usually VS1, but possibly also VS2... as a "guest", with which program development or file maintenance could be accomplished concurrently with the on-line functions.

In some instances, production work was run under VS2 under the hypervisor, including, possibly, IMS DB.

System/360 Model 20

The Model 20 was labeled as part of the System/360 range because it could be connected to some of the same peripherals, but it was a 16-bit machine and not entirely program-compatible with other members of the System/360 range. Three operating systems were developed by IBM's labs in Germany, for different 360/20 configurations; DPSwith disks (minimum memory required: 12 KB); TPSno disk but with tapes (minimum memory required: 8 KB); and CPSpunched-card-based (minimum memory required: 4 KB).[36] These had no direct successors since IBM introduced the System/3 range of small business computers in 1969 and System/3 had a different internal design from the 360/20 and different peripherals from IBM's mainframes.

System/360 Model 44

This was another processor which used the System/360 peripherals but had a different internal design. The 360/44 was designed for scientific computation using floating point numbers, such as geological or meteorological analyses. Because of the internal differences and the specialized type of work for which it was designed, the 360/44 had its own operating system, PS/44.[37] An emulator for missing System/360 instructions allowed the Model 44 to run OS/360. The 360/44 and PS/44 had no direct successors.

System/370 and virtual memory operating systems

When System/370 was announced in 1970 it offered essentially the same facilities as System/360 but with about 4 times the processor speeds of similarly-priced System/360 CPUs.[38] Then in 1972 IBM announced "System/370 Advanced Functions", of which the main item was that future sales of System/370 would include virtual memory capability and this could also be retro-fitted to existing System/370 CPUs. Hence IBM also committed to delivering enhanced operating systems which could support the use of virtual memory.[39][40]

Most of the new operating systems were distinguished from their predecessors by the presence of "/VS" in their names. "VS" stands for "Virtual Storage" - IBM avoided the term "memory", allegedly because it might be interpreted to imply that their computers could forget things.

All of today's IBM mainframe operating systems except z/TPF are descendants of those included in the "System/370 Advanced Functions" announcement - z/TPF is a descendant of ACP, the system which IBM initially developed to support high-volume airline reservations applications.

DOS/VS

DOS/VS was the successor to DOS/360. In addition to virtual memory DOS/VS provided other enhancements:

DOS/VS was followed by significant upgrades: DOS/VSE and VSE/SP (1980s), VSE/ESA (1991), and z/VSE (2005).[41][42]

OS/VS1

OS/VS1 was the successor to MFT, and offered similar facilities, with the addition of virtual memory.[27] IBM released fairly minor enhancements of OS/VS1 until 1983, and in 1984 announced that there would be no more. OS/VS1 is the only System/370 operating system which does not have a modern descendant.

The Special Real Time Operating System (SRTOS), Programming RPQ Z06751, was a variant of OS/VS1 extended to support real-time computing. It was targeted at such industries as electric utility energy management and oil refinery applications.[43]

OS/VS2 and MVS

OS/VS2 Release 1 (SVS) was a replacement for MVT with virtual memory; while there were many changes it retained the overall structure. But in 1974 IBM released what it described as OS/VS2 release 2 but which was a major rewrite that was upwards-compatible with the earlier OS/VS2 SVS. The new system's most noticeable feature was that it supported multiple virtual address spaces - different applications thought they were using the same range of virtual addresses, but the new system's virtual memory facilities mapped these to different ranges of real memory addresses.[27] As a result, the new system rapidly became known as "MVS" (Multiple Virtual Storages), the original OS/VS2 became known as "SVS" (Single Virtual Storage). IBM itself accepted this terminology and labelled MVS's successors "MVS/...".[44]

The other distinctive features of MVS were: its main catalog had to be a VSAM catalog; it supported "tightly-coupled multiprocessing" (2 or more CPUs share the same memory and copy of the operating system); it included a System Resources Manager (renamed Workload Manager in later versions) which allowed users to load additional work on to the system without reducing the performance of high-priority jobs.

IBM has released several MVS upgrades: MVS/SE, MVS/SP Version 1, MVS/XA (1981), MVS/ESA (1985), OS/390 (1996) and currently z/OS (2001).[45]

VM/370

For more details on the early history of VM/370, see History of CP/CMS.

VM/370 combined a virtual machine facility with a single-user system called Conversational Monitor System (CMS); this combination provided time-sharing by allowing each user to run a copy of CMS on his / her own virtual machine. This combination was a direct descendant of CP/CMS.[46] The virtual machine facility was often used for testing new software while normal production work continued on another virtual machine, and the CMS timesharing system was widely used for program development.[47]

VM/370 was followed by a series of upgrades: VM/SEPP ("Systems Extensions Program Product"), VM/BSEPP ("Basic Systems Extensions Program Product"), VM/SP (System Product), VM/SP HPO ("High Performance Option"), VM/XA MA ("Extended Architecture Migration Aid"), VM/XA SF ("Extended Architecture System Facility"), VM/XA SP ("Extended Architecture System Product"), VM/ESA ("Enterprise Systems Architecture"), and z/VM. IBM also produced optional microcode assists for VM and successors, to speed up the hypervisor's emulation of privileged instructions (those which only operating systems can use) on behalf of "guest" operating systems. As part of 370/Extended Architecture, IBM added the Start Interpretive Execution (SIE) instruction[48] to allow a further speedup of the CP hypervisor.[49]

Technical notes

Time-sharing

Main article: Time-sharing

Time-sharing (or timesharing) is based on the idea that computers are much faster than humans, so while one human user is reading what a computer has just displayed on a screen the computer can do some useful work for another user. Large time-sharing systems can have hundreds or even thousands of simultaneous users, and the memory required by their programs and data generally adds up to much more than the physical memory attached to the computer. Time-sharing systems solve this problem by various combinations of:

Virtual memory

Main article: Virtual memory

Virtual memory is a memory management technique by which programs are made to work as if they have more memory available to them than is actually attached to the computer. Running programs' code and data may be scattered over several areas of physical memory or even placed on a disk until needed.

The main components of an IBM virtual memory system are:

When functioning properly, the virtual memory system keeps active pages in real memory, inactive ones on disk, and allows more efficient execution of the systems workload.

Virtual machine

Main article: Virtual machine

Virtual machine techniques enable several operating systems ("guest" operating systems) or other software to run on the same computer so that each thinks it has a whole computer to itself, and each of these simulated whole computers is called a "virtual machine". The operating system which really controls the computer is usually called a hypervisor. Two of the major components of the hypervisor are:

See also

References

  1. "Timeline of Computer History: 1956: Software". Computer History Museum. Retrieved September 4, 2007.
  2. OS History - MCP
  3. 1 2 A Brief History of Linux
  4. IBM 650 Magnetic Drum Data Processing Machine
  5. IBM 7090/94 IBSYS Operating System
  6. Gray, G. (1999). "EXEC II". Unisys History Newsletter 1 (3).
  7. "A Career Interview with Bernie Galler". IEEE Annals of the History of Computing 23 (1): 22–33. Jan–Mar 2001. doi:10.1109/85.910847.
  8. Vyssotsky, V. and Pierce, E. (Jan 1985). "Putting Unix in Perspective". Unix Review 1 (3).
  9. Reminiscences of Fortran
  10. "FORTRAN Anecdotes". IEEE Annals of the History of Computing 6 (1): 59–64. January–March 1984. doi:10.1109/MAHC.1984.10010.
  11. John McCarthy, Reminiscences on the History of Time Sharing - describes the origins of timesharing
  12. 1 2 R. J. Creasy, "The origin of the VM/370 time-sharing system", IBM Journal of Research & Development, Vol. 25, No. 5 (September 1981), pp. 483–90, PDF
  13. Peter J. Denning, "Performance Modeling: Experimental Computer Science at its Best", Communications of the ACM, President's Letter (November 1981), available on-line at cs.gmu.edu
    a survey of research papers
  14. Melinda Varian, VM and the VM community, past present, and future, SHARE 89 Sessions 9059-9061, 1977; available online at www.princeton.edu/~melinda - outstanding source for CP/CMS and VM history
  15. Denning, Peter (1997). "Before Memory was Virtual". In the Beginning: Recollections of Software Pioneers.
  16. Luanne Johnson (December 23, 2004). "Company Details - National CSS". Computer History Museum. Retrieved January 30, 2007.
  17. Harold Feinleib (March 2005). A technical history of National CSS (PDF). Computer History Museum.
  18. MTS History by Dan Boulet for Everything2.com
  19. McGill University - MUSIC/SP
  20. ORVYL/370 Timesharing System Functional Description, Stanford University, 1978
  21. WYLBUR Reference Manual, Stanford University, 1984
  22. Mainframe Family tree & chronology
  23. 1 2 3 4 Chuck Boyer, The 360 Revolution
  24. Johnston (April 1, 2005). "VSE: A Look at the Past 40 Years". z/Journal (Thomas Communications) (April/May 2005). ISSN 1551-8191. OCLC 56140149.
  25. 1 2 Andrew S. Tanenbaum, History of Modern Operating Systems, Prentice Hall (2001)
  26. 1 2 3 Ray Saunders, "MVS... And Before OS/360 ?"
  27. 1 2 3 4 5 Auslander, M. A.; Jaffe, J. F. (1973). "Functional structure of IBM virtual storage operating systems Part I: Influences of dynamic address translation on operating system technology" (PDF). IBM Systems Journal 4 (IBM).
  28. The IBM 360/67 and CP/CMS
  29. Brooks, F.P. (1995) [1975]. The Mythical Man-Month: Essays on Software Engineering. Addison-Wesley Professional. ISBN 0-201-83595-9.
  30. Jerry Johnston, VSE: A Look at the Past 40 Years (2005)
  31. The midseventies SHARE survey by an IBM user group
  32. Technical Note - IMS celebrates thirty years as an IBM product
  33. CICS: 35 Years - 1960s
  34. "Linking Applications to Adabas". Archived from the original on May 22, 2008. Retrieved July 8, 2008. lists the major 1970s-1980s TP monitors
  35. Hugo, I. (November 15, 1989). "Metier the model, but few followed - UK software industry". Software Magazine. Retrieved July 8, 2008.
  36. History of IBM Deutschland Entwicklung GmbH - 1960s
  37. IBM 360/370/3090/390 Model Numbers
  38. "System/370 Announcement". IBM. June 30, 1970.
  39. "DPD chronology (1970–1974)". IBM. DPD = Data Processing Division, which was responsible for IBM's medium and large systems.
  40. Pugh, E.W., Johnson, L.R. and Palmer, J.H. (1991). IBM's 360 and Early 370 Systems. MIT Press. ISBN 0-262-16123-0.
  41. About VSE - 1980s
  42. About VSE - 1990s
  43. IBM Corporation (January 1976). IBM System/370 Special Real Time Operating System Programming RPQ Z06751 Description and Operation Manual (PDF).
  44. 3033 Technical press release
  45. MVS, OS/390, z/OS operating system
  46. Creasy, R. J. (1981). "The Origin of the VM/370 Time-Sharing System". IBM Journal of Research and Development 25 (5): 483–490. doi:10.1147/rd.255.0483.
  47. Seawright, L. H.; MacKinnon, R. A. (1979). "VM/370—A study of multiplicity and usefulness". IBM Journal of Research and Development 18 (1): 4–17. doi:10.1147/sj.181.0004.
  48. 370/Extended Architecture/Interpretive Execution. IBM. SA22-7095.
  49. Osisek, D.L., Jackson, K.M., and Gum, P.H. (March 1991). "ESA/390 interpretive-execution architecture, foundation for VM/ESA - technical". IBM Systems Journal. doi:10.1147/sj.301.0034.

Further reading

This article is issued from Wikipedia - version of the Friday, April 08, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.