Fred Brooks

Fred Brooks (Frederick Phillips Brooks Jr.; April 19, 1931 to November 17, 2022) was an American computer scientist who led the development of the IBM System/360 computer family, founded the computer science department at the University of North Carolina at Chapel Hill (UNC), and for several decades directed UNC research in interactive 3D computer graphics and virtual reality. He received the ACM A.M. Turing Award in 1999 for contributions to computer architecture, operating systems and software engineering, and wrote The Mythical Man-Month (1975).

In VR and haptics, Brooks is known for Project GROPE, a force-feedback molecular docking effort that UNC began in 1967; for the Walkthrough project, first described in 1986, which let users explore architectural models of buildings before they were built; and for his 1999 survey "What's Real About Virtual Reality?", which concluded that VR had moved from "almost works" to "barely works". The IEEE Visualization and Graphics Technical Committee (VGTC) gave him its Virtual Reality Career Award in 2010; the award has been called the VR Lifetime Achievement Award since 2022.

Reviewed 4 October 2026. Biography, education, IBM and UNC roles, honors and death checked against the ACM Turing page, NYT obituary, UNC memorial and 2008 building notice, VGTC citation; GROPE, Walkthrough, presence studies and the 1999 CG&A survey checked against the original papers and NSF report. About review dates.

Early life and education

Brooks was born in Durham, North Carolina, the eldest of three boys; his father was a physician and his mother, Octavia (Broome) Brooks, was a homemaker. He grew up in Greenville, North Carolina. He earned an AB in physics from Duke University in 1953, then studied in Harvard University's early computing program, receiving an SM in 1955 and a PhD in 1956. His doctoral adviser was Howard Aiken, designer of the Harvard Mark I. He married Nancy Greenwood, whom he met at Harvard, in 1956.

Career

IBM

Brooks joined IBM in 1956 and worked there until 1965. He helped design the Stretch and Harvest supercomputers and was later IBM's corporate project manager for the System/360, covering both the hardware family and the Operating System/360 software. IBM announced the System/360 in April 1964 as a family of six compatible computers. Lessons from the OS/360 effort became The Mythical Man-Month: Essays on Software Engineering, the source of "Brooks's law": "Adding manpower to a late software project makes it later."

University of North Carolina

In 1964 Brooks founded UNC's computer science department, which became the second free-standing, doctorate-granting computer science department in the United States. He chaired it for 20 years, led a research group in interactive computer graphics and virtual environments, and retired in 2015 after 51 years at the university. He held the title of Kenan Professor of Computer Science. According to his 2010 VGTC award biography, his team worked on molecular graphics from 1965 to 1999, on scientific visualization and manipulation from 1965, and on virtual environments from 1970, in collaboration with Henry Fuchs, Dinesh Manocha and Mary C. Whitton; he had advised 37 PhD graduates by then. UNC's 2022 memorial notice put the number of students who completed doctorates with him as principal adviser at more than 40. In the New York Times obituary, Fuchs said Brooks saw computer scientists as "toolsmiths", tool builders who help others do their jobs better. Brooks had argued this position in print in "The Computer Scientist as Toolsmith II" (Communications of the ACM, March 1996).

Virtual reality and haptics research

Project GROPE

The 1990 GROPE paper says UNC's graphics program was stimulated by Ivan Sutherland's 1965 vision of "The Ultimate Display", which included seeing, hearing and feeling in a virtual world. The group chose molecular graphics as its driving problem and in 1967 started Project GROPE to build a haptic display for molecular forces. The work proceeded in stages:

System	Description
GROPE-I	A 2-D system that displayed continuous force fields.
GROPE-II	Used master stations from Model E-3 Argonne Remote Manipulators, obtained through Argonne National Laboratory manipulator designer Ray Goertz, with the computer standing in for the manipulator's slave arm. It rendered hard-surface forces in three translational degrees of freedom. An IBM System/360 Model 75 could compute forces in real time only for a table top, seven children's blocks and the manipulator tongs, so the team set the arm aside until more computing power was available.
GROPE-IIIA	The full 6-D GROPE-III system (three forces, three torques) was begun in 1986 on VAX computers; its first tests, called GROPE-IIIA, came in 1988 with a rod hung in space by springs.
GROPE-IIIB	A full molecular force-field evaluator for drug docking, driven by a dedicated Sun-4.

Brooks presented the results with Ming Ouh-Young, James J. Batter and P. Jerome Kilpatrick at SIGGRAPH '90 in Dallas. The authors reported that haptic display added to a visual display improved perception of force fields and of worlds containing impenetrable objects. The largest gains they measured were 2.2 times in a simple manipulation task and 1.7 times in 6-D molecular docking. Chemists using GROPE-III reproduced known docking positions and found good docks for drugs whose positions were unknown. The paper also predicted that entertainment, not scientific visualization, would drive and pace haptic technology. His 2010 VGTC citation states that the demands of molecular modeling and docking led to many innovations in 3D interaction, especially haptic feedback.

In a 1988 CHI paper, "Grasping Reality Through Illusion", Brooks called for interfaces to scientific computations that were direct-manipulation, interactive, 3D and multisensory. He also proposed a "shells-of-certainty" model for reporting research findings about 3D interfaces.

Walkthrough

Brooks described the Walkthrough project at the 1986 Workshop on Interactive 3D Graphics in Chapel Hill. Its aim was to let an architect and client "walk through" a building that had been designed but not yet built, much as flight simulators fly over virtual terrain. The first prototype modeled UNC's new computer science building (Sitterson Hall) with about 8,000 polygons. Running binary space partitioning software on an Adage Ikonas, it produced a shaded perspective view every 3 to 5 seconds, while the user steered a cursor in real time over a floor plan on a Vector General 3300 display. The department used it in discussions with its architects, O'Brien and Atkins, particularly over the lobby layout and balcony width. A third version on Fuchs's Pixel-Planes hardware reached 9 updates per second on a 4-by-6-foot projected image.

The project's 1992 final report to the National Science Foundation, with Brooks as principal investigator, covered six generations of the system. The team modeled Sitterson Hall, the fellowship hall and Sunday school wing of Orange United Methodist Church, and a planned remodeling of the Brooks house, all before construction. Walkthrough 5.2 rendered 25 stereo frames per second on 30,000-polygon models with radiosity lighting, textures and location sounds. Users wore a stereo head-mounted display and walked within a 12-by-10-foot area tracked by UNC's ceiling tracker, which used 960 ceiling-mounted beacons. A non-motorized treadmill fitted with bicycle handlebars served as an alternative way to walk; the report found it realistic but too slow and tiring for exploring large models. The report named as its most important lesson that many technical tasks become much more difficult with models of meaningful complexity, consisting of tens of thousands of primitive elements, and compared building and maintaining such a model to building and maintaining a program of similar size.

Presence and locomotion studies

Brooks co-authored several UNC studies of presence. "Walking > Walking-in-Place > Flying, in Virtual Environments" (SIGGRAPH 99), written with Martin Usoh, Kevin Arthur, Mary Whitton, Rui Bastos, Anthony Steed and Mel Slater, repeated a study by Slater and colleagues and added real walking as a third condition. Real walking scored best for ease of locomotion. Walking-in-place and real walking both produced more subjective presence than flying, and presence correlated with how strongly subjects associated with their avatars.

In "Physiological Measures of Presence in Stressful Virtual Environments" (SIGGRAPH 2002), Michael Meehan, Brent Insko, Mary Whitton and Brooks compared reactions in an ordinary virtual training room with an adjacent "pit room", whose floor opened onto a room 20 feet below. Change in heart rate met their criteria for a presence measure, skin conductance did so to a lesser degree, and skin temperature did not. Adding a physical 1.5-inch wooden ledge at the edge of the virtual pit (passive haptics) significantly increased presence, and presence rose with frame rate (30 > 20 > 15 frames per second). His 2010 award biography summarizes the group's pit studies as showing that latency matters a lot and photorealism very little.

"What's Real About Virtual Reality?"

In a public lecture in London on 30 November 1994, "Is There Any Real Virtue in Virtual Reality?", Brooks judged that VR "almost worked". In 1999 the Office of Naval Research funded him to visit major VR centers in North America and Europe for an updated assessment, much of which he gave as a keynote address at the Virtual Reality 99 conference and published in IEEE Computer Graphics and Applications. He defined a VR experience as "any in which the user is effectively immersed in a responsive virtual world", which implies user control of viewpoint. He counted more than 10 and fewer than 100 production installations as of March 1999, leaving out vehicle simulators and entertainment, and concluded: "VR that used to almost work now barely works. VR is now really real."

The survey named end-to-end system latency as the most serious technical shortcoming of VR systems. It noted that 150 to 500 ms of latency makes the scene "swim" in head-mounted displays, and cited UNC research finding that, for a cranio-facial surgeon's head motions, each millisecond of latency produced up to one millimeter of registration error in augmented reality. The applications he described included vehicle simulation; he called an hour flying a 747 flight simulator at British Airways' Heathrow facility "the best VR I have ever experienced". He also described vehicle ergonomics and design at Daimler-Chrysler, submarine design review at Electric Boat, NASA astronaut training, psychiatric treatment developed by Georgia Tech and Emory University researchers (including fear-of-flying therapy and post-traumatic stress disorder treatment for Vietnam War veterans), and UNC's nanoManipulator interface for probe microscopes, led by Russell Taylor and Richard Superfine. The open challenges he listed were latency, real-time rendering of models over one million polygons, choosing among head-mounted, CAVE, workbench and panorama displays, satisfactory haptic augmentation, interaction and wayfinding, efficient model building, and measuring presence.

Honors

Year	Honor
1976	Member, National Academy of Engineering
1985	National Medal of Technology
1993	IEEE John von Neumann Medal
1997	CyberEdge Journal Sutherland Award
1999	ACM A.M. Turing Award, "for landmark contributions to computer architecture, operating systems, and software engineering"
2001	Member, National Academy of Sciences; Fellow, Computer History Museum
2004	ACM/IEEE Eckert-Mauchly Award
2010	IEEE VGTC Virtual Reality Career Award, "for his lifetime contributions to virtual reality research and practice"

In 2008 UNC dedicated the Frederick P. Brooks Jr. Computer Science Building, a four-story, 30,000-square-foot addition connected to Sitterson Hall. At the time UNC described his work as real-time 3D graphics, or virtual environments, that had helped biochemists solve the structure of complex molecules and let architects walk through buildings still under design.

Death

Brooks died at his home in Chapel Hill on November 17, 2022, at age 91. His son Roger said he had been in declining health since a stroke two years earlier. In the New York Times obituary, Stanford professor and Turing Award recipient Patrick Hanrahan said that "the impact of his work in computer graphics was enormous".

See also

• Ivan Sutherland
• Henry Fuchs
• Haptics
• Presence
• History of virtual reality