# The HCI Golden Age Wiki A research compendium for a digital museum of cutting-edge Human-Computer Interaction from the late 1970s through the early 1990s. These ninety projects mix canonical experiments with weird, forgotten, and beautiful vaporware — brain control, voice control, gesture, wearable computing, VR, robots, and full-body exertion. Each entry includes an overview, a deep dive, a small media gallery, and full source links so the images and facts can always be traced back. --- ## Table of Contents 1. [Hubot (c. 1983)](#hubot-c-1983) 2. [The P300 Speller (1988)](#the-p300-speller-1988) 3. [VPL Research EyePhone & DataGlove (1980s)](#vpl-research-eyephone--dataglove-1980s) 4. [Put-That-There (1980)](#put-that-there-1980) 5. [VIDEOPLACE / Artificial Reality (1970s–80s)](#videoplace--artificial-reality-1970s80s) 6. [Nintendo Power Glove (1989)](#nintendo-power-glove-1989) 7. [Olivetti Active Badge (1992)](#olivetti-active-badge-1992) 8. [The Digital Desk (1991)](#the-digital-desk-1991) 9. [Atari Mindlink (1984)](#atari-mindlink-1984) 10. [Texas Instruments Speak & Spell (1978)](#texas-instruments-speak--spell-1978) 11. [Kurzweil Reading Machine (1976)](#kurzweil-reading-machine-1976) 12. [Virtuality Arcade VR System (1990)](#virtuality-arcade-vr-system-1990) 13. [Steve Mann's EyeTap / Wearable Computing (1980s)](#steve-manns-eyetap--wearable-computing-1980s) 14. [Mandala / The Vivid Group Gesture VR System (1986)](#mandala--the-vivid-group-gesture-vr-system-1986) 15. [Handykey Twiddler Chord Keyboard (1992)](#handykey-twiddler-chord-keyboard-1992) 16. [GRiDPad 100 (1989)](#gridpad-100-1989) 17. [Heathkit HERO 1 (1982)](#heathkit-hero-1-1982) 18. [HP-150 Touchscreen (1983)](#hp-150-touchscreen-1983) 19. [KoalaPad (1984)](#koalapad-1984) 20. [Microwriter (1980)](#microwriter-1980) 21. [Nintendo D-pad controller (1985)](#nintendo-d-pad-controller-1985) 22. [Polhemus 3Space Isotrak (1987)](#polhemus-3space-isotrak-1987) 23. [Poqet PC (1989)](#poqet-pc-1989) 24. [Psion Organiser II (1986)](#psion-organiser-ii-1986) 25. [Summagraphics Bit Pad (1977)](#summagraphics-bit-pad-1977) 26. [WriteHander (1978)](#writehander-1978) 27. [Fairlight CMI (1979)](#fairlight-cmi-computer-musical-instrument-1979) 28. [Konami LaserScope (1990)](#konami-laserscope-1990) 29. [NES Power Pad (1988)](#nes-power-pad-family-trainer--family-fun-fitness-1988) 30. [Amiga Joyboard (1983)](#amiga-joyboard-1983) 31. [GROPE-III (1990)](#grope-iii-1990) 32. [Nintendo Hands Free Controller (1989)](#nintendo-hands-free-controller-1989) 33. [DLR Control Ball (1981)](#dlr-control-ball-spacemouse-1981) 34. [DragonDictate (1989)](#dragondictate-1989) 35. [EyeTyper (1983)](#eyetyper-1983) 36. [BioMuse (1990)](#biomuse-1990) 37. [Etak Navigator (1985)](#etak-navigator-1985) 38. [Nintendo R.O.B. (Robotic Operating Buddy) (1985)](#nintendo-rob-robotic-operating-buddy-1985) 39. [Private Eye (1989)](#private-eye-1989) 40. [Radio Drum / Radio Baton (c. 1987)](#radio-drum--radio-baton-c-1987) 41. [Broderbund U-Force (1989)](#broderbund-u-force-1989) 42. [Buchla Lightning (1991)](#buchla-lightning-1991) 43. [Fakespeare BOOM (Binocular Omni-Orientation Monitor) (1989)](#fakespeare-boom-binocular-omni-orientation-monitor-1989) 44. [Seiko RC-1000 Wrist Terminal (1984)](#seiko-rc-1000-wrist-terminal-1984) 45. [Barcode Battler (1991)](#barcode-battler--1991) 46. [Talking Glove (1988–1991)](#talking-glove--the-talkingglove-19881991) 47. [Performance-Driven Facial Animation (1990)](#performance-driven-facial-animation-1990) 48. [Convolvotron (1988)](#convolvotron-1988) 49. [HeadMaster (1986)](#headmaster-1986) 50. [VPL DataSuit (1989)](#vpl-datasuit-1989) 51. [Minsky Sandpaper / Computational Haptics Sandpaper System (1990)](#minsky-sandpaper--computational-haptics-sandpaper-system-1990) 52. [Quantel Paintbox (1981)](#quantel-paintbox-1981) 53. [Tongue Touch Keypad (TTK) / Tongue Activated Communications Controller (1991)](#tongue-touch-keypad-ttk--tongue-activated-communications-controller-1991) 54. [Aesthedes (1984)](#aesthedes-1984) 55. [RDI Halcyon (1985)](#rdi-halcyon-1985) 56. [Talking Signs / Remote Infrared Audible Signage (RIAS) (1979)](#talking-signs--remote-infrared-audible-signage-rias-1979) 57. [Canon Cat (1987)](#canon-cat-1987) 58. [Puma RS Computer Shoes (1985)](#puma-rs-computer-shoes-1985) 59. [VersaBraille (1979)](#versabraille-1979) 60. [MBX Expansion System (1983)](#mbx-expansion-system-1983) 61. [The Drawing Prism (1985)](#the-drawing-prism-1985) 62. [DataHand Keyboard (1990)](#datahand-keyboard-1990) 63. [Pencept PenPad (1982)](#pencept-penpad-1982) 64. [Synapse Relax Stress Reduction System (1984)](#synapse-relax-stress-reduction-system-1984) 65. [Exciting Boxing Controller (1987)](#exciting-boxing-controller-1987) 66. [Interactive Brainwave Visual Analyzer (IBVA) (1991)](#interactive-brainwave-visual-analyzer-ibva-1991) 67. [CAVE Automatic Virtual Environment (1992)](#cave-automatic-virtual-environment-1992) 68. [Virtual Fixtures (1992)](#virtual-fixtures-1992) 69. [Vectrex 3D Imager (1983)](#vectrex-3d-imager-1983) 70. [Soundbeam (1984)](#soundbeam) 71. [Hard Drivin' / Race Drivin' (1989)](#hard-drivin--race-drivin-1989) 72. [Cauzin Softstrip Reader (1985)](#cauzin-softstrip-reader-1985) 73. [Reading Electropalatography (EPG) System (1978)](#reading-electropalatography-epg-system-1978) 74. [SynthAxe (1985)](#synthaxe-1985) 75. [Sega Hang-On (1985)](#sega-hang-on-1985) 76. [CMU Sensor Frame (1985)](#cmu-sensor-frame-1985) 77. [UPIC (Unité Polyagogique Informatique CEMAMu) (1977)](#upic-unité-polyagogique-informatique-cemamu-1977) 78. [AtariLab (1983)](#atarilab-1983) 79. [SGI Dial and Button Box (1986)](#sgi-dial-and-button-box-1986) 80. [Sega R360 (1990)](#sega-r360-1990) 81. [Akai EWI 1000 (1987)](#akai-ewi-1000-1987) 82. [Armatron (1984)](#armatron-1984) 83. [Big Trak (1979)](#big-trak-1979) 84. [Logitech ScanMan (1987)](#logitech-scanman-1987) 85. [BAT Keyboard (1990)](#bat-keyboard-1990) 86. [NTT ClearBoard-1 (1991)](#ntt-clearboard-1-1991) 87. [Xerox LiveBoard (1990)](#xerox-liveboard-1990) 88. [Butler in a Box (1983)](#butler-in-a-box-1983) 89. [Gibson Light Pen System / LPS II (1981)](#gibson-light-pen-system-lps-ii-1981) 90. [Versatron Footmouse (1985)](#versatron-footmouse-1985) --- ## Hubot (c. 1983) **By:** Hubotics Inc. **Tags:** `Robot` `Voice` `Home Computer` `CES` `Assistive/Companion` ### Overview Hubot was a butler-esque personal home robot developed by California startup Hubotics Inc. Marketed as a companion, educator, entertainer and sentry, it combined a wheeled mobile robot with a voice synthesizer, an on-board computer, a TV/monitor, an Atari 2600 game console, and ultrasonic obstacle sensing. Sources disagree on the exact year: the Science Photo Library and CNET caption it as 1981, while a detailed hardware retrospective dates the company’s formation and CES debut to 1984. It is best treated as an early-1980s project. ### Deep dive * **Origins and team.** Hubotics Inc. was a small Carlsbad, California startup formed to build a personal home robot named Hubot. Mechanical/graphic designer Glen Keith hand-built early prototypes in his home, carving the rotating sensor head from plastic and fiberglass. * **Hardware.** Hubot stood roughly 1.10 m tall and moved on wheels. It contained a proprietary CP/M-class computer (one source names SysCon), a monochrome monitor, a detachable keyboard, printer support, joystick control, a 12-inch display, a TV tuner, a cassette deck and an Atari 2600. * **Sensing and speech.** A Polaroid-style ultrasonic transducer mounted on a rotating collar scanned the room for obstacles before movement. An optional voice-command module with a built-in microphone allowed limited spoken control; the voice synthesizer could speak about 1,200 words in English. * **Launch and price.** The robot was demonstrated at the January 1984 Consumer Electronics Show (CES). It was priced at US$3,495 (well over US$10,000 in 2026 dollars). Planned optional modules included a fire/burglar alarm, a robotic arm, a drink tray, a vacuum unit, route programming, and autonomous recharging. * **Commercial fate.** The project was too expensive and too far ahead of its ecosystem to succeed at scale. Production estimates vary; one Reddit post claims roughly 75 units were made, but this is a single-source figure and should be treated cautiously. * **Weird / fun facts.** Hubot’s body was rotomolded in polyethylene — the same material used for trash cans and water tanks — because it was cheap, rugged and still looked good after scratches. Its head used the same sonar sensor found in Polaroid cameras. Today a Hubot is preserved in the Computer History Museum’s collection. * **Impact.** Hubot is an early, exuberant example of the 1980s personal-robot boom. It anticipated later voice-activated smart-home assistants by several decades, even if it failed commercially. ### Team * **Glen Keith** — Mechanical and graphic designer; hand-built early Hubot prototypes in Carlsbad, California, carving the rotating sensor head from plastic and fiberglass. * **Hubotics Inc.** — Carlsbad startup formed to commercialize a personal home robot. The company demonstrated Hubot at the January 1984 Consumer Electronics Show and priced it at $3,495. ### Media ![Hubot, Hubotics, c.1981/83](../assets/wiki/hubot-cnet.webp) *CNET gallery photo of Hubot, captioned “Hubot, Hubotics, 1981.” Source: [CNET](https://www.cnet.com/pictures/rise-of-the-robots-from-sci-fi-to-our-homes/)* ![Hubot hardware detail](../assets/wiki/hubot-hardware.webp) *Hardware.com.br photo showing Hubot’s display and Atari 2600 slot. Source: [Hardware.com.br](https://www.hardware.com.br/tecnologia/hubot-robo-atari-1984/)* ![Hubot being carried](../assets/wiki/hubot-sciencephoto.jpg) *Science Photo Library image of Hubot being held from behind. Source: [Science Photo Gallery](https://sciencephotogallery.com/featured/hubot-robot-volker-steger.html?product=acrylic-print)* ### Sources 1. Hardware.com.br, “O robô doméstico com Atari embutido que custava caro demais para dar certo” (2025) — https://www.hardware.com.br/tecnologia/hubot-robo-atari-1984/ 2. American Computer and Robotics Museum, “Hubot: A Personal History and Reminiscence” — https://acrmuseum.org/hubot-history 3. CNET, “Rise of the robots, from sci-fi to our homes – Hubot, Hubotics, 1981” — https://www.cnet.com/pictures/rise-of-the-robots-from-sci-fi-to-our-homes/ 4. Reddit r/cassettefuturism, “Hubot by Hubotics: A sophisticated personal household robot, c.1983” — https://www.reddit.com/r/cassettefuturism/comments/15q8sck/hubot_by_hubotics_a_sophisticated_personal/ 5. Science Photo Gallery, “Hubot Robot Acrylic Print by Volker Steger / Science Photo Library” — https://sciencephotogallery.com/featured/hubot-robot-volker-steger.html?product=acrylic-print 6. YouTube: “The Story of Hubot” (Hubotics Inc.) — https://www.youtube.com/watch?v=Je4TjjtFDNU --- ## The P300 Speller (1988) **By:** Lawrence A. Farwell & Emanuel Donchin **Tags:** `Brain Control` `BCI` `EEG` `P300` `Assistive Technology` ### Overview The P300 Speller was the first brain-computer interface (BCI) spelling system based on the P300 event-related potential (ERP). Users selected letters and numbers from a 6×6 matrix simply by focusing attention on the target; the system detected the resulting P300 brainwave and inferred the chosen character. It provided a non-muscular communication channel for people with severe motor impairments. ### Deep dive * **Publication.** Farwell and Donchin described the system in “Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials,” *Electroencephalography and Clinical Neurophysiology* 70(6):510–523, 1988. * **The P300 signal.** The P300 is a positive EEG deflection that peaks roughly 300 ms after an infrequent, attended “oddball” stimulus. In the speller, this signal is elicited whenever the row or column containing the user’s target character flashes. * **Row-column paradigm.** A 6×6 grid displays the alphabet plus digits. Rows and columns flash in random order; the user silently counts flashes that include the desired character. The row and column producing the largest P300 responses are identified, and their intersection gives the selected character. * **Performance.** The original report used a stepwise linear discriminant analysis (SWLDA) classifier, tested on four subjects, and achieved about 95% accuracy at roughly 12 bits/min information transfer rate. * **Notable experiments / demos.** Farwell and Donchin’s paper demonstrated that people could spell without any overt muscle movement. Later work introduced the checkerboard paradigm, region-based spellers, auditory/tactile variants, hybrid P300+SSVEP systems, and, most recently, LLM-augmented P300 spellers such as ChatBCI. * **Impact.** The P300 Speller established the dominant design for non-invasive visual BCI spellers and remains the reference architecture for communication BCIs used by people with ALS and locked-in syndrome. * **Weird / fun facts.** The paper’s title coined the phrase “talking off the top of your head.” Modern descendants literally pair the speller with large language models to predict words and cut the number of required selections by up to 80%. ### Team * **Lawrence A. Farwell** — Cognitive psychophysiologist and inventor; led the development of the P300 Speller and later coined the term "brain fingerprinting." * **Emanuel Donchin** — Professor of psychology at the University of Illinois at Urbana-Champaign; Farwell's advisor and co-author of the 1988 paper that established the row-column P300 speller. * **University of Illinois at Urbana-Champaign** — The research home where the first mental-prosthesis spelling interface was developed and tested. ### Media ![P300 row-column paradigm](../assets/wiki/p300-rowcolumn.webp) *Row-column paradigm figure from the 2022 Frontiers review (open access). Source: [Frontiers in Human Neuroscience](https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2022.1077717/full)* ![First page of the 1988 P300 speller paper](../assets/wiki/p300-paper-01.png) *First page of the original Farwell & Donchin (1988) scanned paper. Source: [Farwell Brain Fingerprinting](https://www.farwellbrainfingerprinting.com/pdf/Farwell-Donchin-1988-Talking-Off-the-Top-of-Your-Head-BCI-brain-computer-interface.pdf)* ### Sources 1. Farwell, L. A. & Donchin, E. (1988). “Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials.” PDF — https://www.farwellbrainfingerprinting.com/pdf/Farwell-Donchin-1988-Talking-Off-the-Top-of-Your-Head-BCI-brain-computer-interface.pdf 2. Sapien Labs, “Implementations of the P300 BCI Speller” — https://sapienlabs.org/implementations-of-the-p300-bci-speller/ 3. Pan, J. et al. (2022). “Advances in P300 brain–computer interface spellers: toward paradigm design and performance evaluation.” *Frontiers in Human Neuroscience* 16:1077717 — https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2022.1077717/full 4. IEEE Brain on X, ChatBCI pairing P300 speller with LLMs — https://x.com/IEEEBrain/status/2026003399527813560 5. YouTube: “The P300 Speller: ‘Talking off the Top of Your Head’” — https://www.youtube.com/watch?v=FllhWvw8mfk --- ## VPL Research EyePhone & DataGlove (1980s) **By:** Jaron Lanier, Thomas G. Zimmerman and colleagues at VPL Research **Tags:** `VR` `Gesture` `Wearables` `HMD` `Commercial VR` ### Overview VPL Research, founded by Jaron Lanier in 1984, was one of the first companies to develop and sell virtual-reality products. Its best-known devices were the DataGlove wired glove, the EyePhone head-mounted display, the DataSuit full-body suit, and the “Reality Built for Two” shared-VR system. Lanier is widely credited with popularizing the term “virtual reality.” ### Deep dive * **Company.** VPL stood for “Virtual Programming Languages.” The company was founded in Palo Alto by Lanier and Thomas G. Zimmerman after they left Atari; early funding came in part from Marvin Minsky. VPL filed for bankruptcy in 1990, and its patents were bought by Sun Microsystems in 1998/1999. * **DataGlove.** Zimmerman invented the optical-fiber glove. It used 6502 microcontrollers and fiber-optic bundles along the fingers to track hand posture and orientation, letting users manipulate virtual objects. VPL later licensed the technology to Mattel, which turned it into the Nintendo Power Glove (1989), a US$90 holiday hit that sold roughly 1.3 million units. * **EyePhone.** Released in June 1989, the EyePhone was a head-mounted display with Fresnel lenses that tracked head orientation. Because 1980s graphics hardware could manage only about five to six frames per second, the experience was crude, and a full EyePhone system cost upwards of US$250,000, keeping it firmly in research and trade-show territory. * **DataSuit and RB2.** The DataSuit extended full-body motion capture. “Reality Built for Two” (RB2) let two people share a virtual world, making it an early commercial networked-VR system. * **Weird / fun facts.** In a 1988 description Lanier imagined a “Home Reality Engine” that plugged into the phone jack; users could choose to inhabit a cat, a mountain range, a galaxy, or even a piano. The DataGlove’s affordable consumer descendant, the Power Glove, became “one of the hottest gift items of the 1989 holiday season” but disappointed gamers because it lacked supported software. * **Impact.** VPL’s products defined the visual vocabulary of 1990s VR, influenced films such as *The Lawnmower Man*, and laid the commercial groundwork for today’s HMDs and hand-tracking controllers. ### Team * **Jaron Lanier** — Musician, computer scientist, and founder of VPL Research; widely credited with popularizing the term "virtual reality." * **Thomas G. Zimmerman** — Engineer and artist; invented the optical-fiber DataGlove and co-founded VPL with Lanier after the two met at Atari. * **VPL Research** — Palo Alto startup founded in 1984 to commercialize virtual-reality products. It filed for bankruptcy in 1990; its patents were later acquired by Sun Microsystems. * **Marvin Minsky** — MIT AI pioneer who served as an early advisor to VPL and helped shape its scientific ambitions. ### Media ![VPL DataSuit](../assets/wiki/vpl-datasuit.jpg) *VPL Research DataSuit on display (Wikimedia Commons). Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/VPL_Research)* ![EyePhone and DataGlove demo, 1989](../assets/wiki/vpl-eyephone-demo.jpg) *Two people demonstrating EyePhone and DataGlove at the Texpo Telecommunications Show, San Francisco, June 1989. Source: [Flashbak](https://flashbak.com/jaron-laniers-eyephone-head-and-glove-virtual-reality-in-the-1980s-26180/)* ![Jaron Lanier](../assets/wiki/vpl-jaron-lanier.jpg) *Jaron Lanier, VPL co-founder. Source: [Flashbak](https://flashbak.com/jaron-laniers-eyephone-head-and-glove-virtual-reality-in-the-1980s-26180/)* ### Sources 1. Wikipedia, “VPL Research” — https://en.wikipedia.org/wiki/VPL_Research 2. Wikipedia, “Jaron Lanier” — https://en.wikipedia.org/wiki/Jaron_Lanier 3. Mental Floss, “An Oral History of Nintendo’s Power Glove” — https://www.mentalfloss.com/article/91939/losing-their-grip-oral-history-nintendos-power-glove 4. Flashbak, “Jaron Lanier’s EyePhone: Head And Glove Virtual Reality In The 1980s” — https://flashbak.com/jaron-laniers-eyephone-head-and-glove-virtual-reality-in-the-1980s-26180/ 5. VR & AR Wiki, “VPL EyePhone” — https://vrarwiki.com/wiki/VPL_EyePhone 6. YouTube: “1990s Jaron Lanier Presents VPL Virtual Reality Glove” — https://www.youtube.com/watch?v=E1q9zDSAQEw --- ## Put-That-There (1980) **By:** Richard A. Bolt, Chris Schmandt & Eric A. Hulteen, MIT Architecture Machine Group **Tags:** `Voice` `Gesture` `Multimodal` `Graphics Interface` ### Overview “Put-That-There” was a pioneering voice-and-gesture system demonstrated at MIT’s Architecture Machine Group (a predecessor to the Media Lab). A user could create and rearrange simple graphics on a large video display by speaking naturally while pointing — for example, saying “Put that there” and indicating the object and destination with hand gestures. The system compensated for imperfect speech recognition by combining redundant input channels, context, and speech-based feedback. ### Deep dive * **Publication.** The work was presented at SIGGRAPH ’80 as “Put-that-there: Voice and gesture at the graphics interface.” MIT’s Media Lab publication page also hosts the paper PDF. * **Design philosophy.** The project explicitly assumed that speech-recognition hardware would never be 100% accurate. To raise “effective accuracy,” it combined voice, gesture, syntax, semantics, context-sensitive interpretation, immediate visual feedback, and spoken clarification questions. * **Interaction.** Users referred to objects and locations deictically: “Create a blue square there,” “Put that below that,” etc. The system asked aloud when input was ambiguous, making the conversation loop visible and correctable. * **Notable demos.** The canonical demo shows a user moving colored shapes around a large-format screen using only voice and pointing, anticipating the multimodal interfaces now common in phones, cars, and AR/VR systems. * **Impact.** Put-That-There is a foundational reference for multimodal HCI. It inspired decades of research on gesture+speech input and is still revisited today; a 2025 arXiv paper proposes “Revisiting put-that-there” for modern head-mounted displays using large language models. * **Weird / fun facts.** The project’s very name became shorthand for the entire genre of multimodal, deictic interaction. The phrase has outlived the specific hardware by more than four decades. ### Team * **Richard A. Bolt** — Researcher at MIT's Architecture Machine Group; principal author and visionary behind the voice-and-gesture interface. * **Chris Schmandt** — Longtime MIT speech and audio-interface researcher; co-author of the SIGGRAPH '80 paper. * **Eric A. Hulteen** — Co-author of the "Put-that-there" paper, contributing to the system's implementation and evaluation. * **MIT Architecture Machine Group** — The precursor to the MIT Media Lab, where multimodal interaction was explored as a way to compensate for imperfect speech recognition. ### Media ![Put-That-There SIGGRAPH '80 title page](../assets/wiki/put-that-there-paper-1.png) *Title page of the scanned SIGGRAPH ’80 paper. Source: [MIT Media Lab](https://dam-prod.media.mit.edu/uuid/8e6d934b-6c6f-48e4-b0a1-270e0dae745f)* ![Put-That-There demo thumbnail](../assets/wiki/put-that-there-video.jpg) *YouTube thumbnail from the original demo recording. Source: [YouTube](https://www.youtube.com/watch?v=RyBEUyEtxQo)* ### Sources 1. MIT Media Lab, “Put-that-there: Voice and gesture at the graphics interface” — https://www.media.mit.edu/publications/put-that-there-voice-and-gesture-at-the-graphics-interface/ 2. MIT Media Lab PDF of the paper — https://dam-prod.media.mit.edu/uuid/8e6d934b-6c6f-48e4-b0a1-270e0dae745f 3. Du, R., “‘Put-That-There’: Voice and Gesture at the Graphics Interface” citation page — https://duruofei.com/cites/Bolt1980Put.html 4. YouTube: “Put That There (Original)” — https://www.youtube.com/watch?v=RyBEUyEtxQo --- ## VIDEOPLACE / Artificial Reality (1970s–80s) **By:** Myron Krueger **Tags:** `Gesture` `Artificial Reality` `Interactive Art` `Computer Vision` `Telepresence` ### Overview VIDEOPLACE was an interactive “artificial reality” environment created by Myron Krueger beginning in the mid-1970s. Users in separate rooms stood before large projection screens and video cameras; their live silhouettes were digitized, colored, and placed into a shared virtual space where they could interact with computer graphics and with each other — all without headsets, gloves, or other worn equipment. ### Deep dive * **Origins.** Krueger established the Videoplace laboratory in the mid-1970s, first at the University of Wisconsin and later at the University of Connecticut. It grew out of earlier installations: GLOWFLOW (1969), METAPLAY (1975), and PSYCHIC SPACE. * **No-wearable philosophy.** Krueger deliberately avoided goggles and gloves. His goal was an artificial reality that surrounded users and responded to their natural body movements. * **Technology.** The first 1975 environment used no computer; by 1984 Krueger had built a custom real-time system that performed image recognition, image analysis, and graphical response fast enough for live interaction. Projectors, cameras, special-purpose hardware, and software produced colored user silhouettes and 25 different interaction programs. * **Notable experiments / demos.** Users could push, pull, or play with virtual creatures and objects. Because they saw their silhouettes on screen, they experienced social presence: people instinctively pulled away when their silhouettes intersected with another person’s. * **Legacy.** The work formed the basis of Krueger’s influential 1983 book *Artificial Reality*. VIDEOPLACE is now on permanent display at the State Museum of Natural History at the University of Connecticut. * **Weird / fun facts.** Krueger’s team admitted they never achieved their ultimate goal of a program that could learn independently. The project is usually styled VIDEOPLACE in all caps. * **Impact.** VIDEOPLACE pioneered camera-based full-body interaction, shared virtual spaces, and unencumbered embodied interfaces. It is a direct ancestor of modern depth-camera installations, motion-controlled games, and social VR. ### Team * **Myron Krueger** — Artist and computer scientist; created VIDEOPLACE and the concept of "artificial reality," deliberately avoiding headsets and gloves. * **University of Wisconsin** — Hosted Krueger's early Videoplace laboratory in the mid-1970s. * **University of Connecticut** — Home of the later Videoplace lab and the permanent installation now at the State Museum of Natural History. ### Media ![Videoplace still](../assets/wiki/videoplace-mediaartnet.jpg) *Myron Krueger, *Videoplace*, 1974 video still. Source: [Media Art Net](http://www.medienkunstnetz.de/works/videoplace/)* ![Videoplace 1989 demo thumbnail](../assets/wiki/videoplace-video.jpg) *YouTube thumbnail from “Myron Kreuger – Video Place – 1989.” Source: [YouTube](https://www.youtube.com/watch?v=dqZyZrN3Pl0)* ### Sources 1. Wikipedia, “Videoplace” — https://en.wikipedia.org/wiki/Videoplace 2. Media Art Net, “Krueger, Myron: Videoplace” — http://www.medienkunstnetz.de/works/videoplace/ 3. YouTube: “Myron Kreuger – Video Place – 1989” — https://www.youtube.com/watch?v=dqZyZrN3Pl0 4. YouTube: “Video Place Examples – Myron Kreuger (c.1989)” — https://www.youtube.com/watch?v=XrQaXKKoTjY 5. Ars Electronica Archive entry on Videoplace — http://archive.aec.at/#23842 6. HandWiki, “Artificial Reality” — https://handwiki.org/wiki/Artificial_Reality --- ## Nintendo Power Glove (1989) **By:** Abrams/Gentile Entertainment / Mattel (technology licensed from VPL Research) **Tags:** `Gesture` `Wearable` `Gaming` `Motion Control` `Virtual Reality` ### Overview The Power Glove was an officially licensed, third-party controller accessory for the Nintendo Entertainment System (NES). Marketed as a futuristic, gesture-based way to play games, it tracked hand position and finger bending and mapped them to NES inputs. It sold strongly at launch — around one million units in North America and roughly 1.3 million worldwide including Japan — but was widely criticized for imprecise controls, difficult calibration, and a lack of dedicated software. Today it is remembered as both a famous flop and an early mass-market experiment in wearable motion control. ### Deep dive * **Background.** The Power Glove originated outside Nintendo. Abrams/Gentile Entertainment (AGE) licensed technology from VPL Research. VPL’s DataGlove was a high-end research instrument used by NASA and others, costing around $10,000. AGE, together with Mattel as manufacturer, aimed to produce a consumer version for the NES boom. Mattel engineers had roughly nine months to shrink a $10,000 lab device into a toy with about $26 worth of parts. * **Technical details.** The glove was worn on the right hand and contained: * Conductive-ink flex sensors on four fingers (the pinky was omitted to save cost), giving roughly four positions per finger. * Ultrasonic transmitters/receivers to track hand roll and position in 3D space. * A keypad on the forearm with traditional NES buttons plus programmable buttons 0–9. * A serial connection to the NES. * **Games.** Only two games were released specifically for the glove: *Super Glove Ball* and *Bad Street Brawler*. The glove appeared prominently in the 1989 film *The Wizard*, where Lucas Barton declares, “I love the Power Glove. It’s so bad.” * **Impact.** Despite its commercial failure, the Power Glove is often cited as a precursor to later motion controllers (Wii Remote, PlayStation Move, Kinect) and as an early affordable entry point for hobbyist VR experiments. 1990s VR enthusiasts used the glove with shareware such as REND386. * **Weird / fun facts.** * The design was inspired by the *RoboCop* franchise. * Mattel reportedly took 700,000 retailer orders after a CES demo where much of the on-screen action was staged with an Amiga and an actor pretending to play. * Nintendo required the glove to survive 10 million finger bends before granting its Seal of Quality. * A 2019 documentary, *The Power of Glove*, chronicles its history. ### Team * **Thomas G. Zimmerman** — VPL Research engineer who invented the original DataGlove technology licensed for the Power Glove. * **Abrams/Gentile Entertainment (AGE)** — New York toy-design firm contracted by Mattel to turn the DataGlove into a mass-market NES controller in nine months. * **Grant Goddard and Samuel Cooper Davis** — Designers at AGE credited with the industrial design and engineering of the consumer glove. * **Mattel** — Produced and marketed the Power Glove as a $90 holiday accessory, selling roughly 1.3 million units. * **Nintendo** — Licensed the glove for the NES but provided little software support, contributing to its rapid decline. ### Media ![NES Power Glove](../assets/wiki/power-glove-1.jpg) *The American NES Power Glove, showing the forearm keypad and knuckle-mounted ultrasonic sensors. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Power_Glove)* ![Power Glove promotional art](../assets/wiki/power-glove-2.jpg) *Promotional advertising imagery for the Power Glove, c. 1989. Source: [ACMI](https://www.acmi.net.au/stories-and-ideas/nintendo-nes-power-glove/)* ### Sources 1. Wikipedia, “Power Glove.” https://en.wikipedia.org/wiki/Power_Glove 2. ACMI, “The promise of the Nintendo Power Glove.” https://www.acmi.net.au/stories-and-ideas/nintendo-nes-power-glove/ 3. Jake Rossen, “An Oral History of Nintendo's Power Glove,” Mental Floss, 22 Feb 2017. https://mentalfloss.com/article/91939/losing-their-grip-oral-history-nintendos-power-glove 4. HowStuffWorks, “How the Nintendo Power Glove Worked.” https://electronics.howstuffworks.com/nintendo-power-glove.htm 5. Design News, cover story, 4 Dec 1989 (PDF via Microsoft Research/Bill Buxton collection). https://research.microsoft.com/en-us/um/people/bibuxton/buxtoncollection/a/pdf/powerglove%20design%20news%20%20article.pdf --- ## Olivetti Active Badge (1992) **By:** Roy Want, Andy Hopper, Veronica Falcão, Jonathan Gibbons — Olivetti Research Laboratory (ORL) **Tags:** `Wearable` `Location-Aware` `Ubiquitous Computing` `Context-Aware` `Infrared` ### Overview The Active Badge system was one of the first building-scale indoor location systems. Developed at the Olivetti Research Laboratory (ORL) in Cambridge, England, it let a computer system track where people were inside an office by having them wear small infrared badges. The idea pioneered “location-aware” or context-aware computing: applications could route phone calls, find colleagues, or move virtual desktops based on a person’s physical location. ### Deep dive * **Background.** The Olivetti Research Laboratory was founded in 1986 by Hermann Hauser and Andy Hopper after Olivetti acquired Acorn Computers. The Active Badge was conceived, designed, and prototyped between 1989 and 1992. * **Technical details.** * Each badge was a small wearable device that transmitted a unique infrared signal every 10 seconds. * Rooms were equipped with networked sensors that received these signals and forwarded them to a central location service. * The original badge sent a 5-bit unique code; later versions expanded to 10-bit and then 48-bit addresses, with the final version adding a microprocessor and bi-directional communication. * Because infrared signals do not pass through walls, the system could locate a badge at roughly room-level granularity. * Location information was exposed through a web service called the WWW Active Badge Service. * **Notable experiments and demos.** Deployments reached over 1,500 badges and 2,000 sensors across European universities and U.S. research labs. The largest single site was the Cambridge University Computer Laboratory, with more than 200 badges and 300 sensors in daily use. The system enabled early “follow-me” applications such as phone call forwarding and moving a user’s desktop session as they walked between rooms. * **Impact.** The Active Badge is widely cited as a foundational system for indoor localization, context-aware computing, and what later became known as sentient/ubiquitous computing. Follow-up work evolved into the Active Bat ultrasonic system and the broader Sentient Computing project. * **Weird / fun facts.** * The Active Badge was once the subject of a cartoon in a British national newspaper. * The system raised early privacy questions: wearing a badge that broadcasts your location every few seconds was a novel social concern in the early 1990s. * ORL later became AT&T Laboratories Cambridge and is also famous for developing VNC. ### Team * **Roy Want** — Researcher at Olivetti Research Ltd.; led development of the infrared Active Badge system. * **Andy Hopper** — Director of Olivetti Research Ltd. in Cambridge, UK; championed ubiquitous computing and location-aware systems. * **Olivetti Research Ltd. (ORL)** — The Cambridge lab that produced the Active Badge and explored the social implications of always-on location tracking. ### Media ![Active Badge generations](../assets/wiki/active-badge-1.gif) *Four generations of the Active Badge, showing the progression from 5-bit to 48-bit bidirectional designs. Source: [Cambridge/AT&T Active Badge archive](https://www.cl.cam.ac.uk/research/dtg/attarchive/ab.html)* ### Sources 1. Cambridge Computer Laboratory, “The Active Badge System.” https://www.cl.cam.ac.uk/research/dtg/attarchive/ab.html 2. Cambridge Computer Laboratory, “The Active Badge.” https://www.cl.cam.ac.uk/research/dtg/attarchive/thebadge.html 3. Roy Want, Andy Hopper, Veronica Falcão, Jonathan Gibbons, “The Active Badge Location System,” *ACM Transactions on Information Systems*, Jan 1992. https://www.roywant.com/cv/papers/pubs/1992-01%20(ACM%20TOIS)%20Active%20Badge.pdf 4. Wikipedia, “Olivetti Research Laboratory.” https://en.wikipedia.org/wiki/Olivetti_Research_Laboratory 5. Microsoft Research, “Location-Aware Computing Comes of Age,” *IEEE Computer*, 2004. https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/locationaware-ieeecomputer2004.pdf 6. YouTube, “The Active Badge System | ACM SIGCHI.” https://www.youtube.com/watch?v=-vQ48S1IVD4 --- ## The Digital Desk (1991) **By:** Pierre Wellner at Rank Xerox EuroPARC **Tags:** `Tangible Interface` `Augmented Reality` `Projection` `Computer Vision` `Office Work` ### Overview The Digital Desk was a research prototype created by Pierre Wellner at Rank Xerox EuroPARC in Cambridge. It augmented a normal office desk with an overhead video camera and a computer-controlled projector. The camera watched the desk surface, detected where the user was pointing (with an LED-tipped pen or stylus), and recognized paper documents placed on the desk. The projector could then overlay electronic images, controls, and text directly onto the paper, blending physical and digital work on a single surface. ### Deep dive * **Background.** Wellner’s project explored how to make the transition between paper and electronic information less awkward. Rather than forcing users to look back and forth between a physical desk and a computer screen, the Digital Desk turned the desk itself into a display and input surface. * **Technical details.** * A video camera mounted above the desk pointed down at the surface. * Image processing detected pointing (initially via an LED-tipped pen) and recognized documents. * A computer-controlled projector mounted above the desk displayed electronic objects, menus, numbers, and annotations onto the physical desk and onto paper documents. * The system required coordinate transformations between the camera, the pointing device, and the projected image. * Early image-processing work focused on adaptive thresholding to convert grayscale camera images into clean black-and-white representations of documents and handwriting. * **Notable experiments and demos.** * The “DigitalDesk Calculator” (UIST ’91) demonstrated tangible manipulation: a user could point at printed numbers on paper and the system would project a running calculation back onto the sheet. * *PaperPaint* was a freehand drawing application developed on an early Digital Desk prototype. * A CHI ’92 video, “Tactile Manipulation on a Digital Desk,” showed scenarios including sketching, note-taking, and expense calculations; the sketching segment is sometimes cited as an early instance of the multi-touch “pinch” gesture. * The EuroCODE project (1992–1995) produced *Ariel*, a DigitalDesk tailored to annotating engineering drawings. * Later work evolved into *LightWorks* and *CamWorks*, over-the-desk video-capture systems for casual scanning. * **Impact.** The Digital Desk is widely recognized as one of the first projection-based augmented-reality systems and a direct ancestor of modern tangible and augmented-reality interfaces. It influenced research in interactive surfaces, digital whiteboards, and projected augmented reality. * **Weird / fun facts.** * Wellner originally envisioned using a finger — or two fingers for certain tasks — as the pointing device, though a tablet and stylus proved more practical at the time. * Some of the famous CHI ’92 demo sequences were scripted “envisionments” because the real-time technology of 1991 could not yet fully realize the concepts. ### Team * **Pierre Wellner** — Researcher at EuroPARC and later at Rank Xerox; invented the Digital Desk, combining camera and projector to turn ordinary paper into an interactive surface. * **EuroPARC** — Xerox's European research laboratory in Cambridge, UK, where the Digital Desk prototype was built. * **Rank Xerox** — Industrial research organization supporting the work that merged physical documents with projected digital overlays. ### Media ![Digital Desk prototype](../assets/wiki/digital-desk-1.gif) *Early DigitalDesk prototype showing projected user-interface elements on the desktop surface. Source: [NAVER LABS Europe](https://europe.naverlabs.com/history/past-research/digitaldesk-to-camworks/)* ![Digital Desk CHI '92 video thumbnail](../assets/wiki/digital-desk-2.jpg) *YouTube thumbnail for “Tactile Manipulation on a Digital Desk (1991) Xerox,” the CHI ’92 video demonstration. Source: [YouTube](https://www.youtube.com/watch?v=laApNiNpnvI)* ### Sources 1. Pierre Wellner, “The DigitalDesk Calculator: Tactile Manipulation on a Desk Top Display,” *UIST ’91 Proceedings*, pp. 27–33. https://uist.acm.org/archive/html/proceedings/1991.html 2. ACM Digital Library, DOI 10.1145/120782.120785. https://dl.acm.org/doi/pdf/10.1145/120782.120785 3. Pierre Wellner, “Interacting with Paper on the DigitalDesk,” University of Cambridge Technical Report UCAM-CL-TR-330, 1994. https://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-330.pdf 4. Eindhoven University presentation slides, “The Digital Desk from Pierre Wellner in 1991.” https://rauterberg.employee.id.tue.nl/presentations/How-to-acquire-HCI-knowledge/tsld006.htm 5. NAVER LABS Europe, “DigitalDesk to CamWorks.” https://europe.naverlabs.com/history/past-research/digitaldesk-to-camworks/ 6. YouTube, “Tactile Manipulation on a Digital Desk (1991) Xerox.” https://www.youtube.com/watch?v=laApNiNpnvI 7. YouTube, “Digital Desk” by Pierre Wellner, 1991. https://www.youtube.com/watch?v=S8lCetZ_57g --- ## Atari Mindlink (1984) **By:** Atari, Inc. **Tags:** `Brain-Computer Interface` `Biofeedback` `Wearable` `Gaming` `Vaporware` ### Overview The Atari Mindlink was an unreleased controller for the Atari 2600 (and planned for Atari home computers and the 7800) that promised to let players control games with their minds. In reality it read myoneural signal voltage from forehead muscles using a headband with infrared sensors. Players moved game objects by twitching their eyebrows or forehead. The device was demonstrated at the 1984 Summer CES but was canceled after Atari’s consumer division was sold to the Tramiel family. ### Deep dive * **Background.** Atari explored biofeedback and alternative input as part of its push into novel game peripherals. The Mindlink grew out of earlier work on a biofeedback relaxation system and a project called “Bionics.” Because the medical-device market was small and carried liability concerns, Atari reworked the headband as a game controller. * **Technical details.** * The controller consisted of an elastic headband with three metal contact sensors pressed against the player’s forehead. * It detected myoneural signal voltage (electrical activity associated with muscle contraction) in the forehead muscles. * The signal was transmitted via infrared to a receiver connected to the Atari 2600 controller port. * In its basic form the device supported only “bang-bang” control: moving an object left/right or up/down based on muscle tension. * An advanced lab prototype could reportedly control almost any Atari joystick-compatible software by strapping the headband to different muscle groups. * **Notable experiments, demos, and games.** Three games were in development: *Bionic Breakthrough* (a *Breakout* clone), *Telepathy*, and *Mind Maze* (a pseudo-ESP card-guessing game). None were released. The 1984 Summer CES demo used simple Pong/Breakout-style software because the more advanced controller could not be finished in time. * **Impact.** The Mindlink is remembered as one of the earliest consumer brain–computer / biofeedback interfaces and a classic example of 1980s vaporware. It predated modern EMG-based and consumer EEG devices by decades and foreshadowed today’s interest in hands-free and thought-adjacent control. * **Weird / fun facts.** * Atari’s marketing claimed the device let you control games “with your mind,” but it actually responded to forehead muscle movement. * Testers frequently got headaches from consciously moving their eyebrows to play. * The day after the CES introduction, a representative of the Special Olympics approached Atari about developing sports software for disabled athletes; the project’s cancellation closed that opportunity. * Proposed follow-ups included attaching sensors to forehead, biceps, and thighs for five-degree “bang-bang” control — essentially a Wii-style motion controller for the late 1980s. ### Team * **Atari, Inc.** — The project was developed internally at Atari's research and engineering labs as a controller for the Atari 2600. * **Unnamed engineering team** — Individual designers are not well documented; the headband was demonstrated at the 1984 Consumer Electronics Show and canceled shortly after. ### Media ![Atari Mindlink at National Videogame Museum](../assets/wiki/atari-mindlink-1.jpg) *A Mindlink controller on display at the National Videogame Museum. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Atari_Mindlink)* ![Atari Mindlink prototype](../assets/wiki/atari-mindlink-2.jpg) *Prototype Mindlink headband and hardware shown by the Atari Museum. Source: [Atari Museum](https://atarimuseum.ctrl-alt-rees.com/videogames/consoles/2600/mindlink.html)* ### Sources 1. Wikipedia, “Atari Mindlink.” https://en.wikipedia.org/wiki/Atari_Mindlink 2. Atari Museum, “The Atari Mindlink System.” https://atarimuseum.ctrl-alt-rees.com/videogames/consoles/2600/mindlink.html 3. Atari Compendium, “MindLink.” https://www.ataricompendium.com/game_library/prototypes/vcs/mindlink.html 4. Chris Scullion, “The Atari Mindlink and other outrageous controllers,” *Computer and Video Games*, 10 Mar 2014. https://www.cvg.com/453147/blog/the-atari-mindlink-and-other-outrageous-controllers/ 5. T3, “20 Worst game accessories ever.” https://www.t3.com/features/20-worst-game-accessories-ever-1/mindlink-jpg 6. YouTube, “Atari Mindlink (Atari 2600) Commercial 1984.” https://www.youtube.com/watch?v=VgQ-nii_9OY 7. YouTube, “Anthony Jones, Atari UK; Atari Mindlink — interview.” https://www.youtube.com/watch?v=PqBuVLAEmzs --- ## Texas Instruments Speak & Spell (1978) **By:** Texas Instruments **Tags:** `Voice` `Speech Synthesis` `Educational Toy` `Handheld` `Consumer Electronics` ### Overview The Speak & Spell was an electronic educational toy that used solid-state speech synthesis to teach children spelling and pronunciation. Introduced by Texas Instruments in 1978, it was one of the first handheld electronic devices to use interchangeable ROM cartridges and one of the first consumer products to put a digital model of the human vocal tract on a single integrated circuit. It became a cultural icon, appearing in films, music, and museums, and its voice chip technology influenced later speech-synthesis applications. ### Deep dive * **Background.** Development began in 1976 at Texas Instruments, led by Paul Breedlove, with an initial budget of $25,000. It grew out of TI’s research into linear predictive coding (LPC) speech synthesis. The goal was to create a talking learning aid for children ages 7 and up. * **Technical details.** * Speech synthesis was performed by the TMC0280 chip, later known as the TI TMS5100. It used a 10th-order LPC model implemented with pipelined digital signal-processing logic. * Phoneme data were stored on a pair of 128 Kbit PMOS ROMs — at the time the largest-capacity ROMs in use. * A professional speaker recorded the words; the recordings were processed in Dallas to drastically reduce the data rate to roughly 1,000 bits per second. * The device had a small vacuum fluorescent display (VFD) capable of showing 8 characters at a time. * Power came from four C batteries or a 6-volt DC adapter. * Expansion modules plugged into a slot near the battery compartment to add word libraries and games. * **Notable experiments and games.** Built-in games included *Say It*, *Mystery Word*, *Secret Code*, and *Letter*. Cartridge expansions included *Vowel Power*, *Super Stumpers*, *Mighty Verbs*, and an *E.T. the Extra-Terrestrial* tie-in module. The toy spawned companion products: Speak & Read (1980), Speak & Math (1980), and later Super Speak & Spell models. * **Impact.** * The Speak & Spell was named an IEEE Milestone in 2009 for being the first use of a digital signal-processing IC for speech generation. * It is held in the collections of the Computer History Museum and the Smithsonian National Museum of American History. * Its synthesized voice became a staple of popular music (Kraftwerk, Depeche Mode album title *Speak & Spell*, Beck, E.T. soundtrack, etc.). * It inspired the circuit-bending community, with musicians modifying units to create strange electronic instruments. * **Weird / fun facts.** * The toy’s voice was provided by radio announcer Mitch Carr. * The 1978 American model had raised chiclet-style buttons; a 1980 redesign introduced a flat membrane keyboard. * In *E.T. the Extra-Terrestrial* (1982), a Speak & Spell is the key component of E.T.’s improvised “phone home” device. * A 2019 reissue by Basic Fun replaced the original synthesized voice with recorded dialog processed to sound synthesized and removed the cartridge slot. ### Team * **Larry Brantingham and Richard Wiggins** — Texas Instruments engineers who led development of the TMC0280 linear-predictive-coding speech synthesizer chip. * **Paul Breedlove** — Product manager and engineer who helped shape the educational toy around the new voice chip. * **Gene Frantz** — TI engineer and marketer closely associated with the product launch and later evangelism of the technology. * **Texas Instruments** — Semiconductor giant whose single-chip LPC speech model made consumer speech synthesis affordable. ### Media ![Original Speak & Spell](../assets/wiki/speak-spell-1.jpg) *An American 1978-model Speak & Spell with raised chiclet keyboard. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Speak_%26_Spell_(toy))* ![Speak & Spell in CHM timeline](../assets/wiki/speak-spell-2.jpg) *TI Speak & Spell as featured in the Computer History Museum timeline. Source: [Computer History Museum](https://www.computerhistory.org/timeline/ai-robotics/)* ### Sources 1. Wikipedia, “Speak & Spell (toy).” https://en.wikipedia.org/wiki/Speak_%26_Spell_(toy) 2. Computer History Museum, “Speak & Spell.” https://www.computerhistory.org/timeline/ai-robotics/ 3. Computer History Museum, “Graphics & Games Timeline.” https://www.computerhistory.org/timeline/graphics-games/ 4. IEEE Global History Network, “Milestones: Speak & Spell, the First Use of a Digital Signal Processing IC for Speech Generation, 1978.” http://www.ieeeghn.org/wiki/index.php/Milestones:Speak_%26_Spell,_the_First_Use_of_a_Digital_Signal_Processing_IC_for_Speech_Generation,_1978 5. Audrey Watters, “Speak & Spell: A Brief History,” Circuit Bent, 13 Mar 2020. https://circuit-bent.net/talking-teacher-circuit-bent/speak-spell-a-brief-history.html 6. Texas Instruments press release, “TI Talking Learning Aid Sets Pace for Innovative CES Introductions,” 11 June 1978. http://www.datamath.org/Speech/SpeaknSpell.htm 7. YouTube, “Speak & Spell (1978) Texas Instruments.” https://www.youtube.com/watch?v=B_bahLxKF_k 8. YouTube, “1978 Texas Instruments Speak & Spell.” https://www.youtube.com/watch?v=F65l31ZkZKw --- ## Kurzweil Reading Machine (1976) **By:** Kurzweil Computer Products **Tags:** `Accessibility` `Assistive Technology` `OCR` `Text-to-Speech` ### Overview The Kurzweil Reading Machine was the first commercial print-to-speech reading machine for blind users. It combined three technologies that Kurzweil Computer Products had to develop: omni-font optical character recognition (OCR), a CCD flatbed scanner, and a text-to-speech synthesizer. A printed page placed on the machine was scanned, recognized, and read aloud, giving blind readers independent access to ordinary books, magazines, and mail. ### Deep dive Ray Kurzweil founded Kurzweil Computer Products in 1974 to build the first OCR system capable of recognizing text in any normal font. After a conversation with a blind passenger on an airplane, Kurzweil identified blindness as the most important application for the technology, because printed text was the principal barrier blind people faced in daily life. The resulting Kurzweil Reading Machine was large — roughly tabletop-sized — and was unveiled in a press conference on 13 January 1976 with leaders of the National Federation of the Blind. Walter Cronkite used the machine that evening to read his signature sign-off, “And that’s the way it is, January 13, 1976.” Stevie Wonder saw a segment on *The Today Show*, tried the machine, and became the user of the first production unit. The KRM’s core pipeline — scan → OCR → speech synthesis — anticipated today’s smartphone document readers and the later K-NFB Reader (2005). The company’s OCR and scanning technology was also sold into commercial data-entry markets (Lexis, Nexis) and eventually to Xerox in 1980. * **Weird / fun facts.** According to Kurzweil’s own account, the prototype stopped working just hours before the live *Today Show* demonstration; the chief engineer eventually fixed it by slamming the machine against a table. Stevie Wonder took his first production unit home in a taxi. ### Team * **Raymond Kurzweil** — Futurist and inventor; founded Kurzweil Computer Products, Inc. to build the first omni-font OCR system for the blind. * **Kurzweil Computer Products, Inc.** — The company that integrated CCD scanning, omni-font OCR, and text-to-speech into one reading machine. * **Stevie Wonder** — Musician and early adopter; took the first production unit home and demonstrated the machine on television with Walter Cronkite. ### Media ![Kurzweil Reading Machine](../assets/wiki/kurzweil-reading-machine-1.jpg) *Promotional photo of the Kurzweil Reading Machine. Source: [Kurzweil Technologies](http://www.kurzweiltech.com/kcp.html)* ### Sources 1. Kurzweil Technologies, “Kurzweil Computer Products” — http://www.kurzweiltech.com/kcp.html 2. Wikipedia, “Ray Kurzweil” — https://en.wikipedia.org/wiki/Ray_Kurzweil 3. Wikipedia, “Reading machine” — https://en.wikipedia.org/wiki/Reading_machine 4. YouTube, “1980s THROWBACK: ‘STEVIE WONDER AND THE KURZWEIL READING MACHINE’” — https://www.youtube.com/watch?v=dPKGbGm6Fec 5. YouTube, “Kurzweil’s Revolutionary reading devices for the blind” — https://www.youtube.com/watch?v=g0jECuwrn_U --- ## Virtuality Arcade VR System (1990) **By:** Virtuality Group (originally W Industries) **Tags:** `VR` `Arcade` `Gaming` `3D Graphics` `Multiplayer` ### Overview Virtuality was the first mass-market, networked virtual-reality arcade system. Produced by Virtuality Group — originally founded as W Industries in Leicester, England, in October 1987 — the system put players inside a stereoscopic headset (branded the “Visette”) with 6-degrees-of-freedom magnetic tracking and a handheld “space joystick.” Players stood in a ring or sat in a pod and competed in real-time 3D games such as *Dactyl Nightmare*. ### Deep dive Dr. Jonathan Waldern developed early VR prototypes at Leicester Polytechnic/Loughborough University, including a 1986 stereoscopic “Roaming Caterpillar” system. W Industries refined several prototype pods before the fifth prototype became the basis of the commercial Virtuality 1000SU, launched at the Computer Graphics ’90 exhibition at Alexandra Palace, London, in November 1990. The 1000 series was built around an Amiga 3000 with 4 MB RAM and a pair of Texas Instruments TMS34020-based graphics accelerators (one per eye). The Visette headset used two Panasonic LCD screens (372×250 per eye) derived from a camcorder accessory; because the screens were too heavy to mount directly in front of the eyes, they were placed at the sides and reflected into the lenses with mirrors. The stand-up 1000CS used a Polhemus magnetic tracking ring at waist height to track both the headset and the space joystick; the sit-down 1000SD used a cheaper Ascension tracker with a shorter range, acceptable because the player remained seated. The arcade 1000CS shipped in 1991 with games including *Dactyl Nightmare* (a multiplayer arena shooter with a pterodactyl that snatched players), *Grid Busters*, *Hero*, and *Legend Quest*. The SD unit offered *Battlesphere*, *Exorex*, *Total Destruction*, *VTOL*, and *Flying Aces*. About 1,200 Virtuality arcade machines were in use before the company filed for bankruptcy in 1997. * **Weird / fun facts.** * The “CS” suffix stood for “Cyberspace,” pure marketing for the early-1990s VR hype. * *Dactyl Nightmare* is sometimes cited as one of the first commercial networked first-person deathmatch games, predating *Doom*. * The headset mirrors were a literal workaround for overweight LCDs. ### Team * **Jonathan Waldern** — Founder of W-Industries, later Virtuality Group plc; drove the design of the arcade VR pods. * **W-Industries / Virtuality Group** — UK company that produced networked, stand-up VR arcade systems using Amiga 3000s and magnetic tracking. * **Commodore / Amiga** — The Amiga 3000 formed the graphics and compute heart of early Virtuality 1000SD and 1000CS systems. ### Media ![Virtuality 1000CS stand-up pod](../assets/wiki/virtuality-1000cs-1.jpg) *1991 Virtuality 1000CS stand-up arcade pod with Visette headset and space joystick. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Virtuality_(product))* ![Virtuality 1000SD sit-down unit](../assets/wiki/virtuality-1000sd-2.jpg) *Sit-down 1000SD unit. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Virtuality_(product))* ![Dactyl Nightmare screenshot](../assets/wiki/virtuality-dactyl-3.jpg) *Screenshot of *Dactyl Nightmare* running on original 1000CS hardware. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Virtuality_(product))* ### Sources 1. Wikipedia, “Virtuality (product)” — https://en.wikipedia.org/wiki/Virtuality_(product) 2. Virtual Reality Society, “Virtuality – A New Reality of Promise, Two Decades Too Soon” — https://www.vrs.org.uk/dr-jonathan-walden-virtuality-new-reality-promise-two-decades-soon/ 3. Heise Online, “Virtual reality in the 90s: how the first VR hype started in arcades” — https://www.heise.de/en/background/Virtual-reality-in-the-90s-how-the-first-VR-hype-started-in-arcades-10478602.html 4. Time Extension, “Virtuality, The 1990s Pioneer That Sold The World On VR” — https://www.timeextension.com/features/the-making-of-virtuality-the-1990s-pioneer-that-sold-the-world-on-vr 5. V-Rtifacts, “Virtuality History” (archived) — https://web.archive.org/web/20221111015229/https://vrtifacts.com/wp-content/uploads/2010/07/vhist.html 6. YouTube, “VIRTUALITY DACTYL NIGHTMARE REVIEW! Experience VR From 1990 Right Now!” — https://www.youtube.com/watch?v=mAcGA5XdZHY 7. YouTube, “Playing Dactyl Nightmare on Real 1990s VR Hardware!” — https://www.youtube.com/watch?v=Nz_BeaBS_cg --- ## Steve Mann’s EyeTap / Wearable Computing (1980s) **By:** Steve Mann **Tags:** `Wearable Computing` `Augmented Reality` `Mediated Reality` `Sousveillance` `Input` ### Overview EyeTap is a wearable device worn in front of one eye that acts as both a camera and a display: it records the scene available to the eye and superimposes computer-generated imagery on that same scene. Steve Mann began building wearable computer systems in high school in the late 1970s and developed successive “WearComp” backpack rigs through the 1980s, eventually shrinking them toward eyeglass form. The work underlies modern smart glasses, AR headsets, and lifelogging concepts. ### Deep dive Mann’s first EyeTap versions consisted of a backpack computer wired to a camera and viewfinder mounted on a helmet. The later optical design uses a beam splitter to send the same incoming light to both the user’s eye and a camera; the camera digitizes the scene, a computer processes it, and a display (the “aremac”) projects the augmented image back through the beam splitter. This creates what Mann calls “computer-mediated reality” or “augmented reality,” distinct from a conventional HUD because the computer can modify the real-world view in response to what it sees. Mann is widely cited as the “father of wearable computing” and coined *sousveillance* (personal, bottom-up recording) as a counterpoint to surveillance. In the mid-1990s he ran continuous personal-broadcast experiments that are considered early precursors to moblogging and lifelogging. He co-founded the International Symposium on Wearable Computers in 1997 and received the 2025 IEEE Masaru Ibuka Consumer Technology Award for his work. * **Uncertainty note.** The exact year of the first EyeTap prototype is reported differently across sources (late 1970s vs. early 1980s); the consensus is that Mann was wearing homemade head-mounted camera/display systems while still in high school and continued refining them through the 1980s. * **Weird / fun facts.** Mann has described feeling “nauseous, unsteady, naked” when removing the device after decades of use. In 2012 he reported being assaulted at a Paris McDonald’s because employees objected to his permanently attached EyeTap glasses. ### Team * **Steve Mann** — Inventor and researcher; built camera-display eyeglasses as a high-school student in the 1980s and coined much of the wearable-computing vocabulary. * **MIT Media Lab** — Mann's later research home, where wearable computing was explored as a new paradigm for human augmentation. * **University of Toronto** — Long-term research base where Mann continued work on mediated, augmented, and diminished reality. ### Media ![Injection-molded EyeTap](../assets/wiki/eyetap-aimoneyetap-1.jpg) *Man wearing an injection-molded one-eyed EyeTap. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/EyeTap)* ![Laser EyeTap](../assets/wiki/eyetap-mann-glass-2.jpg) *Steve Mann wearing a metal-frame Laser EyeTap. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Steve_Mann_(inventor))* ![Generation-4 EyeTap](../assets/wiki/eyetap-gen4-3.jpg) *Steve Mann with a Generation-4 EyeTap Digital Eye Glass, 1999. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Steve_Mann_(inventor))* ### Sources 1. Wikipedia, “EyeTap” — https://en.wikipedia.org/wiki/EyeTap 2. Wikipedia, “Steve Mann (inventor)” — https://en.wikipedia.org/wiki/Steve_Mann_(inventor) 3. IEEE Spectrum, “The Accidental Engineer Who Conjured Up Extended Reality” — https://spectrum.ieee.org/engineer-conjured-up-extended-reality 4. Steve Mann, “Wearable Computing: Toward Humanistic Intelligence” (IEEE Intelligent Systems, 2001) — https://ieeexplore.ieee.org/document/940020 5. YouTube, “DEF CON 7 - Steve Mann: The Inventor of the So Called Wearable Computer” — https://www.youtube.com/watch?v=HVquUd-MFtU 6. YouTube, “The Father of Wearable Computing | Steve Mann | TEDxUTSC” — https://www.youtube.com/watch?v=Z9qiWqRPrcw --- ## Mandala / The Vivid Group Gesture VR System (1986) **By:** The Vivid Group (Vincent John Vincent & Francis MacDougall) **Tags:** `Gesture` `VR` `Computer Vision` `Interactive Art` `Amiga` `Accessibility` ### Overview Mandala was a camera-based “mirror VR” system developed by The Vivid Group. Users saw themselves on a screen inside a computer-generated or video world and interacted with virtual objects through full-body movement — no headset, glove, or controller required. It was one of the first practical, unencumbered gestural VR installations and was used in museums, arcades, TV production, rehabilitation, and live performances. ### Deep dive The Vivid Group — Vincent John Vincent and Francis MacDougall — began work on video gesture control in 1983. The Mandala project started in 1982; the first prototype of what became the GestureXtreme engine ran on an Amiga 1000 in 1986. A video camera captured the user’s silhouette; the system digitized the image at up to 30 frames per second and placed it in its own bitplane, using pixel-level collision detection between the user and animated “actors” to trigger graphics, sounds, gravity effects, and state changes. Because the output was displayed on ordinary monitors, projectors, or video walls, Mandala installations could support multiple simultaneous participants and spectators. Notable deployments included the Tech2000 Gallery of Interactive Education in Washington, D.C., the CN Tower in Toronto, the Bell Canada Video Teleconferencing Forum, and later the *Nick Arcade* and *Total Panic* TV shows on Nickelodeon. *Popular Science* named Mandala one of the top breakthrough technologies of 1990. The technology evolved into GestureXtreme and eventually into GestureTek, whose patents later influenced Sony EyeToy and Microsoft Kinect. * **Weird / fun facts.** The name “Mandala” was chosen from Sanskrit to evoke a person at the center of an interconnected, multidimensional universe whose creative input becomes part of a cosmic dance. Vincent John Vincent used the system to become what the company calls the world’s first “Virtual Reality Performer / Virtual Musician.” ### Team * **Vincent John Vincent** — Co-founder of The Vivid Group; choreographer and technologist who pioneered full-body video-silhouette interaction. * **Franck Lasowski** — Co-founder of The Vivid Group; developed the real-time computer-vision systems behind Mandala. * **The Vivid Group** — Toronto-based company that produced Mandala and licensed gesture-VR systems worldwide. * **Commodore Amiga** — The platform that made 30fps live-video silhouette processing affordable in 1986. ### Media ![Mandala at SIGGRAPH 1991](../assets/wiki/mandala-siggraph-1.jpg) *SIGGRAPH 1991 Immersive Pavilion exhibit photo of The Mandala VR System by The Vivid Group. Source: [ACM SIGGRAPH History Archives](https://history.siggraph.org/experience/the-mandala-vr-system-by-wyshynski/)* ![Mandala demo thumbnail](../assets/wiki/mandala-video-thumb-2.jpg) *YouTube thumbnail for “Mandala (Amiga, 1986) – The First Motion Sensing VR System.” Source: [YouTube](https://www.youtube.com/watch?v=h6xHpyJQ6GQ)* ### Sources 1. ACM SIGGRAPH History Archives, “‘The Mandala VR System’ by Wyshynski” — https://history.siggraph.org/experience/the-mandala-vr-system-by-wyshynski/ 2. GestureTek Health, “Timeline” — https://gesturetekhealth.com/timeline 3. GestureTek Health, “History” — https://gesturetekhealth.com/about/history 4. YouTube, “Mandala (Amiga, 1986) – The First Motion Sensing VR System” — https://www.youtube.com/watch?v=h6xHpyJQ6GQ 5. YouTube, “Amiga Mandala Powering Museum, Music, Games, and More – Vivid Group Videos Compilation” — https://www.youtube.com/watch?v=RwAXPY6jwCE --- ## Handykey Twiddler Chord Keyboard (1992) **By:** HandyKey Corporation / Tek Gear **Tags:** `Input` `Chorded Keyboard` `One-Handed` `Mobile` `Wearable` ### Overview The Twiddler is a handheld, one-handed chording keyboard that also functions as a mouse. Launched in 1992 by HandyKey Corporation, it is designed for mobile and wearable computing: users hold it in one hand and press combinations (chords) of keys to type characters, while a thumb-controlled pointer or motion sensors act as a pointing device. ### Deep dive The original Twiddler communicated over a serial port and drew power from a PC/AT keyboard port. Later revisions added USB (Twiddler 2.1), Bluetooth, and haptic feedback (Twiddler 3). The Twiddler became a fixture in the MIT Wearable Computing Group and related wearable-computing research: Thad Starner and other early wearable pioneers used it for one-handed text entry while walking. A CHI 2004 Georgia Tech study found that an experienced Twiddler user could average roughly 60 words per minute with letter-by-letter typing of standard phrases. HandyKey was acquired by Canadian firm Tek Gear in 2007. In 2024 the Twiddler 4 was announced with USB-C or Bluetooth connectivity and an optical trackpad replacing the earlier joystick. * **Weird / fun facts.** The Twiddler packs keyboard, mouse, and (in later models) motion control into a device small enough to hold in one hand. It is a rare example of a 1990s input device still in active development more than 30 years later. ### Team * **Lyndon Venancio** — Engineer credited with the original design of the Twiddler one-handed chord keyboard. * **Handykey Corporation** — Company formed to manufacture and sell the Twiddler to wearable-computing researchers and mobile users. * **MIT Media Lab Wearable Computing Group** — Early adopters who pushed the device to 60 words per minute while walking and helped refine the one-handed input paradigm. ### Media ![Original Twiddler (1992)](../assets/wiki/twiddler-original-1.png) *The original Twiddler model from 1992. Source: [Wikimedia Commons](https://en.wikipedia.org/wiki/Twiddler)* ![Twiddler in use](../assets/wiki/twiddler-lgr-thumb-2.jpg) *YouTube thumbnail for LGR’s “Twiddler Motion Controlled Keyboard Mouse from 1992.” Source: [YouTube](https://www.youtube.com/watch?v=HhJGrATZCl0)* ### Sources 1. Wikipedia, “Twiddler” — https://en.wikipedia.org/wiki/Twiddler 2. New Atlas, “Learning the one-handed Twiddler3 keyboard a challenge worth taking” — https://newatlas.com/one-handed-twiddler3-keyboard-tekgear/36952/ 3. The Register, “Come and Twiddle Tek Gear's one handed keyboard” — https://www.theregister.com/2015/01/21/review_tek_gear_twiddler_3_remote_handheld_keyboard/ 4. Lyngbäck et al. / Georgia Tech, “Twiddler Typing: One-Handed Chording Text Entry for Mobile Phones” (CHI 2004) — https://sites.cc.gatech.edu/home/thad/p/030_10_MTE/twiddler-chi04.pdf 5. YouTube, “LGR Oddware: Twiddler Motion Controlled Keyboard Mouse from 1992” — https://www.youtube.com/watch?v=HhJGrATZCl0 6. YouTube, “Twiddlering!” — https://www.youtube.com/watch?v=zZhWa2FfEac --- ## Appendix: Image Credits | Component | File | Caption | Source | |---|---|---|---| | Hubot | `hubot-cnet.webp` | CNET gallery photo | [CNET](https://www.cnet.com/pictures/rise-of-the-robots-from-sci-fi-to-our-homes/) | | Hubot | `hubot-hardware.webp` | Hardware.com.br detail | [Hardware.com.br](https://www.hardware.com.br/tecnologia/hubot-robo-atari-1984/) | | Hubot | `hubot-sciencephoto.jpg` | Science Photo Library | [Science Photo Gallery](https://sciencephotogallery.com/featured/hubot-robot-volker-steger.html?product=acrylic-print) | | P300 Speller | `p300-rowcolumn.webp` | Row-column paradigm | [Frontiers](https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2022.1077717/full) | | P300 Speller | `p300-paper-01.png` | First page of 1988 paper | [Farwell PDF](https://www.farwellbrainfingerprinting.com/pdf/Farwell-Donchin-1988-Talking-Off-the-Top-of-Your-Head-BCI-brain-computer-interface.pdf) | | VPL | `vpl-datasuit.jpg` | VPL DataSuit | [Wikimedia Commons](https://en.wikipedia.org/wiki/VPL_Research) | | VPL | `vpl-eyephone-demo.jpg` | EyePhone/DataGlove demo | [Flashbak](https://flashbak.com/jaron-laniers-eyephone-head-and-glove-virtual-reality-in-the-1980s-26180/) | | VPL | `vpl-jaron-lanier.jpg` | Jaron Lanier | [Flashbak](https://flashbak.com/jaron-laniers-eyephone-head-and-glove-virtual-reality-in-the-1980s-26180/) | | Put-That-There | `put-that-there-paper-1.png` | SIGGRAPH ’80 title page | [MIT Media Lab](https://dam-prod.media.mit.edu/uuid/8e6d934b-6c6f-48e4-b0a1-270e0dae745f) | | Put-That-There | `put-that-there-video.jpg` | Demo thumbnail | [YouTube](https://www.youtube.com/watch?v=RyBEUyEtxQo) | | VIDEOPLACE | `videoplace-mediaartnet.jpg` | Videoplace still | [Media Art Net](http://www.medienkunstnetz.de/works/videoplace/) | | VIDEOPLACE | `videoplace-video.jpg` | 1989 demo thumbnail | [YouTube](https://www.youtube.com/watch?v=dqZyZrN3Pl0) | | Power Glove | `power-glove-1.jpg` | NES Power Glove | [Wikimedia Commons](https://en.wikipedia.org/wiki/Power_Glove) | | Power Glove | `power-glove-2.jpg` | Promotional art | [ACMI](https://www.acmi.net.au/stories-and-ideas/nintendo-nes-power-glove/) | | Active Badge | `active-badge-1.gif` | Four badge generations | [Cambridge/AT&T archive](https://www.cl.cam.ac.uk/research/dtg/attarchive/ab.html) | | Digital Desk | `digital-desk-1.gif` | Prototype projection | [NAVER LABS Europe](https://europe.naverlabs.com/history/past-research/digitaldesk-to-camworks/) | | Digital Desk | `digital-desk-2.jpg` | CHI ’92 video thumbnail | [YouTube](https://www.youtube.com/watch?v=laApNiNpnvI) | | Atari Mindlink | `atari-mindlink-1.jpg` | National Videogame Museum | [Wikimedia Commons](https://en.wikipedia.org/wiki/Atari_Mindlink) | | Atari Mindlink | `atari-mindlink-2.jpg` | Atari Museum prototype | [Atari Museum](https://atarimuseum.ctrl-alt-rees.com/videogames/consoles/2600/mindlink.html) | | Speak & Spell | `speak-spell-1.jpg` | 1978 American model | [Wikimedia Commons](https://en.wikipedia.org/wiki/Speak_%26_Spell_(toy)) | | Speak & Spell | `speak-spell-2.jpg` | CHM timeline | [Computer History Museum](https://www.computerhistory.org/timeline/ai-robotics/) | | Kurzweil Reading Machine | `kurzweil-reading-machine-1.jpg` | Promotional photo | [Kurzweil Technologies](http://www.kurzweiltech.com/kcp.html) | | Virtuality | `virtuality-1000cs-1.jpg` | 1000CS stand-up pod | [Wikimedia Commons](https://en.wikipedia.org/wiki/Virtuality_(product)) | | Virtuality | `virtuality-1000sd-2.jpg` | 1000SD sit-down unit | [Wikimedia Commons](https://en.wikipedia.org/wiki/Virtuality_(product)) | | Virtuality | `virtuality-dactyl-3.jpg` | Dactyl Nightmare | [Wikimedia Commons](https://en.wikipedia.org/wiki/Virtuality_(product)) | | EyeTap | `eyetap-aimoneyetap-1.jpg` | Injection-molded EyeTap | [Wikimedia Commons](https://en.wikipedia.org/wiki/EyeTap) | | EyeTap | `eyetap-mann-glass-2.jpg` | Laser EyeTap | [Wikimedia Commons](https://en.wikipedia.org/wiki/Steve_Mann_(inventor)) | | EyeTap | `eyetap-gen4-3.jpg` | Generation-4 EyeTap | [Wikimedia Commons](https://en.wikipedia.org/wiki/Steve_Mann_(inventor)) | | Mandala | `mandala-siggraph-1.jpg` | SIGGRAPH 1991 exhibit | [ACM SIGGRAPH History](https://history.siggraph.org/experience/the-mandala-vr-system-by-wyshynski/) | | Mandala | `mandala-video-thumb-2.jpg` | Demo thumbnail | [YouTube](https://www.youtube.com/watch?v=h6xHpyJQ6GQ) | | Twiddler | `twiddler-original-1.png` | Original 1992 Twiddler | [Wikimedia Commons](https://en.wikipedia.org/wiki/Twiddler) | | Twiddler | `twiddler-lgr-thumb-2.jpg` | LGR overview thumbnail | [YouTube](https://www.youtube.com/watch?v=HhJGrATZCl0) | --- *Compiled 2026-06-23. Facts are sourced from the references listed; uncertainty is noted where evidence is thin or conflicting.* --- ## GRiDPad 100 (1989) **By:** GRiD Systems Corporation **Tags:** `pen computing` `handwriting recognition` `tablet PC` ### Overview The **GRiDPad 100** is a pen-based MS-DOS tablet computer that established the archetype for portable, stylus-driven handwriting recognition in a clamshell-free slate format. Released in 1989 by GRiD Systems Corporation, it combined a rugged magnesium case with a 640×400 monochrome LCD, a cordless pen, and the *PalmPrint* character recognizer—the work of Jeff Hawkins, later founder of Palm Computing. At 4.5 pounds, the GRiDPad targeted mobile professionals in insurance, healthcare, and field-service verticals, offering a keyboardless alternative to laptops for data entry. Unlike the palm-top organizers of the era, the GRiDPad ran a full MS-DOS 3.3 environment and could host standard x86 applications, though its true novelty lay in a pen-aware application launcher and handwriting input panel that let users write directly into forms. The device could store up to 20 MB of files on its internal hard disk and supported PCMCIA expansion, enabling integration with wireless modems and custom peripherals. The GRiDPad 100 demonstrated that stylus interaction on a portable screen was viable and economically useful, preceding the more famous Apple Newton by four years. It remains a landmark in mobile HCI for its early fusion of untethered pen input, rugged industrial design, and practical MS-DOS compatibility. ### Deep dive * **Origins.** GRiD Systems, founded in 1979 by John Ellenby, had already pioneered the GRiD Compass—the first clamshell laptop—and later the GRiDCASE rugged laptops. By the late 1980s the company sought to eliminate the keyboard altogether for vertical-market tasks like insurance claims processing, hospital rounds, and inventory tracking. The result was a slate tablet that retained MS-DOS software compatibility while introducing a stylus-driven interface. The handwriting recognition engine, PalmPrint, was developed by Jeff Hawkins, who joined GRiD as a research engineer and would later build on this core technology to create the Palm Pilot. * **Hardware.** The GRiDPad 100 centered on an 80C86-compatible NEC V40 processor running at 10 MHz, supported by 1 or 2 MB of RAM and a 20 MB Conner Peripherals hard disk drive. Its 9.5-inch black-on-white reflective LCD offered 640×400 CGA resolution with a 16:10 aspect ratio, making it legible even in direct sunlight. A cordless electromagnetic pen digitized ink at the display surface; the system could also accept finger touches. A single PCMCIA 2.0 Type II slot provided expansion for memory cards, modems, or custom radio modules. The magnesium-alloy enclosure, sealed ports, and shock-mounted drive ensured the 11.5 × 9.5 × 1.7-inch tablet could endure a one-foot drop onto concrete—a necessity for field use. * **Interaction.** Pen input was handled through a DOS-resident driver and a character-mode shell called **PenRight**, which offered an icon launcher and a handwriting-recognition keyboard. Users wrote block-printed letters and numbers in designated on-screen boxes; PalmPrint analyzed strokes in a user-independent, trainable engine that achieved >95% accuracy for discrete characters. A gesture vocabulary let users tap, double-tap, or circle items to open files, invoke menus, and select text. Because the underlying OS was standard MS-DOS 3.3, any text-based application could be controlled with pen-emulating cursor movements, though the experience was markedly different from keyboard use. * **Commercial fate.** GRiD Systems sold the GRiDPad primarily to corporate and government customers, including the U.S. Army, insurance adjusters, and healthcare providers. The base price was approximately $2,370 (equivalent to about $5,000 today). An upgraded model, the GRiDPad 1900, appeared in 1990 with a larger hard drive (60 MB) and 386SL compatibility. In 1993, GRiD was acquired by Tandy Corporation, which continued the product under the GRiD brand for a few years before folding the pen-computing division. The GRiDPad line never reached the consumer mass market, but it proved the commercial viability of pen-based mobile data collection. * **Impact.** The GRiDPad directly influenced the design of pen-based operating systems, including GO Corp.’s PenPoint and Microsoft Windows for Pen Computing. Jeff Hawkins’ learning from PalmPrint fed into the Graffiti handwriting system used on the PalmPilot, which popularized stylus interaction with a generation of handheld organizers. The device also established the rugged slate form factor later adopted by tablets in logistics, public safety, and military computing. Museum retrospectives rightly place the GRiDPad 100 as the first broadly commercial, MS-DOS-compatible pen tablet—a functional bridge between the clunky portables of the 1980s and the touch-centric smartphones and tablets of the 21st century. ### Team * **John Ellenby.** Founder of GRiD Systems, driving force behind the GRiD Compass and GRiDCASE lines; set the vision for a pen-based tablet. * **Jeff Hawkins.** Developer of the PalmPrint handwriting recognition engine used in the GRiDPad; later founded Palm Computing and created the PalmPilot. ### Media ![GRiDPad 100 tablet showing the screen and pen in a right-side view](../assets/wiki/gridpad-100-1.jpg) *The GRiDPad 100 with its cordless pen and exposed PC Card slot. Source: oldcomputers.net* ![Left side of the GRiDPad 100 revealing ports and pen garage](../assets/wiki/gridpad-100-2.jpg) *Ports and pen storage detail on the left flank. Source: oldcomputers.net* ![GRiDPad 100 on display at the Computer History Museum](../assets/wiki/gridpad-100-3.jpg) *The GRiDPad 100 in the CHM collection, highlighting the screen bezel and palm rest. Source: Computer History Museum* ### Sources 1. GRiDPad tablet computer – CHM Revolution — https://www.computerhistory.org/revolution/mobile-computing/18/319/1727 2. GridPad - Wikipedia — https://en.wikipedia.org/wiki/GridPad 3. GRiDPad - Old Computers — https://oldcomputers.net/gridpad.html 4. GRiD Introduces PC-Compatible Computer that Recognizes Printed Handwriting – Pen-Based Computing History Museum — https://www.penbasedcomputing.com/grid-introduces-pc-compatible-computer-that-recognizes-printed-handwriting/ 5. GRiD System’s GRiDPad – Byte Magazine’s 1989 BYTE AWARD DISTINCTION — https://laptops251.com/grid-systems-gridpad/ 6. Gridpad – Rhode Island Computer Museum — https://www.ricomputermuseum.org/collections-gallery/small-systems-at-ricm/gridpad --- ## Heathkit HERO 1 (1982) **By:** Heath Company / Heathkit **Tags:** `Educational Robot` `Programmable Sensing` `Human-Computer Interaction` ### Overview The Heathkit HERO 1 (ET-18) was a self-contained mobile robot introduced in 1982 by the Heath Company of Benton Harbor, Michigan, primarily known for its electronic kits. The robot was designed as an educational platform, enabling students, hobbyists, and engineers to learn about robotics and computer control of physical devices. It was one of the first robots to bring programmable sensing, locomotion, and speech to an affordable, kit‑built format, making physical‑world interaction a tangible subject for human‑computer interaction experimentation. Equipped with a Motorola 6808 microprocessor, 4K of RAM, and 8K of ROM, the HERO 1 could process inputs from an array of sensors: a light-dependent resistor, a condenser microphone, a passive infrared motion detector, and a Polaroid ultrasonic ranging module. An integrated Votrax SC-01 speech synthesizer gave it a spoken voice, while a 16‑character alphanumeric LED display and a 17‑key hex keypad on its rotating head provided direct user interaction. The robot also featured an optional five‑axis arm with gripper, allowing it to manipulate objects. All these capabilities were embedded in a battery‑powered, wheeled chassis roughly 50 cm tall. Programming the HERO 1 could be done directly via its hex keypad, which entered machine code or accessed a resident debug monitor. More elaborate control was achieved through an RS‑232 serial link to a personal computer, using the on‑board ROM‑based HERO BASIC language. This dual‑mode interface opened the door for HCI researchers to rapidly prototype interactive behaviors such as obstacle‑avoiding navigation, voice‑responsive tasks, and even simple telepresence. As a result, the HERO 1 became an early platform for exploring embodied interaction design, situating computing in the physical world long before off‑the‑shelf robotic kits were commonplace. ### Deep dive * **Origins.** Heathkit, the kit‑building division of the Heath Company, had a long history of electronic training products. In October 1979, a team led by David Mork began developing a robot that would teach microprocessor control and sensor integration. The result was the HERO 1 (Heathkit Educational Robot, model ET‑18), launched in 1982. Priced at $1,495 as a kit and $2,495 factory‑assembled, it was marketed through Heathkit’s catalog and educational channels, aimed at vocational schools, colleges, and advanced hobbyists. * **Hardware.** The HERO 1’s brain was a 1‑MHz Motorola 6808 CPU, backed by 4K of static RAM (expandable to 8K) and 8K of ROM containing the operating system and HERO BASIC. Sensors included a CdS photocell for ambient light, an electret microphone with amplifier for sound detection, a heat/motion sensor using a passive infrared element, and a Polaroid electrostatic sonar unit that measured distances from 0.15 to 6 meters. A magnetic reed switch in the base detected the robot’s wheel rotation, while potentiometers tracked the head’s pan and tilt. Outputs comprised the Votrax SC‑01 phoneme synthesizer driving a speaker, a 16‑character alphanumeric LED display, two drive motors and a steering servo, and the optional robot arm with its own motor controllers. Power came from two sealed 12‑volt lead‑acid batteries, giving several hours of operation. The body was a molded plastic shell on a circular baseplate, with a top‑mounted head unit that rotated 350° and tilted ±45°. The entire robot weighed about 16 kg and stood 50 cm high. * **Interaction.** Interaction with the HERO 1 could occur at two levels. For quick experimentation, the 17‑button hex keypad on the head allowed the user to enter 6808 opcodes directly, read sensor values on the LED display, and command motor actions. A resident monitor program handled the keypad interface and provided a simple debug environment. For more complex programming, the robot’s RS‑232 serial port (300–4800 baud) connected to a terminal or personal computer. The onboard ROM contained an interpretive BASIC language with statements that directly addressed sensors and actuators—e.g., MOVE 100 to advance 100 encoder counts, SONAR to read distance, or SPEAK "HELLO" to string phonemes. Users could download programs typed on a PC and run them autonomously or under remote control. This made the HERO 1 a flexible testbed for human‑computer interaction research; one could write a script that made the robot wander until it heard a clap, then approach and deliver a spoken message, combining sensing, mobility, and speech. Its use in university HCI labs and hobbyist workshops demonstrated that intelligent behavior could be packaged in a consumer‑accessible form, inspiring later research into ubiquitous and embodied computing. * **Commercial fate.** The HERO 1 was produced from 1982 until about 1985, when Heathkit shifted focus to its lower‑cost HERO Jr. and the more powerful HERO 2000 (based on an Intel 8088). Heathkit continued to supply manuals, spare parts, and software for the HERO line until 1995. Exact sales figures are unpublished, but the kit was expensive compared to contemporary home computers, limiting its market primarily to schools and dedicated enthusiasts. Today, surviving units are collector’s items and appear in robotics museums, prized for their historical role in bringing real‑world interaction to the personal computing era. * **Impact.** Though not a commercial blockbuster, the HERO 1 had a lasting influence on personal robotics and HCI. It was among the first platforms to give programmers direct access to a rich set of physical sensors and actuators, lowering the barrier to investigating embodied interaction. In academic settings, the robot helped frame early discussions on ambient intelligence and tangible user interfaces, as researchers used it to build prototypes that responded to people’s presence, voice, and gestures. Its open architecture and available documentation also nurtured a community of hobbyist modifiers who added wireless links, extended memory, or custom sensors. This do‑it‑yourself ethos foreshadowed the Maker movement and the current landscape of programmable robotic toys (such as LEGO Mindstorms), which owe a conceptual debt to the HERO 1’s accessible combination of sensing, mobility, and speech. ### Team * **Heath Company / Heathkit.** Developer and distributor of the HERO 1 educational robot, Benton Harbor, Michigan. * **David A. Mork.** Lead designer of the HERO 1 at Heathkit Educational Systems (source: theoldrobots.com hero1-a page). ### Media ![Heathkit HERO 1 with robot arm, standing on a table](../assets/wiki/heathkit-hero-1-1.jpg) *The HERO 1 robot with its optional arm. (Wikimedia Commons)* ![Close-up of the HERO 1 head, showing hex keypad and LED display](../assets/wiki/heathkit-hero-1-2.JPG) *The hex keypad and alphanumeric display on the robot's rotating head. (theoldrobots.com)* ![HERO 1 in motion with arm extended, photographed from the side](../assets/wiki/heathkit-hero-1-3.JPG) *HERO 1 demonstrating its robotic arm in an action pose. (theoldrobots.com)* ![Original advertisement photo of the HERO 1 robot](../assets/wiki/heathkit-hero-1-4.jpg) *Period advertisement showing the HERO 1. (Classic Computer Brochures)* ### Sources 1. Wikipedia – HERO (robot) — https://en.wikipedia.org/wiki/HERO_(robot) 2. theoldrobots.com – Heathkit Hero 1 — http://www.theoldrobots.com/hero1-a.html 3. theoldrobots.com – Heathkit Hero 1 (main page) — http://www.theoldrobots.com/hero1.html 4. Classic Computer Brochures – Heathkit Hero 1 — https://classic.technology/heathkit-hero-1/ 5. History of Information – Heathkit HERO 1 — https://www.historyofinformation.com/detail.php?id=5419 6. HandWiki – Engineering:HERO (robot) — https://handwiki.org/wiki/Engineering:HERO_(robot) --- ## HP-150 Touchscreen (1983) **By:** Hewlett-Packard Company **Tags:** `Touchscreen` `Infrared touch` `MS-DOS computer` `8-bit microcomputer` `Hewlett-Packard` ### Overview The HP-150 (codenamed "Magic" during development) was Hewlett-Packard’s bold attempt to simplify personal computing by making the screen itself the primary input device. Introduced at the COMDEX Fall trade show in Las Vegas on November 28, 1983, it is widely recognised as the first mass-market computer to ship with direct finger‑touch interaction as the main user interface. The machine’s defining feature was a 9-inch Sony CRT surrounded by a bezel that housed a matrix of infrared (IR) emitters and detectors; any non‑transparent object breaking the beams—typically a finger—allowed the system to pinpoint the touch location and translate it to screen coordinates. Under the hood, the HP-150 was an Intel 8088‑based PC‑workalike that ran a customised version of MS‑DOS (2.01, 2.11 or 3.20) rather than IBM PC DOS. Its 8 MHz CPU was notably faster than the 4.77 MHz 8088 found in the contemporary IBM PC XT, and the base 256 KB of RAM could be expanded to 640 KB via add‑on cards. However, the machine was never fully IBM PC compatible; software had to be written or adapted specifically for the HP-150’s non‑standard BIOS and memory map, which severely limited its third‑party software library. The system packaged the CRT and logic board in a single compact unit—reminiscent of the original Macintosh—while storage was provided externally. Users could snap on an HP‑IB‑connected HP 9121 dual 3½‑inch floppy‑drive (each diskette holding 270 KB) or an optional hard‑disk unit to create the "HP Touchscreen MAX". Internally, a tiny operating system called TOS (Terminal Operating System) ran two tasks: a terminal emulator and Microsoft DOS itself. The touch‑overlay communicated with the host through a serial link, and the whole ensemble was priced at US $2,795 (equivalent to roughly US $7,000 in 2025), targeting business professionals who wanted a more intuitive way to work with spreadsheets, word processors and custom HP applications. ### Deep dive * **Origins.** The HP-150 sprang from Hewlett-Packard’s Personal Computer Group in Fort Collins, Colorado, at a time when the company was searching for ways to differentiate its PC offerings in a market rapidly coalescing around the IBM PC standard. Codenamed "Magic," the project aimed to reduce the perceived complexity of personal computing by replacing the keyboard‑and‑mouse paradigm with a direct‑manipulation touch interface. Engineers opted for an infrared beam‑interruption scheme because it could be overlaid on a standard CRT without degrading image quality, and because the necessary emitters and detectors were already inexpensive, small‑enough components. The concept was demonstrated privately to HP management in 1982, received a green light, and after 18 months of intense development was unveiled at COMDEX in November 1983. At a time when touchscreens were almost unknown outside research labs, the HP‑150 represented a dramatic departure from convention, though HP was careful to position it as a serious business machine rather than a futuristic curiosity. * **Hardware.** At its core, the HP-150 used an Intel 8088 microprocessor clocked at 8 MHz, making it nearly 70% faster than the 4.77 MHz PC/XT. The motherboard held 256 KB of RAM (expandable to 640 KB via a proprietary card), and an optional Intel 8087 math coprocessor could be installed on a piggyback board because space constraints on the main PCB prevented a dedicated socket. The 9‑inch Sony Trinitron CRT offered amber or green phosphor and a resolution of 720×200 pixels. The infrared touch system consisted of 26 pairs of IR LEDs and phototransistors embedded in tiny holes along the inside edges of the monitor bezel; a custom controller board scanned the grid continuously, reporting coordinates to the CPU over an RS‑232‑like serial line. Because the bottom row of holes was especially prone to collecting dust—often causing the touch function to fail—users routinely had to vacuum the bezel to restore operation. External storage was managed via HP‑IB (IEEE‑488): the phone‑book‑sized 9121D dual floppy drive that sat beneath the monitor, or the HP 9133V hard‑disk unit for the Touchscreen MAX. Later models (the HP-150II, introduced in 1984) added an 8088 running at 8 MHz as well but offered an internal 3½‑inch floppy drive and greater IBM PC compatibility through a revised BIOS. * **Interaction.** The touchscreen was not a simple up‑or‑down digitizer; it could detect the moment a finger broke the beam, track its position while the beam remained broken, and register a tap when the beam returned. This allowed a vocabulary of gestures: a quick touch could select an icon, a press‑and‑hold could drag a scroll bar, and a double‑tap could open a file. HP shipped a suite of productivity applications—Personal Decision Support (a spreadsheet), WordStar customised for touch, and a drawing program—that rendered large, touch‑friendly buttons on screen. Because the bezel stood slightly proud of the CRT surface, the actual contact point was offset from the visible target, requiring a small parallax‑correction routine in software. The operating system’s TOS layer managed both the touch input and a terminal‑emulation window that allowed the HP-150 to connect to HP 3000 minicomputers, blending local DOS applications with host‑based computing. Despite its ingenuity, the touch interface could be tiring for extended use (the screen was not arm‑reaching low) and the lack of haptic feedback made precision tasks like text editing cumbersome, so the keyboard remained essential for heavy data entry. * **Commercial fate.** The HP-150 generated considerable press excitement at launch but failed to carve out a significant market share. Two factors worked against it: first, its incompatibility with the vast library of IBM PC software meant that buyers were confined to a tiny catalogue of HP‑approved programs; second, the infrared bezel was a mechanical weak point that industrial users found too finicky. Pricing, at $2,795 for the floppy‑only configuration, was competitive with the IBM PC/XT, but corporate IT managers were reluctant to adopt a non‑standard platform. An updated HP-150II that offered better IBM PC compatibility and an internal floppy drive arrived in 1984, yet it too struggled. By 1985, HP had quietly withdrawn both models from the market, shifting its PC strategy toward fully IBM‑compatible Vectra machines. The Touchscreen MAX, positioned for high‑end accounting and database work, sold in even smaller numbers. Estimates suggest total HP-150 series sales were fewer than 100 000 units—far below the volume needed to sustain a platform. * **Impact.** Although a commercial disappointment, the HP-150 was a landmark in human‑computer interaction. It was the first computer to demonstrate that finger‑based touch could serve as a practical, everyday pointing device in a mass‑produced desktop system. The infrared matrix technology pioneered on the HP-150 later appeared in countless kiosks, point‑of‑sale terminals, and public‑information displays, where it remained the dominant touch technology until capacitive screens became cheap enough for consumer devices in the mid‑2000s. HP’s experiment also highlighted the importance of software‑hardware co‑design for touch interfaces: applications had to be radically rethought to suit large target areas, gesture recognition, and the absence of a cursor. These lessons echoed through the industry’s later forays into pen computing, PDAs, and ultimately the multi‑touch smartphones that now permeate daily life. The HP-150 thus stands as a prescient, if prematurely executed, vision of a touch‑centric computing future. ### Team * **Hewlett-Packard Personal Computer Division (Fort Collins, Colorado).** Design, development, and manufacturing of the HP-150 ### Media ![HP-150 Touchscreen computer with CRT, keyboard, and dual floppy drive attached](../assets/wiki/hp-150-touchscreen-1.jpg) *HP-150 (1983) showing the CRT unit, separate keyboard, and the HP 9121 dual 3½-inch floppy drive beneath. The tiny holes around the bezel that hold the infrared emitters and detectors are visible. (Source: Wikimedia Commons)* ![HP-150 system with monitor and keyboard, front view](../assets/wiki/hp-150-touchscreen-2.jpeg) *Museum-quality photograph of an HP-150 with its characteristically squat CRT housing and external storage. (Source: Hewlett-Packard History)* ![Close-up of HP-150 screen displaying touch-enabled icons](../assets/wiki/hp-150-touchscreen-3.jpeg) *Detail of the 9-inch Sony CRT showing a touch-optimised application with large, finger-friendly icons—a visual reminder of the HP-150’s departure from keyboard‑centric interfaces. (Source: Hewlett-Packard History)* ### Sources 1. HP-150 – Wikipedia — https://en.wikipedia.org/wiki/HP-150 2. HP-150 touchscreen personal computer – HP Computer Museum — https://www.hp.com/hpinfo/abouthp/histnfacts/museum/personalsystems/0031/index.html 3. The HP 150 Touchscreen Computer – Hewlett-Packard History — https://www.hewlettpackardhistory.com/item/youve-got-the-touch/ 4. Business Desktops/Calcs – HP Computer Museum — https://www.hpmuseum.net/display_item.php?hw=43 5. Hewlett-Packard Introduces the HP-150 – History of Information — https://www.historyofinformation.com/detail.php?id=2431 --- ## KoalaPad (1984) **By:** Koala Technologies Corporation **Tags:** `Graphics Tablet` `Touch Tablet` `Absolute Positioning` `Home Computing` `HCI History` ### Overview The KoalaPad was a pioneering graphics tablet introduced by Koala Technologies in 1983 and broadly marketed in 1984 for popular 8-bit home computers, including the Apple II, Commodore 64, Atari 8-bit family, TRS-80 Color Computer, and IBM PC/PCjr. Conceived by Dr. David Thornburg as an affordable drawing surface for schools, the KoalaPad brought absolute‑position input, on‑surface menu selection, and pixel‑oriented creativity to consumers long before graphic tablets became mainstream. It consisted of a 4.5‑inch‑square resistive touch surface, a tethered stylus, and bundled software. The signature feature was a printed overlay that divided the active area into a central drawing region and labelled function, tool, and palette zones. Touching a zone with the stylus activated the corresponding command, eliminating the need for keyboard shortcuts or pull‑down menus. The bundled KoalaPainter (also called KoalaPaint or PC Design) offered standard drawing tools, plus the ability to save and create slideshows via Graphics Exhibitor. Although the KoalaPad achieved modest commercial success, it was ultimately overshadowed by the rise of the mouse and graphical user interfaces. Its design language, however, anticipated the absolute‑position input of today’s tablets and touchscreens, and it remains a beloved artifact of early home‑computer creativity, demonstrating how the industry was already exploring alternative interaction paradigms in the early 1980s. ### Deep dive * **Origins.** The KoalaPad was designed by Dr. David Thornburg, an educational computing consultant and author, who envisioned a low‑cost digitizing tablet that schools could use to teach art and design. Koala Technologies Corporation, based in Santa Clara, California, was founded specifically to manufacture and distribute the device. The first version targeted the Apple II, leveraging its joystick port for connection, and shipped by mid‑1983; versions for other platforms followed through 1984. The name ‘Koala’ reflected the Australian marsupial, chosen for its friendly, approachable image. The product was initially positioned as an educational tool, but home consumers embraced it for recreational drawing. * **Hardware.** The KoalaPad’s core was a 4.5 × 4.5 inch (114 mm) resistive touch surface, consisting of two layers of conductive film separated by a thin spacer. Pressing the stylus – or a finger – pushed the layers together, creating a voltage divider that allowed the onboard circuitry to read X and Y coordinates. The pad communicated through a standard joystick port (or a dedicated interface on some systems), reporting absolute coordinates at a resolution of roughly 160 × 160 points, sufficient for the low‑resolution screens of the day. The plastic housing featured a non‑slip base and a storage slot for the stylus. A paper overlay, supplied with the software, transformed the peripheral into a command surface: a central free‑draw area, surrounded by icons for brush shapes, color selection, fill, undo, and file operations. The overlay could be swapped for different applications, such as a music keyboard for the included Music Painter utility. * **Interaction.** Unlike contemporary mice, which moved a cursor relative to its current position, the KoalaPad reported absolute location. This meant that touching the top‑right corner of the pad always corresponded to the top‑right corner of the screen, making direct pointing intuitive and enabling a menu‑driven interface without an on‑screen pointer. In KoalaPainter, users could immediately switch between tools by tapping the labelled areas on the overlay, a paradigm now commonplace in touch‑screen applications. The drawing experience was immediate: as the stylus glided across the pad, the software would place pixels, draw lines, or create geometric shapes with real‑time feedback. The bundled Graphics Exhibitor application extended the system’s utility into slide‑show creation, letting users sequence KoalaPainter images with transitions – a precursor to presentation software. The physical overlay concept also encouraged third‑party software to design custom membrane templates, further expanding the pad’s use as a control surface for educational and music software. * **Commercial fate.** The KoalaPad enjoyed a few years of moderate success. Compute! magazine reviewed the PCjr version in 1985, praising the hardware but noting that the limited resolution of early PC displays made the drawing area feel cramped. Bundles with popular computers garnered some shelf space, and the device was sold through retail chains such as Toys “R” Us. However, the rapid standardization of the mouse – accelerated by the Apple Macintosh in 1984 and later by Microsoft Windows – marginalized absolute‑position tablets. By the late 1980s, Koala Technologies had shifted its focus to another touch‑based product, the Mac ‘n Touch screen for the Macintosh, but the company ultimately folded. Despite its short commercial lifespan, the KoalaPad earned a loyal following and is today a sought‑after collector’s item and a reminder of an era when the home computer was an open canvas for experimental peripherals. * **Impact.** The KoalaPad stands as an important milestone in interaction design. It proved that a simple touch tablet with a static overlay could replace complex keyboard commands, foreshadowing the direct manipulation interfaces that dominate modern computing. Its absolute‑position approach directly influenced later graphics tablets, such as Wacom’s digitizers, which became standard tools for digital artists. The concept of using a printed overlay to reconfigure a touch surface reappeared in early PDAs (e.g., PalmPilot graffiti area) and in educational toys. While the mouse eventually won the desktop, the KoalaPad’s design philosophy – that a pointing device could be both a canvas and a control panel – resonates today in the touch‑first interfaces of smartphones and tablets. In the history of HCI, it remains a compelling example of an early attempt to make computing more direct, creative, and accessible. ### Team * **Dr. David Thornburg.** Inventor and educational technologist; conceived the low‑cost drawing tablet for schools. * **Koala Technologies Corporation.** Manufacturer and distributor, Santa Clara, California; produced the KoalaPad for multiple platforms. ### Media ![A KoalaPad graphics tablet with stylus](../assets/wiki/koalapad-1.jpg) *KoalaPad for the Apple II series, showing the central drawing area and side function keys. (Wikimedia Commons, CC BY-SA 4.0)* ![Top view of the KoalaPad tablet](../assets/wiki/koalapad-2.jpg) *Detail of the printed overlay that turned the tablet into a menu-driven drawing surface. (Oldcomputr.com)* ![Exploded view of the KoalaPad showing internal layers](../assets/wiki/koalapad-3.jpg) *Exploded view revealing the two conductive layers that detected touch. (Oldcomputr.com)* ![Original box for the KoalaPad](../assets/wiki/koalapad-4.jpg) *Retail packaging emphasized the pad’s creative potential. (Oldcomputr.com)* ![KoalaPad Touch Tablet from the Computer History Museum collection](../assets/wiki/koalapad-5.jpg) *A KoalaPad with stylus and software manual, as preserved at the Computer History Museum. (Computer History Museum)* ### Sources 1. KoalaPad - Wikipedia — https://en.wikipedia.org/wiki/KoalaPad 2. Koala Technologies KoalaPad TouchTablet - Oldcomputr.com — https://www.oldcomputr.com/koala-technologies-koalapad-touchtablet/ 3. KoalaPad Touch Tablet - Computer History Museum Revolution — https://www.computerhistory.org/revolution/input-output/14/352/1817 4. The KoalaPad Comes Full Circle - Timex/Sinclair Computers — https://www.timexsinclair.com/blog/koalapad-comes-full-circle/ 5. Review: KoalaPad For PCjr - Compute! Magazine (Issue 54, 1985) — http://www.atarimagazines.com/compute/issue54/140_1_REVIEWS_KoalaPad_For_PCjr.php --- ## Microwriter (1980) **By:** Cy Endfield and Chris Rainey / Microwriter Ltd. **Tags:** `chording keyboard` `portable computing` `mobile text entry` `wearable technology` ### Overview The Microwriter is a pioneering hand-held word processor with a one-handed chording keyboard, designed to let mobile professionals take notes without a desk. Invented by film director Cy Endfield and engineer Chris Rainey, it was marketed from 1980 by Microwriter Ltd. of Mitcham, Surrey, UK. The device fits in the palm of the right hand; five keys for the fingers and a side‑mounted thumb key form letter chords whose shapes mirror the written characters. This mnemonic ‘alphabet’ was claimed to reach typing speeds averaging 1.5 times that of handwriting. The best‑known model, the MW4, features a 16‑character scrolling LCD, 8 KB of battery‑backed RAM, and an RS‑232 serial port for connecting to printers or computers. Users can edit, search, and scroll through text using chord commands, and the internal memory can hold several pages of notes. Power comes from rechargeable NiCad batteries, offering hours of continuous use. Although it never became a mass‑market product, the Microwriter demonstrated the viability of mobile text entry long before PDAs and smartphones. Its chording approach influenced later wearable keyboards, and its descendants—the AgendA folding PDA and the CyKey PC keyboard—kept the idea alive. The device remains a significant artifact in the history of human–computer interaction and portable computing. ### Deep dive * **Origins.** Cy Endfield, a film director best known for ‘Zulu’ and ‘Mysterious Island,’ grew frustrated with the slowness of handwriting during production and wanted a battery‑powered device for immediate note‑taking. With engineer Chris Rainey he conceived a portable word‑processor based on a chorded keyboard. The first prototype was shown at a London computer exhibition in 1978. A patent application (issued as US4442506A) described a portable word‑processor with a one‑handed chording system and a visual mnemonic scheme. In 1980 Microwriter Ltd. began selling the Microwriter MW4, targeting business executives, journalists, and students. * **Hardware.** The MW4 unit measures roughly 230 × 130 × 25 mm (9 × 5 × 1 in) and weighs about 500 g. The casing, usually black, has a recessed keypad: five circular finger keys on top, arranged in a slight arc for the right hand, and a thumb key on the left side of the body. A 16‑character reflective liquid‑crystal display sits above the keys, showing a scrolling window into the current document. Internal storage consists of 8,000 characters of non‑volatile, battery‑backed RAM, which can be partitioned into multiple files. Power is supplied by removable, rechargeable NiCad cells. Communication is via an RS‑232 serial port for output to Epson‑compatible printers or for uploading text to a computer; an optional acoustic‑coupler modem was available for remote transmission. * **Interaction.** The user holds the device in the right hand, with fingers resting on the five top keys and the thumb on the side key. Each letter, digit, or punctuation mark is produced by pressing a unique chord—a combination of fingers and thumb. The chords are mnemonically shaped: for example, ‘A’ is thumb + index finger, evoking the two strokes of a capital A; ‘B’ adds the middle and ring fingers to suggest the two loops of the letter. The built‑in firmware interprets chords in context, separating text‑entry mode from command mode. Chords control cursor movement, delete, insert, block operations, and file management. A printed learning guide claimed that most users could reach 30 words per minute after 3–6 hours of practice. Editing is performed on a small window; the text scrolls as the cursor moves. Completed documents can be transferred word‑for‑word or as ASCII codes via the serial port. * **Commercial fate.** Microwriter Ltd. launched the MW4 at a price of about £200–£300 in the early 1980s, but sales remained modest against the growing tide of portable electronic typewriters and early laptop computers. In 1984 the company introduced the AgendA, a folding PDA that combined a full QWERTY keyboard with Microwriter chording pads on the inside surfaces. The company dissolved later that decade. Chris Rainey then founded a new venture that produced the CyKey—a compact chording keyboard for PCs that preserved the Microwriter mnemonic scheme—and marketed it into the 1990s. Original Microwriter units are now held in several museum collections. * **Impact.** Although not a commercial blockbuster, the Microwriter is a landmark in the history of mobile text entry. It preceded the one‑handed Twiddler keyboard by more than a decade and demonstrated that chorded input, combined with a mnemonic alphabet, could be learned quickly and used effectively while standing or walking. It is frequently cited in human–computer interaction research as an early example of a wearable word‑processor. The idea lived on through the AgendA and CyKey, and a community of enthusiasts has even created modern emulators. The device’s design philosophy—one‑handed, shape‑based chord mapping—continues to inform research on alternative keyboards and text‑entry methods. ### Team * **Cy Endfield.** Inventor, film director; conceived the idea and co‑designed the chording system. * **Chris Rainey.** Co‑inventor, engineer; responsible for the electronic and firmware design. * **Microwriter Ltd..** Company based in Mitcham, Surrey, UK; manufactured and marketed the Microwriter. ### Media ![A hand holding the Microwriter MW4, showing the 16-character LCD display and chording keys.](../assets/wiki/microwriter-1.png) *The Microwriter MW4 handheld word processor. Source: Wikimedia Commons.* ![Cover of a Microwriter sales brochure, showing the device's portability.](../assets/wiki/microwriter-2.jpg) *A sales brochure for the Microwriter, circa early 1980s. Source: Wikimedia Commons.* ![Specifications and ordering information sheet for the Microwriter.](../assets/wiki/microwriter-3.jpg) *Specifications overview and ordering information from Microwriter Ltd. Source: Wikimedia Commons.* ### Sources 1. Wikipedia: Microwriter — https://en.wikipedia.org/wiki/Microwriter 2. Centre for Computing History: Microwriter MW4 — https://www.computinghistory.org.uk/det/36099/Microwriter-MW4/ 3. Google Patents US4442506A – Portable word-processor — https://patents.google.com/patent/US4442506A/en 4. Science Museum Group: Experimental and pre-production models of the Microwriter typewriter — https://collection.sciencemuseumgroup.org.uk/objects/co38161/experimental-and-pre-production-models-of-the-microwriter-typewriter 5. Vintage Computers: Microwriter MW4 — http://vintagecomputers.sdfeu.org/mw4/ 6. GitHub: microwriter_mw4 emulator — https://github.com/sjaturner/microwriter_mw4 --- ## Nintendo D-pad controller (1985) **By:** Nintendo Co., Ltd. (R&D1 team) **Tags:** `D-pad` `Game controller` `NES` ### Overview The Nintendo D-pad controller, launched with the Nintendo Entertainment System in 1985, introduced a novel cross-shaped directional pad that redefined how players interacted with console games. Prior to the NES, home video game systems typically relied on large joysticks or paddle controllers that required wrist and arm movements. The D-pad, a compact, thumb-operated interface, provided silent, precise eight-directional control and required far less physical effort. Its design built on the cross-shaped pad first seen on the Game & Watch *Donkey Kong* handheld in 1982, itself an invention of Nintendo engineer Gunpei Yokoi, who sought a low-profile solution for portable play. The NES controller paired the D-pad with two main action buttons (A and B) and Start/Select buttons, housed in a simple rectangular plastic shell that could be held comfortably in two hands. This layout became the archetype for home console gamepads for over a decade. The D-pad’s internal mechanism—four rubber-dome switches arranged around a central pivot—allowed users to rock the pad in any cardinal direction and, by pressing two adjacent directions simultaneously, achieve diagonal movement, while the pivot physically prevented all four switches from being pressed at the same time. This tactile feedback and ease of use proved ideally suited to the era’s precision platformer games, such as *Super Mario Bros.*, cementing the controller’s reputation as an exceptionally responsive and ergonomic input device. Today, the NES D-pad’s influence extends far beyond gaming: its cross-shaped layout appears on remote controls, mobile phones, calculators, and countless other electronic devices as the universal symbol for directional input. Although analog sticks have since become the primary directional control for 3D games, the D-pad remains an essential secondary input on nearly every modern gamepad, a testament to the enduring utility of Yokoi’s compact, thumb-driven design. ### Deep dive * **Origins.** The concept of a cross-shaped thumb pad was born in 1982 when Gunpei Yokoi, head of Nintendo’s R&D1 division, designed the Game & Watch version of *Donkey Kong*. The handheld’s small form factor precluded a joystick, so Yokoi created a flat, cross-shaped rocker that could be operated with the thumb alone. This “cross key” design was so successful that it was carried over to the controller for the Family Computer (Famicom), launched in Japan in 1983. The North American release of the NES in 1985 used the same controller (model NES-004E), with only minor cosmetic changes such as the addition of grey plastic and redesigned labels. The controller’s design was a collaborative effort within Nintendo’s hardware teams, with Masayuki Uemura overseeing the Famicom’s development and ensuring the D-pad controller met the demands of home console gameplay. * **Hardware.** The NES-004E measures approximately 124 mm × 54 mm × 22 mm and is constructed from injection-molded ABS plastic. The D-pad unit itself is a cross-shaped piece mounted on a central pivot, resting on a metal plate inside the shell. Beneath each of its four arms, a rubber dome with a conductive carbon pad sits above a set of interleaved contacts on the printed circuit board. Pressing an arm collapses the dome, bridging the contacts and registering a directional input. The pivot prevents simultaneous activation of opposing directions, while pressing a corner engages two domes, producing a diagonal. The controller houses a single 4021B shift register IC, which reads the state of all eight buttons (four directions, A, B, Select, Start) and sends the data serially through a 7-pin connector. The original controller is tethered by a fixed 7.6-foot (2.3‑m) cable. The D-pad’s surface has a subtle linear texture for grip. * **Interaction.** The D-pad transforms thumb motion into binary on/off signals, offering tactile feedback through the rubber domes’ snap and the pivot’s rocking feel. Players quickly learn to locate the pad by feel, using the cross shape as a home position for the thumb. The pad’s low profile reduces fatigue compared to joysticks, enabling rapid directional changes essential for fast-paced platform games. In *Super Mario Bros.*, for instance, the D-pad’s reliability allowed precise control over running, jumping, and ducking without accidental diagonals. The A and B buttons are placed slightly to the right, allowing the index or middle finger to stabilize the back of the controller while the thumb alternates between D-pad and face buttons. This ergonomic arrangement became the standard for subsequent gamepads and influenced the layout of countless handheld devices. * **Commercial fate.** Bundled with every NES console (which sold over 61 million units worldwide), the controller achieved widespread adoption and spawned numerous third-party clones and variations. Its design language persisted in Nintendo’s SNES controller (with additional shoulder buttons), the Game Boy (which integrated a D-pad as a primary input), and later consoles. Rival companies, from Sega to Sony, adopted the D-pad in their own gamepads, often paying license fees to Nintendo in the early years. Even as analog sticks took over primary movement in 3D titles from the mid-1990s, the D-pad never disappeared; it remains a standard feature on Xbox, PlayStation, and Nintendo Switch controllers, used for menu navigation, 2D games, and secondary commands. * **Impact.** The NES D-pad established a new interaction paradigm for consumer electronics, proving that a thumb-operated, discrete-input pad could replace bulkier joysticks. Its compactness enabled the development of genuinely portable game systems, from the Game Boy to modern mobile phones. The cross-shaped directional controller became an icon of digital control, informing the design of TV remotes, PDAs, MP3 players, and automotive interfaces. In human-computer interaction research, the D-pad is often cited as a case study in minimalist, intuitive input design that balances simplicity, durability, and precision. Over three decades later, the NES controller’s D-pad continues to be referenced as the benchmark for directional pad design, and its influence can be traced in all modern button-based directional controls. ### Team * **Gunpei Yokoi.** Lead designer at Nintendo R&D1; inventor of the cross-shaped D-pad for Game & Watch and the NES controller adaptation. * **Masayuki Uemura.** Head of Nintendo R&D2; supervised the Famicom/NES hardware and integration of the D-pad controller. * **Nintendo Co., Ltd..** Overall development and manufacture of the NES-004E controller. ### Media ![Close-up of the NES D-pad with cross-shaped rocker and textured surface.](../assets/wiki/nintendo-d-pad-controller-1.jpg) *The NES D-pad in detail. Photograph from Wikimedia Commons.* ![Front view of the NES controller without cable, showing the D-pad and A/B buttons.](../assets/wiki/nintendo-d-pad-controller-2.jpg) *NES controller (no cable) from the BYU Design Review collection.* ![CAD rendering of the NES controller’s D-pad mechanism, revealing the central pivot and switch domes.](../assets/wiki/nintendo-d-pad-controller-3.png) *CAD cross-section of the D-pad pivot and rubber dome switches. Image by Nate Mattson / BYU Design Review.* ### Sources 1. Product Development Lessons from the NES Controller — The BYU Design Review — https://www.designreview.byu.edu/collections/product-development-lessons-from-the-nes-controller 2. Controller (NES-004E) – Famicom / NES | Chromagi — https://chromagi.com/nintendo/fc-nes/nes-004e/ 3. Controller pad, NES video game, Nintendo Company Ltd., 1986 | Science Museum Group Collection — https://collection.sciencemuseumgroup.org.uk/objects/co8226750/controller-pad-nes-video-game-nintendo-company-ltd-1986 4. The history of the NES’s iconic controller — XDA — https://www.xda-developers.com/from-console-to-controller-the-evolution-of-the-ness-iconic-gamepad/ 5. Nintendo Entertainment System Controller - NintendoWiki — https://niwanetwork.org/wiki/Nintendo_Entertainment_System_Controller 6. D-pad - Wikipedia — https://en-wp.org/wiki/D-pad 7. Why The NES Controller Became The Standard — Oldiesnest — https://oldiesnest.com/nintendo/why-nes-controller-became-standard/ --- ## Polhemus 3Space Isotrak (1987) **By:** Polhemus, a division of McDonnell Douglas Electronics Company **Tags:** `6DOF Tracking` `Electromagnetic Tracking` `Virtual Reality` ### Overview The Polhemus 3Space Isotrak, introduced in 1987, was the first widely available electromagnetic six‑degrees‑of‑freedom (6DOF) tracking system for interactive 3D applications. Before the Isotrak, freehand spatial input was largely confined to mechanical linkages or limited camera‑based systems; the Isotrak enabled untethered, fully immersive interaction in virtual reality (VR) and computer‑aided design (CAD). Using low‑frequency magnetic fields, a single compact sensor reported its position and orientation in real time, allowing users to look around virtual scenes, manipulate 3D objects with a stylus, or wear a head tracker for head‑mounted displays. Its introduction marked a pivotal moment in human‑computer interaction, bridging the gap between two‑dimensional interfaces and fully embodied 3D computing. The system consisted of a stationary magnetic source, a lightweight receiver/sensor, and a microprocessor‑controlled electronics unit that communicated via RS‑232 serial port. It could track within a hemispherical volume of approximately 1.5 m, with an update rate around 30 Hz and latency on the order of 30 ms – sufficient for many research and industrial applications of the era. While later systems offered greater speed, multi‑sensor capability, and higher accuracy, the Isotrak established the electromagnetic approach that remains a cornerstone of motion tracking today. Commercially, the Isotrak became a standard tool in VR labs worldwide, integrated into systems like VPL Research’s EyePhone head‑mounted display and the Convolvotron 3D audio spatializer. It also found use in biomechanics, robotics, and ergonomic assessment. Through subsequent models (Isotrak II, FASTRAK) and a lineage of modern Polhemus trackers, its legacy endures in motion‑capture studios, flight simulators, and medical training systems that still rely on the non‑line‑of‑sight magnetic tracking principle it pioneered. ### Deep dive * **Origins.** Polhemus was founded in 1970 by Bill Polhemus, initially developing magnetic navigation systems for the U.S. Navy. By the early 1980s, the company, then a division of McDonnell Douglas Electronics Company, began adapting its precision tracking technology for civilian uses. The emergence of VR research – notably at NASA Ames and VPL Research – created a demand for responsive, unencumbered 3D input. The 3Space Isotrak, launched in 1987, was the direct response: a self‑contained, affordable (for the time) 6DOF magnetic tracker that could be purchased off‑the‑shelf rather than custom‑built. It brought laboratory‑grade motion tracking into university and commercial labs, laying the groundwork for the rapid prototyping of VR interaction techniques. * **Hardware.** The original Isotrak system comprised three units: a magnetic source (a cube emitting three orthogonal low‑frequency magnetic fields), a sensor (a smaller cube with three orthogonal coils), and a desktop electronics unit that performed all calculations. The source, typically placed on a desk or tripod, generated a hemispherical working volume of about 1.5 m in diameter. The sensor, measuring roughly 2.5 cm per side, could be grasped as a stylus or attached to a headband or HMD. Data was transmitted via an RS‑232 serial interface to a host computer. Positional accuracy was advertised in the range of 0.1 inches (2.5 mm) RMS, with angular accuracy around 0.5°. The original update rate depended on the level of filtering; typical installations achieved 30 Hz, while the later Isotrak II raised that to 60 Hz. Because the system used alternating magnetic fields, it did not require line‑of‑sight and was immune to optical occlusion, but it was sensitive to ferromagnetic interference from nearby metal objects and electromagnetic noise, which could distort the tracking field. * **Interaction.** The Isotrak transformed how users interacted with 3D digital environments. In VR, a sensor mounted on a head‑mounted display provided low‑latency head tracking, enabling realistic viewpoint changes as the user turned, looked up/down, or tilted their head. In CAD, the sensor was often housed in a handheld stylus, allowing designers to navigate and manipulate virtual prototypes in full 6DOF – zooming, rotating, and panning with natural hand movements that were impossible with a mouse. Researchers also used it for free‑air gestural commands, simple motion capture, and as a spatial input for auditory displays (e.g., the Convolvotron system). The ability to track a single, unconstrained point in space opened up a new design space for interaction, influencing the development of early 3D widgets, the “data glove” concept, and immersive walkthroughs. * **Commercial fate.** The Isotrak was followed in 1990 by the 3Space Isotrak II, which offered greater range (up to 2.5 m), faster update rates (60 Hz), and a more compact electronics unit. In 1993, Polhemus launched the FASTRAK, a multi‑sensor system that could track up to four receivers simultaneously, solidifying the company’s dominance in electromagnetic tracking. The Isotrak family remained on the market for several years, used in aerospace, automotive design, and medical simulation. By the late 1990s, optical tracking systems (e.g., Vicon, OptoTrak) began to compete, and Polhemus shifted its focus to higher‑end medical and military applications. The original Isotrak gradually disappeared, but its technology evolved into the modern Liberty, Patriot, and Viper trackers still sold by Polhemus today. * **Impact.** The Isotrak’s greatest legacy is the democratization of 6DOF spatial input. Before 1987, exploring immersive VR required custom‑built, expensive, and often unreliable trackers. The Isotrak’s relative affordability and plug‑and‑play serial connection let countless university labs and small companies experiment with head‑tracked displays, 3D interaction techniques, and immersive environments. This wave of experimentation directly influenced the graphical user interfaces of 3D modeling software, the design of video game controllers (e.g., Nintendo’s Power Glove used magnetic tracking concepts), and the growing field of HCI research into embodied interaction. Even today, electromagnetic tracking remains the technology of choice in surgical navigation, pilot helmet‑mounted displays, and motion‑capture where optical systems fail due to occlusion. The Polhemus 3Space Isotrak thus stands as a foundational artifact in the history of virtual reality and spatial computing. ### Team * **Bill Polhemus.** Founder and inventor of the electromagnetic tracking technology * **Polhemus (division of McDonnell Douglas Electronics).** Developer and manufacturer ### Media ![Polhemus 3Space Isotrak system with electronics unit and sensor](../assets/wiki/polhemus-isotrak-1.png) *The Polhemus 3Space Isotrak system, comprising the desktop electronics unit (left) and the magnetic sensor (right). Source: XVRWiki.* ![Polhemus 3Space Isotrak II system](../assets/wiki/polhemus-isotrak-2.gif) *The later Polhemus 3Space Isotrak II (1990), with improved range and speed. Source: XVRWiki.* ![Thumbnail of Polhemus 3Space Isotrak system](../assets/wiki/polhemus-isotrak-3.png) *Alternate view of the Isotrak setup. Source: XVRWiki.* ### Sources 1. 3Space Isotrak – XVRWiki — http://www.xvrwiki.org/wiki/3space_isotrak 2. 3Space Isotrak II – XVRWiki — https://www.xvrwiki.org/wiki/3Space_Isotrak_II 3. Polhemus company website — https://polhemus.com/ 4. Polhemus 3SPACE ISOTRAK II Brochure (historical specs) — https://segaretro.org/images/archive/b/be/20180704082333%21Polhemus_3SPACE_ISOTRAK_II_Brochure.pdf 5. ResearchGate: Polhemus Isotrak head tracking hardware (image context) — https://www.researchgate.net/figure/Left-Convolvotron-card-set-Right-Polhemus-Isotrak-head-tracking-hardware-including_fig1_287585070 --- ## Poqet PC (1989) **By:** Poqet Computer Corporation **Tags:** `Palmtop PC` `Power Management` `MS-DOS` ### Overview The Poqet PC, introduced in 1989, was the first IBM PC-compatible palmtop computer capable of running MS-DOS at CGA resolutions. It measured just 9.5 × 4 × 1 inches and weighed 1.2 pounds, making it truly pocketable. A pair of standard AA batteries powered the device for weeks—even months—thanks to pioneering power-management techniques, including halting the CPU between keystrokes and maintaining RAM state in a deep-sleep mode. Its “instant-on” capability allowed users to resume exactly where they left off without booting, a radical departure from the slow startup of contemporary laptops. The Poqet PC featured an NEC V30 (or 80C88) processor, 640 KB of RAM, 1 MB of ROM containing MS-DOS 3.2, GW-BASIC, and a suite of personal information management applications. The reflective supertwist LCD displayed 25 lines by 80 characters, enabling standard DOS applications to run unmodified. Two PCMCIA Type I slots accepted solid-state memory cards for file storage, and a serial port provided connectivity with desktop machines. The keyboard, though small, offered full-travel tactile keys and dedicated function keys, earning praise for its usability. Despite a price of US$2,000—equivalent to over $4,500 today—the Poqet PC garnered strong interest from enterprise and government users who required a portable DOS environment. Its design influenced subsequent palmtops like the Hewlett-Packard 95LX and demonstrated that aggressive power management could deliver true all-day (and all-week) mobile computing. The Poqet PC remains a seminal artifact in the history of mobile interaction, illustrating how carefully engineered suspend-resume behavior and frugal hardware can transform user experience. ### Deep dive * **Origins.** Poqet Computer Corporation was founded in 1987 by John Fairbanks, David Wharton, and other former Convergent Technologies engineers. The Santa Clara, California-based company set out to create a pocket-sized, fully PC‑compatible machine that could run standard DOS software. The Poqet PC was unveiled at Spring COMDEX in 1989 and began shipping later that year, beating competitors such as the Atari Portfolio to deliver a complete DOS environment in a handheld form factor. * **Hardware.** The Poqet PC uses an NEC V30 microprocessor (a CMOS 8086 variant) running at 7.15 MHz, with 640 KB of DRAM (512 KB available to applications) and 1 MB of ROM holding MS-DOS 3.2, GW-BASIC, and built‑in PIM applications (phone book, notepad, calculator, clock). Its monochrome reflective supertwist LCD provides 640×200 pixel CGA‑compatible graphics in a 25‑line × 80‑column text mode. Two PCMCIA Type I slots accept SRAM cards up to 512 KB each for nonvolatile storage. A full‑travel 78‑key keyboard delivers tactile feedback, and an RS‑232 serial port (plus an optional dock with parallel) handles connectivity. The machine is powered by two AA alkaline batteries; aggressive power management—including stopping the CPU between interrupts and maintaining RAM in deep sleep—extends battery life to 30–100 hours of active use and weeks of standby. A supercapacitor preserves memory for a few minutes during battery changes. * **Interaction.** Keyboard input drives the system: every keystroke wakes the CPU just long enough to process the character before returning to sleep, so typing demands minimal power. The “instant‑on” feature lets users resume a session immediately without booting, making the device feel like a calculator. The reflective screen offers high contrast but no backlight, relying on ambient light. Built‑in software uses pop‑up menus and cursor keys, while standard DOS applications (WordPerfect, Lotus 1‑2‑3) run from memory cards, delivering a portable office. File exchange with a desktop is possible via LapLink over the serial port. This seamless, power‑thrifty interaction model removed the friction of startup delays and constant saving, redefining what a pocket computer could be. * **Commercial fate.** Priced at around US$2,000, the Poqet PC gained favor with business and government users but remained a niche product. In 1991 the company released the Poqet PC Plus with a backlit display and 1.5 MB of RAM. Facing financial pressures, Poqet Computer Corporation was acquired by Fujitsu Ltd. in 1992. Fujitsu formed Fujitsu Personal Systems and gradually phased out the Poqet brand, shifting focus to Windows CE pen tablets. The original Poqet PC was discontinued after the acquisition, but its engineering DNA influenced Fujitsu’s later mobile offerings. * **Impact.** The Poqet PC established the benchmark for MS‑DOS palmtops, directly inspiring the HP 95LX and subsequent HP palmtops that adopted similar power management and form factors. Its CPU‑halting technique and suspend‑resume architecture became standard in later laptops and handhelds, embodying the “always on, always connected” ideal. The use of PCMCIA slots foreshadowed the PC Card standard, while full DOS compatibility proved that pocketability did not mean sacrificing the PC software ecosystem. Today, the Poqet PC is recognized as a key milestone in HCI for its elegant integration of low‑power hardware and user‑transparent interaction, prefiguring modern smartphones and instant‑on devices. ### Team * **John Fairbanks.** Founder and CEO of Poqet Computer Corporation * **David Wharton.** Founder and VP of Engineering * **Poqet Computer Corporation.** Developer and manufacturer ### Media ![Poqet PC opened, showing keyboard and LCD](../assets/wiki/poqet-pc-1.jpg) *The original Poqet PC in its clamshell form. Source: Wikimedia Commons.* ![Poqet PC Plus model](../assets/wiki/poqet-pc-2.jpg) *Poqet PC Plus, the 1991 variant with a backlit display. Source: Wikimedia Commons.* ![Poqet PC held in hand for scale](../assets/wiki/poqet-pc-3.jpg) *Poqet PC Classic model, demonstrating pocketability. Source: The Centre for Computing History.* ### Sources 1. Poqet PC - Wikipedia — https://en.wikipedia.org/wiki/Poqet_PC 2. Poqet PC (Classic Model) - The Centre for Computing History — https://www.computinghistory.org.uk/det/15670/Poqet-PC-(-quot-Classic-quot-Model)/ 3. The Poqet PC user's guide - Computer History Museum — https://www.computerhistory.org/collections/catalog/102683011 4. Poqet PC Users Guide 1989 PDF - Bitsavers — https://bitsavers.org/pdf/poqet/Poqet_PC_Users_Guide_1989.pdf 5. Poqet PC FAQ - Bryan Mason — https://www.bmason.com/PoqetPC/faq/poqetpc.html 6. Digibarn Systems: Poqet PC — https://digibarn.com/collections/systems/poqet-pc/index.html 7. Poqet PC - Obsolete Computer Museum — http://www.obsoletecomputermuseum.org/poqet_pc/ 8. Poqet PC Technical Developer's Manual - Chapter 1 — https://www.bmason.com/PoqetPC/docs/poqetpc/techref/chapter1.html --- ## Psion Organiser II (1986) **By:** Psion PLC **Tags:** `Personal Digital Assistant` `Mobile Database` `Calculator` ### Overview The Psion Organiser II, launched in 1986, is a landmark pocket computer widely regarded as the first practical personal digital assistant (PDA). Encased in a rugged hard‑plastic body with a distinctive sliding cover, it features a 6×6 alphabetical keypad and a two‑line, 16‑character liquid‑crystal display. The device combined an electronic diary, a searchable address database, an alarm clock, and a scientific calculator, directly competing with the paper‑based Filofax. At its core is an 8‑bit HD6303Y microprocessor running at 0.92 MHz, typically with 8 KB of RAM (later models offered up to 32 KB). The interchangeable top slot accepted Datapaks – solid‑state program cartridges – while the two side slots accommodated Rampaks for additional memory, a forerunner of removable storage cards. A built‑in programming language, POPL (Psion Organiser Programming Language), allowed users to write custom database applications; machine‑code execution was also supported. By integrating a mobile database, calculator, and time‑management tools in a pocket‑size format, the Organiser II defined a new interaction paradigm for portable computing. Its expandability through Datapaks and the ability to run user‑created software anticipated features that would later become standard in PDAs and smartphones. ### Deep dive * **Origins.** Psion was founded in 1980 by David Potter with the goal of creating handheld computers for practical personal use. The Organiser I appeared in 1984 as a simple diary and calculator, but it was the Organiser II, released two years later, that refined the concept into a full‑featured pocket information manager. Potter’s ambition was to replace traditional paper organisers with a device that could not only store data but also run custom programs, a vision that drove the design of the Organiser II’s expansion system and programming environment. * **Hardware.** The Organiser II is built around a Hitachi HD6303Y processor clocked at 0.92 MHz. Base models carry 8 KB of RAM, while later variants (e.g., the LZ model) provided 32 KB. The monochrome LCD shows two lines of 16 characters. The 6×6 keypad places letters alphabetically, with dedicated keys for frequently used functions. Power comes from a standard 9 V battery or an external supply. A hallmark of the design is the hard‑plastic sliding cover that protects the keypad and display when not in use. The top expansion slot exposes an 8‑bit parallel bus, accepting ROM‑based Datapaks (program cartridges) and later FlashPaks; two side slots allow connection of Rampaks for additional memory, a feature that has been expanded by the community to 256 KB and even 512 KB today. The slot interface also enabled peripheral devices such as a Comms Link for RS‑232 communication. * **Interaction.** Interaction with the Organiser II is menu‑driven. Upon power‑on, the main menu offers access to the diary, phone book (address database), clock/alarm, calculator, and the programming language POPL. The diary and phone‑book entries are fully searchable by text string, a novel feature for a pocket device at the time. The calculator provides scientific functions and can be used interactively, while the alarm clock can be set with any diary entry. Programs written in POPL appear as menu items and can manipulate the built‑in databases or create new ones. All input is textual via the 6×6 keypad, and output is limited to the 16‑character lines, requiring a concise, task‑focused interaction style. The sliding cover doubles as a physical power switch – opening the cover activates the device – reinforcing a direct, tactile interaction metaphor. * **Commercial fate.** The Organiser II enjoyed modest commercial success in the late 1980s, particularly among business professionals and field workers. Its ascendancy was overshadowed by the launch of the Psion Series 3 in 1991, a clamshell PDA with a larger screen and a more sophisticated operating system. Psion gradually withdrew from the consumer handheld market, re‑focusing on the development of the Symbian OS and later industrial data‑collection equipment. The Organiser II line was discontinued, but it has acquired a cult following. A dedicated hobbyist community continues to develop hardware add‑ons – including a JavaScript emulator, USB CommsLinks, Rampaks up to 256 KB, and 512 KB FlashPaks – keeping the platform alive as of autumn 2024. * **Impact.** The Psion Organiser II is recognised as a pioneering PDA. It demonstrated that a pocket‑sized device could serve as a credible mobile database, diary, and calculator, establishing interaction patterns that were later refined by the Psion Series 3 and 5, and by devices such as the Palm Pilot. The Datapak/Rampak expansion model prefigured today’s removable memory cards, while the user‑programmable POPL language anticipated the app‑store model of later mobile platforms. By proving that a handheld computer could replace a paper organiser and run purpose‑built applications, the Organiser II secured a place in the history of portable computing. ### Team * **Psion PLC.** British electronics company; developer and manufacturer of the Organiser II * **David Potter.** Founder of Psion, who drove the vision for pocket‑sized information management ### Media ![Psion Organiser II open and closed](../assets/wiki/psion-organiser-ii-3.jpg) *Psion Organiser II units shown open and closed, with the 6×6 alphabetic keypad and protective sliding cover visible. Source: Wikimedia Commons.* ![Psion Organiser II with cover](../assets/wiki/psion-organiser-ii-2.jpg) *Organiser II with cover, showing the physical shell that made the pocket-computer interaction feel appliance-like rather than laptop-like. Source: Wikimedia Commons.* ![Psion Organiser II product image](../assets/wiki/psion-organiser-ii-1.gif) *Psion Organiser II product image from the Wikipedia infobox. Source: Wikimedia Commons.* ### Sources 1. Psion Organiser – Wikipedia — https://en.wikipedia.org/wiki/Psion_Organiser 2. Jaap's Psion Organiser II Page – Technical Reference Manual — https://www.jaapsch.net/psion/tech.htm 3. Retro Isle – Psion Organiser II Technical Reference Manual — https://www.retroisle.com/others/psion/organiser2/OriginalDocs/org2techmanual.php --- ## Summagraphics Bit Pad (1977) **By:** Summagraphics Corporation **Tags:** `Digitizing Tablet` `Absolute Positioning` `Professional Graphics` ### Overview The **Summagraphics Bit Pad** (often referred to as the Bit Pad One) is a landmark digitizing tablet introduced in 1977 by Summagraphics Corporation of Fairfield, Connecticut. It was one of the first commercially available, high‑precision absolute‑coordinate input devices targeted at professional users, predating the consumer drawing pads that would arrive years later. Unlike relative pointing devices such as the computer mouse, the Bit Pad enabled direct mapping of physical motion to screen coordinates, making it indispensable for computer‑aided design (CAD), cartographic digitizing, and early computer graphics. Built around a magnetostrictive sensing grid embedded beneath a hard, flat surface, the tablet accepted input from either a pen‑like stylus or a puck cursor. With an active area of 12 × 12 inches (305 × 305 mm), a resolution of 0.005 inches (0.127 mm), and an accuracy of ±0.015 inches (0.38 mm), the Bit Pad One delivered the level of precision required to trace blueprints, maps, and intricate line art directly into digital form. It connected to host computers through a standard RS‑232 serial interface and was supplied with drivers for popular microcomputer and minicomputer systems of the era. The Bit Pad firmly established the professional digitizing tablet as a vital peripheral in CAD, GIS, and electronic prepress workflows throughout the 1980s. Its absolute positioning paradigm—where lifting the stylus and placing it elsewhere immediately gave the correct X,Y coordinates—solved the drift and re‑calibration issues that plagued early relative devices. By commercializing a technology that had previously been confined to research labs, Summagraphics shaped the interface language that would later be inherited by modern graphics tablets and pen‑enabled displays. ### Deep dive * **Origins.** Summagraphics Corporation was founded in 1972 with a focus on developing advanced digitizer technologies for industrial and scientific applications. While earlier experimental tablets such as the RAND Tablet (1964) had demonstrated the principle of absolute coordinate sensing, they were laboratory curiosities. The Bit Pad One, released in 1977, represented one of the first serious attempts to turn that capability into a reliable, mass‑produced peripheral for the growing market of microcomputers and engineering workstations. It built on magnetostrictive sensor technology that Summagraphics had refined, allowing a pen or puck to be sensed through a robust, non‑membrane surface. * **Hardware.** The Bit Pad One housed a magnetostrictive wire grid beneath a rigid 12 × 12‑inch (305 × 305 mm) active area, surrounded by a sturdy metal or plastic enclosure measuring approximately 14.5 × 14.5 × 1.5 inches (368 × 368 × 38 mm) and weighing around 11 pounds (5 kg). The grid produced a magnetic field; when the coil in the stylus or puck passed over it, the tablet electronics measured the time delay of the induced pulse to calculate the absolute X and Y position. Resolution was 0.005 inches (0.127 mm), with a specified accuracy of ±0.015 inches (0.38 mm). Users could choose between a corded pen with a tip‑activated switch or a cursor puck fitted with crosshairs and multiple buttons. Data was transmitted via a standard RS‑232 serial port, and an external power supply provided the necessary operating voltages. * **Interaction.** The core interaction paradigm was straightforward yet transformative: wherever the user placed the stylus or puck on the tablet, the corresponding screen coordinate would be registered immediately and absolutely. There was no need to zero the device or move it like a mouse; a drawing or tracing could be paused at any time and resumed without loss of position. This absolute mode was essential for tasks such as tracing paper‑based maps, architectural blueprints, or engineering drawings that were taped to the tablet surface. The tip switch of the stylus (or the buttons on the puck) sent a signal that told the computer when to “lower the pen” or “lift it,” enabling the creation of continuous strokes or isolated points. Drivers for operating systems like CP/M and MS‑DOS mapped the 12‑inch digitizing area to the full video display, giving users a natural, eye‑hand‑coordination‑friendly drawing experience long before on‑screen tablets existed. * **Commercial fate.** Summagraphics rapidly became a market leader in digitizing tablets during the 1980s, with the Bit Pad One at the core of its product line. The tablet found widespread use in industries ranging from aerospace design and naval architecture to printed‑circuit‑board layout and cartography. As the technology matured, Summagraphics introduced larger models (the Bit Pad Two, for example, offered active areas up to 44 × 60 inches) and variants with different interfaces. The company remained an independent entity until 1996, when it was acquired by GTCO Corporation to form GTCO CalComp. Although the Bit Pad name eventually disappeared, the underlying magnetostrictive technology persisted in professional digitizers for decades, and the absolute‑positioning concept influenced the development of later consumer graphics tablets from manufacturers such as Wacom. * **Impact.** The Summagraphics Bit Pad One helped define the look and feel of early computer‑aided design and digital mapping. By offering a reliable, high‑precision absolute input method, it solved a critical human‑interface problem: how to let professionals draw and trace with digital fidelity. The tablet’s RS‑232 interface became a de facto standard for graphics peripherals, encouraging the creation of software that could accept streamed coordinate data. This early “pen and tablet” model established the conceptual foundation for the corded stylus tablets that appeared in the late 1980s and for today’s screen‑equipped drawing displays. In museum collections, the Bit Pad is preserved not only as a piece of hardware but as a milestone in human‑computer interaction, marking the moment when absolute position sensing moved from the laboratory to the everyday toolkit of engineers, artists, and mapmakers. ### Team * **Summagraphics Corporation.** Developer and manufacturer of the Bit Pad series ### Media ![Summagraphics Bit Pad One digitizing tablet with stylus pen](../assets/wiki/summagraphics-bit-pad-1.jpg) *A Summagraphics Bit Pad One, showing the active drawing area and stylus. (Source: The Centre for Computing History)* ### Sources 1. Summagraphics Bit Pad One – Computing History — https://www.computinghistory.org.uk/det/16811/Summagraphics-Bit-Pad-One/ 2. Summagraphics Bit Pad One – Computer History Museum, catalog no. 102743841 — https://www.computerhistory.org/collections/catalog/102743841 3. BitPad One digitizing tablet – Computer History Museum, catalog no. X511.84 — https://www.computerhistory.org/collections/catalog/X511.84 4. Graphics tablet – Wikipedia — https://en.wikipedia.org/wiki/Graphics_tablet --- ## WriteHander (1978) **By:** NewO Company **Tags:** `Chorded Keyboard` `Wearable` `Eyes-Free` ### Overview The WriteHander is one of the earliest commercial attempts at a compact, eyes-free chorded text-entry device. Introduced in 1978 by the NewO Company, it was a handheld, one‑handed keyboard that produced characters through simultaneous keystrokes (chords) rather than sequential presses. The device was designed for portability and mobility, allowing a user to type while holding the unit in one hand and leaving the other hand free—a concept decades ahead of later wearable keyboards. Physically, the WriteHander resembled a small paperback book with a six‑key arrangement: five finger keys and a thumb key. Its small alphanumeric display gave immediate visual feedback of the entered character. By relying on chord combinations, an experienced user could input the entire ASCII character set without ever looking at the keys, making it suitable for notetaking, tele‑operation, or data entry in constrained environments. Although its commercial life was brief, the WriteHander pre‑figured later chording devices such as the Microwriter (1980), the Twiddler, and modern wearable keyers. It stands as a key artifact in the lineage of alternative keyboard research, bridging the gap from early stenographic machines to present‑day mobile and accessible text‑input systems. ### Deep dive * **Origins.** The WriteHander emerged during a period when personal computers were proliferating but input methods were still tied to desk‑bound typewriter‑style keyboards. Chording itself had a long history—in stenotype machines and Braille writers—but commercial electronic chorders for general computing did not yet exist. NewO Company, a now‑obscure firm possibly based in the United Kingdom or United States, seized on the idea of a one‑handed, cable‑connected chord keyboard. Their aim was to produce a truly portable writing tool that freed users from the physical desk. The WriteHander predated the better‑known Microwriter (1980) by two years, placing it among the very first products to bring chording to the consumer electronics market. * **Hardware.** The WriteHander was a molded plastic unit roughly the size of a small paperback novel. Its main face held five circular mechanical keys in a row for the fingers, while a thumb key sat on the right side (for right‑handed users) or was positioned ergonomically for the thumb. Each key gave a distinct tactile click when pressed. A single‑line alphanumeric display—likely an LED or early vacuum‑fluorescent type—showed the character just typed. The device communicated with a host computer over a serial cable, drawing power from the host. The absence of a battery kept it lightweight, at the cost of tethering the user. Production numbers were likely very low, and surviving units are extremely rare. * **Interaction.** Text entry relied on pressing a combination of the six keys simultaneously. Each chord corresponded to a letter, digit, punctuation mark, or control code, following a memorized chart. For example, the ‘A’ chord might be index+middle finger, while ‘E’ could be index+pinky. The thumb key frequently served as a mode‑shift, enabling uppercase, numeric, or symbol layers. Typing was essentially a continuous sequence of brief chording motions. Once the mapping was learned, the user could type without looking at the keyboard, receiving confirmation from the display or, later, from an auditory feedback mechanism if the host provided it. The design traded the simplicity of a standard keyboard for dramatic size reduction and hands‑free flexibility, but required a significant initial learning investment. * **Commercial fate.** The WriteHander failed to find a sustainable market. In the late 1970s the personal computer industry was overwhelmingly oriented toward full‑size QWERTY keyboards, and the idea of learning a completely new input method held little appeal for mainstream users. The high retail cost relative to early home computers, combined with a complete lack of software support for chord‑based input, limited sales to a small circle of enthusiasts and experimenters. NewO Company appears to have discontinued the product within a few years and subsequently faded from the industry. Today, the WriteHander is a rare collector’s item, known chiefly to keyboard historians and vintage computing aficionados. * **Impact.** Despite its commercial failure, the WriteHander occupies an important position in the history of human‑computer interaction. It was among the first portable chord keyboards sold to the public, demonstrating that a one‑handed, eyes‑free text entry device was technically feasible and could be built with off‑the‑shelf components. The concept directly influenced Cy Endfield’s Microwriter, which achieved greater recognition in the early 1980s, and can be traced through successive generations of chording devices—the Twiddler, the Septambic keyer, and contemporary wearable input research. In the context of mobile and ubiquitous computing, the WriteHander’s ambition to decouple text entry from the desk continues to resonate, making it a foundational artifact for studies of alternative and accessible keyboards. ### Team * **NewO Company.** Manufacturer; designer unknown ### Media ![Front view of the WriteHander chorded keyboard](../assets/wiki/writehander-1.jpg) *The WriteHander, showing the five finger keys, thumb key, and built‑in display. (Image: ibnteo.klava.org)* ![Rear view of the WriteHander](../assets/wiki/writehander-2.jpg) *Rear case and connector of the WriteHander. (Image: ibnteo.klava.org)* ### Sources 1. Bill Buxton, “CASE STUDY 2: CHORD KEYBOARDS” (PDF), covers the history of chorded input including early commercial attempts. — https://www.billbuxton.com/input06.ChordKeyboards.pdf 2. Wikipedia, “Chorded keyboard” — outlines the Writehander as a 1978 one‑handed keyboard from NewO Company. — https://en.wikipedia.org/wiki/Chorded_keyboard 3. Блог Вольки, “The NewO Writehander” — detailed description and photographs of the device. — http://ibnteo.klava.org/keyboard/writehander --- ## Fairlight CMI (Computer Musical Instrument) (1979) **By:** Fairlight Instruments Pty Ltd (Peter Vogel, Kim Ryrie) **Tags:** `Music HCI` `Light Pen` `Digital Audio` `Sampling` `Workstation` ### Overview The Fairlight CMI (Computer Musical Instrument) was the first commercially available digital sampling synthesizer and music workstation, created by Peter Vogel and Kim Ryrie in Sydney, Australia, and launched in 1979. It combined an 8-bit sampler, additive synthesis, a graphical sequencer, and a music keyboard into a single console. Its defining HCI feature was a **light pen** used directly on the CRT display: musicians could draw sound waveforms, adjust harmonic sliders, and compose music by pointing at visual representations of notes — all without a mouse, years before the Macintosh popularized the WIMP interface. The CMI was built around dual Motorola 6800 processors, booted from 8-inch floppy disks, and displayed in green monochrome at 512×256 pixels. The light pen detected electron-beam hits on the CRT and, combined with a pressure-sensitive tip switch, enabled direct pointing, selection, and drawing. A QWERTY keyboard handled symbolic input; the light pen handled spatial tasks. The result was a dual-modality interface that bridged the command-line and GUI eras. Only about 300 units of the Series I, II, and IIx were built, priced between £15,000 and £30,000. The user list reads like a who's-who of 1980s music: Peter Gabriel, Kate Bush, Herbie Hancock, Stevie Wonder, Jean-Michel Jarre, Art of Noise, and Jan Hammer. The CMI's 8-bit sampling grit and its iconic ORCH2 "orchestra hit" became the sonic signature of the decade. Its Page R sequencer invented the piano-roll/pattern-grid editing paradigm that every modern DAW still uses. ### Deep dive * **Origins.** The Fairlight CMI began with Tony Furse's Qasar M8, an 8-voice digital synthesizer built for the Canberra School of Electronic Music in 1974–75. The Qasar already featured a light pen, graphic display, and dual Motorola 6800 processors. Peter Vogel and Kim Ryrie licensed the design and spent 1976–1979 turning it into a commercial product. The company was named after the Fairlight hydrofoil ferry passing Ryrie's grandmother's house in Sydney Harbour. The Series I launched in 1979; Series II (1982) added the iconic Page R sequencer; Series III (1985) replaced the light pen with a graphics tablet after user complaints about arm fatigue from holding a pen against a vertical CRT. * **Light pen interaction.** The light pen was a photodiode sensor in a tethered wand. As the CRT's electron beam scanned the phosphor screen line by line, the pen detected the flash of light when the beam passed beneath its tip. The video card latched the current X-Y coordinates, giving screen position. Pressing the pressure-sensitive tip switch confirmed a selection. The UI was organized into 18 numbered 'pages' — waveform drawing (Page 6), harmonic envelopes (Page 4), harmonic sliders (Page 5), sound sampling (Page 8), and the waveform 'mountain range' display (Page D). Users could draw waveforms directly on screen 'as simple as drawing on the back of a bus ticket' (EMM, 1985). The MERGE function computed intermediate waveform segments — early computational morphing. The QWERTY keyboard handled text entry and numeric commands; the light pen handled all spatial/drawing tasks. Only about 5% of functions required the keyboard. * **Page R — the first graphical pattern sequencer.** Created by Michael Carlos for the Series II in 1982, Page R displayed notes as horizontal bars on a grid, read left to right like a piano roll. Up to 8 monophonic parts per pattern, 255 patterns chained into 26 phrases (A–Z). This invented the visual pattern-grid editing paradigm and the concept of quantization, now universal in DAWs (Ableton Live, Logic, FL Studio, Cubase). Audio Media Magazine (1996) noted it 'heralded the democratisation of music creation, making it available to the musically chops-challenged.' CMI user Roger Bolton: 'The CMI II was a high-level composition tool that not only shaped the sound of the 80s, but the way that music was actually written.' * **8-bit sampling sound.** Each of 8 voice cards had 16KB of waveform RAM, sampled at 8–32 kHz with 8-bit resolution — a typical sound was 0.25 to 1 second long. The low sample rates introduced aliasing artifacts that Peter Vogel called 'their own character.' The bass response was reportedly 'awesome with an ability to move furniture.' Boris Blank of Yello still considers its sound superior to later digital samplers. The famous ORCH2 sample — a Stravinsky Firebird stab grabbed from Vogel's vinyl collection — became the most-sampled sample of all time, heard on thousands of records from Afrika Bambaataa to Bruno Mars. ARR1, an ethereal breathy choir created from singer Sarah Cohen's voice, was another ubiquitous sound. * **Commercial fate and legacy.** Only about 300 CMIs were built. Priced at £15,000–£30,000 (roughly £60,000–£110,000 in 2024), it was undercut by MIDI-based systems by the late 1980s. Fairlight pivoted to video post-production and ceased music products by 1989. Yet its influence is extraordinary: the first general-public user of a light pen for creative work, the first graphical music sequencer, the origin of the word 'sampling' in music. It was the original digital audio workstation, a decade before Pro Tools. Peter Vogel later released Fairlight CMI apps for iOS (2011) — the £27,000 sound became a £29.99 app. The CMI was named as the inspiration for the Swedish demoscene group Fairlight, and the UK Musicians' Union called it a 'lethal threat' to orchestral players. Phil Collins put a disclaimer on No Jacket Required (1985): 'There is no Fairlight on this record.' ### Team * **Peter Vogel.** Electronics designer and co-founder of Fairlight Instruments; built the CMI hardware. * **Kim Ryrie.** Co-founder of Fairlight Instruments; synthesizer enthusiast and founder of Electronics Today International magazine. * **Tony Furse.** Built the Qasar M8 digital synthesizer (1974–75), whose light-pen architecture was licensed as the basis for the CMI. * **Michael Carlos.** Created Page R, the first graphical pattern-based music sequencer, for the Series II in 1982. ### Media ![Fairlight CMI Series II with CRT, keyboard, and light pen](../assets/wiki/fairlight-cmi-1.jpg) *A Fairlight CMI Series II workstation showing the green-screen CRT, QWERTY and music keyboards, and 8-inch floppy drives. (Wikimedia Commons)* ![Fairlight CMI Page R sequencer screen](../assets/wiki/fairlight-cmi-2.jpg) *Page R, the first graphical pattern sequencer, displaying notes as horizontal bars on a piano-roll grid (1982). (Wikimedia Commons)* ### Sources 1. Fairlight CMI - Wikipedia — https://en.wikipedia.org/wiki/Fairlight_CMI 2. Sound on Sound Retrozone — Fairlight CMI — https://www.soundonsound.com/reviews/fairlight-cmi-retrozone 3. The Register — 'Rolls Royce of synthesizers' — https://www.theregister.com/2011/04/29/fairlight_synthesiser/ 4. Peter Vogel Instruments — Fairlight History — https://petervogelinstruments.com.au/fairlight-history/ 5. EMM — 'The Fairlight Explained' (1985, Page 6 light pen) — https://www.muzines.co.uk/articles/the-fairlight-explained/1892 6. Science & Media Museum — Fairlight CMI Playlist — https://blog.scienceandmediamuseum.org.uk/fairlight-cmi-playlist/ 7. Herbie Hancock demonstrating the Fairlight CMI (YouTube) — https://www.youtube.com/watch?v=Lfgf9HatIHI --- ## Konami LaserScope (1990) **By:** Konami Industry Co. Ltd. **Tags:** `Voice Control` `Head-Mounted Display` `Gaming` `Wearable` `NES` ### Overview The Konami LaserScope was a voice-activated headset targeting system for the Nintendo Entertainment System, released in 1990. Unveiled at the June 1990 Summer Consumer Electronics Show in Chicago, it was a $39.95 white plastic headset with over-ear headphones, a boom microphone, and a transparent eyepiece that hung in front of the player's right eye. The eyepiece projected a red LED crosshair reticle that the player superimposed on the TV screen. When the player shouted 'Fire!' (or any sufficiently loud noise), the microphone triggered the light gun sensor, effectively acting as a voice-controlled NES Zapper. The headset connected to controller port 2 and drew power from the NES's audio output jacks — no batteries required. The eyepiece contained a photodiode sensor that worked like a standard NES Zapper, detecting the CRT's scanline flash when aimed at a valid target. A critical design flaw: the LaserScope could not function standalone; a regular NES Zapper also had to be plugged into controller port 1. Only an estimated 5,000–10,000 units were produced. It was designed primarily for the game Laser Invasion (1991) but worked with any NES Zapper-compatible game. Retrospective consensus ranks it among the worst video game peripherals ever made — the microphone triggered on any loud noise including breathing and coughing, head-based aiming caused neck fatigue, and the device fit only the smallest heads. Yet it stands as one of the earliest mass-market voice-controlled gaming peripherals and a remarkably prescient combination of head-mounted display, voice input, and spatial aiming that would not be practically realized until modern VR headsets, two decades later. ### Deep dive * **Origins.** Konami developed the LaserScope internally as a peripheral for the NES Zapper software library. It was demonstrated at the June 1990 Summer CES by Konami marketing coordinator Susan Bach, at the same show where Nintendo unveiled the Super Famicom (SNES) and Sega showed the Game Gear — meaning the LaserScope was promoting a peripheral for a console already nearing the end of its commercial life. The companion game Laser Invasion (known as Gun Sight in Japan, though the Japanese Famicom version did not support the LaserScope) was released in 1991 and included a mail-in rebate for the headset. The game's villain was named 'Sheik Toxic Moron,' who planned world domination with his 'TechnoScorch Missile.' * **Hardware and interaction design.** The white plastic headset featured an adjustable headband, over-ear stereo headphones that played game audio, a boom microphone positioned near the mouth, and a transparent plastic eyepiece on an articulated arm in front of the right eye. The eyepiece projected a red LED crosshair onto its surface, creating a heads-up-display-style aiming reticle the player could see superimposed on the TV. Aiming required moving the entire head rather than the wrist (as with the handheld Zapper) — physically tiring and slower. The microphone used a simple amplitude threshold, not actual speech recognition: any sufficiently loud noise — shouting, clapping, breathing near the mic, or 'a seagull outside' — would fire. The detachable scope module allowed the headset to function as standalone stereo headphones with any audio source, connected via the NES's RCA audio output. * **The fatal design flaw.** The LaserScope could not operate on its own. It plugged into controller port 2, but a standard NES Zapper also had to be plugged into controller port 1 for the system to recognize light gun input. The LaserScope essentially acted as a voice-triggered remote trigger for the Zapper connection. You literally needed a better controller to use the worse one. This dual-peripheral requirement, combined with mic hyper-sensitivity, head-aiming fatigue, a short cable limiting playing distance, and a hard plastic headset that seemed 'designed for the smallest of all children,' made the device nearly unusable in practice. * **Commercial fate.** The LaserScope was an unequivocal commercial failure. Consolevariations estimates only 5,000–10,000 units were produced, with a rarity score of 66/100. Only one game was specifically designed for it (Laser Invasion), and it worked poorly even with that. Early reviews from Game Players magazine called it 'a little gimmicky, but it works' (January 1991) before later noting the microphone's hyper-sensitivity made shouting 'awkward' (July 1991). It appears on virtually every 'worst video game peripherals ever' list. Jeff Gerstmann of Giant Bomb placed it among 'that tier of NES peripherals that are these weird, optional things... You're just playing the same video games with flimsier, fudgier controls.' Today, surviving units are sought-after collector's items. * **HCI significance.** Despite its failure, the LaserScope matters deeply to HCI history. It was arguably the first mass-market consumer voice-controlled video game peripheral, predating Microsoft Kinect voice commands by 20 years and modern voice assistants by even longer. It attempted to combine head-based spatial aiming, visual heads-up display, voice input, and audio output into a single wearable device — a remarkably ambitious integration of multiple interaction modalities for 1990. The projected crosshair on a transparent eyepiece was an early consumer implementation of an augmented-reality-style HUD. It is cited in academic HCI literature on voice interaction in games (DiGRA, SAGE Journals) and in studies of disability and voice-enabled gaming (Springer). As a design-failure case study, it illustrates why novel interaction modalities require careful usability testing: every core design choice created friction that compounded into unusability. ### Team * **Konami Industry Co. Ltd..** Japanese video game developer and publisher; developed the LaserScope internally as an NES peripheral. * **Susan Bach.** Konami marketing coordinator who demonstrated the LaserScope at the June 1990 Summer CES (Associated Press photo). * **Nobuya Nakazato.** Director and artist for Laser Invasion (1991), the primary game designed for the LaserScope. * **Masato Maegawa.** Main programmer for Laser Invasion. ### Media ![Konami LaserScope demonstrated at 1990 CES](../assets/wiki/konami-laserscope-1.jpg) *Konami marketing coordinator Susan Bach demonstrates the LaserScope at the Summer CES, Chicago, June 1990. The headset includes the boom microphone, headphones, and transparent eyepiece with projected crosshair. (AP Photo/Mark Elias via Forbes)* ![Konami LaserScope peripheral for the NES](../assets/wiki/konami-laserscope-2.jpg) *The Konami LaserScope headset — a white plastic wearable with over-ear headphones, articulated eyepiece, and boom microphone. (Wikimedia Commons)* ### Sources 1. LaserScope - Wikipedia — https://en.wikipedia.org/wiki/LaserScope 2. Forbes — 'The Konami LaserScope' (AP photo from 1990 CES) — https://www.forbes.com/sites/davidewalt/2012/05/29/the-konami-laserscope/ 3. Consolevariations — Konami NES Laser Scope — https://consolevariations.com/collectibles/konami-nes-laser-scope 4. RetroGamingStuff — 'The Konami Laser Scope: Why?' — https://retrogamingstuff.wordpress.com/2016/09/02/the-konami-laser-scope-why/ 5. Take on the NES Library — Laser Invasion deep dive — https://takeontheneslibrary.com/finished/75-laser-invasion/ 6. DiGRA — 'Word Play: A History of Voice Interaction in Digital Games' — https://dl.digra.org/index.php/dl/article/download/887/887/884 --- ## NES Power Pad (Family Trainer / Family Fun Fitness) (1988) **By:** Bandai (original) / Nintendo of America (rebranded) **Tags:** `Full-Body Input` `Exergaming` `Floor Mat` `Motion Control` `NES` ### Overview The NES Power Pad was a full-body floor mat controller for the Nintendo Entertainment System, originally developed by Bandai as the Family Trainer for the Famicom in Japan (November 1986). Released briefly in North America as 'Family Fun Fitness' in 1987, the rights were purchased by Nintendo in 1988, rebranded as the Power Pad, and bundled with the NES Power Set console package alongside the game World Class Track Meet. It was also released in Europe as Family Fun Fitness in June 1988. The mat unfolded to approximately 94 cm × 97 cm (37 × 38 inches) and featured two sides: Side A with 8 pressure zones (rarely used) and Side B with 12 pressure zones arranged in a 3×4 grid, numbered 1–12. Each zone contained a simple binary pressure-sensitive switch — no analog pressure measurement, just on/off. The mat connected to the NES controller port (typically port 2) and communicated via a serial protocol using two dedicated data lines, read at the NES's standard 60 Hz polling rate during vertical blanking intervals. Players stood on the mat barefoot or in socks and controlled games by running in place, jumping, and stepping on specific numbered zones. Eleven official games were released across all regions (six in North America), spanning athletic simulations (World Class Track Meet, Athletic World), rhythm/dance (Dance Aerobics — the acknowledged precursor to Dance Dance Revolution), team relay events (Super Team Games), and memory/action challenges (Short Order / Eggsplode!). The Power Pad sold approximately 500,000 units in North America — modest for the NES's 34-million install base, but enough to establish an entire new genre of interaction. ### Deep dive * **Origins.** Bandai, the Japanese toy and game company, developed the Family Trainer mat and the first ten games for the Famicom, with software by Human Entertainment. It launched in Japan on November 12, 1986. Bandai released it briefly in North America as 'Family Fun Fitness' in 1987 before Nintendo purchased the North American rights, rebranded it as the Power Pad, and recalled remaining Family Fun Fitness mats from stores. The recalled launch title Stadium Events — of which only about 200 copies had reached retail shelves before the rebrand to World Class Track Meet — is now the rarest licensed NES game in existence; sealed copies have sold for over $41,000 at auction. * **Hardware and sensor technology.** The Power Pad consisted of two layers of flexible gray vinyl-like plastic with 12 pressure-sensitive switches embedded between them. Each switch completed an electrical circuit when compressed by foot pressure, reading as a simple binary on/off — no analog pressure measurement. The mat used a non-slip surface and was designed for barefoot or socked use with deliberate step thresholds (light incidental contact was ignored). Connection was via a standard NES controller cable with a 6-wire protocol using two dedicated data lines (D3 and D4), unlike the standard controller's single data line. Software mapped the 12 zones to standard NES controller inputs (D-pad directions, A/B buttons, etc.), with different games using different mappings. Side A (8 zones) was almost never used; Side B (12 zones, numbered 1–12) was the standard for nearly every game. * **Interaction and game experience.** The Power Pad asked players to use their whole body as input. In World Class Track Meet, players ran in place by rapidly alternating steps between two zones to complete 100m dash, hurdles, long jump, and triple jump events — racing against AI opponents named after animals (Turtle = slowest, Cheetah = fastest). Dance Aerobics (1987 in Japan) featured an instructor-led rhythm mode and a 'free form mode' where players could compose their own melodies by tapping out notes on the mat, arguably making it the first home music-creation game. Super Team Games supported up to six players simultaneously sharing zones for relay races, crab walks, and tug-of-war — an early example of collaborative multi-body input on a single device. Athletic World (1986) asked players for their name, age, gender, and date to provide 'customized advice,' anticipating Wii Fit's health tracking by 22 years. Kids quickly discovered a classic ergonomic exploit: kneeling and slapping the mat with hands was faster than running in place. * **Commercial fate.** The Power Pad sold approximately 500,000 units in North America (per David Sheff's Game Over, 1994). It was modestly successful as a novelty accessory but ultimately limited by a very small game library (only 6 North American titles, all released by 1989), lack of third-party developer support, and the mat's tendency to wear and delaminate over time. It competed with the standard controller's precision and was retired by the early 1990s as the NES era wound down. Nintendo never released a Power Pad successor for the SNES (though the Exertainment Life Cycle exercise bike was a spiritual successor that failed even more spectacularly). A Power Pad unit is now part of the permanent collection at the Science Museum, London. * **Impact and legacy.** The Power Pad's HCI significance is hard to overstate. It was the first mass-market full-body home controller — proof that feet and whole-body movement could be a viable consumer input modality. It pioneered the exergaming genre, explicitly reframing video games as fitness tools in an era when gaming was seen as purely sedentary. Ian Bogost's seminal 2005 paper 'The Rhetoric of Exergaming' uses the Power Pad as its starting point. It is the direct conceptual ancestor of Dance Dance Revolution (1998, Konami), the Wii Fit Balance Board (2008, Nintendo), Microsoft Kinect (2010), and the entire genre of motion-based gaming. J.A. McArthur wrote in 100 Greatest Video Game Franchises (2017): 'As a video game franchise, Bandai's Family Trainer was widely considered a flop. However, as a stepping-stone toward personal use of motion capture devices, Family Trainer nourished a generation of thought surrounding the performance of bodily motion and its role in video games.' In 2013, developer Archie Prakash connected a Power Pad to a PC via Arduino for its 25th anniversary, building what he called the 14th game ever made for the peripheral. ### Team * **Bandai Co., Ltd..** Japanese toy and game company that originally developed the Family Trainer mat and the first ten games for the Famicom (1986). * **Human Entertainment.** Japanese game developer that created the software for the first ten Family Trainer titles. * **Nintendo of America.** Acquired North American rights from Bandai in 1988, rebranded the mat as the Power Pad, and published additional titles including World Class Track Meet, Dance Aerobics, and Short Order / Eggsplode! ### Media ![NES Power Pad side B showing 12 numbered pressure zones](../assets/wiki/nes-power-pad-1.png) *Side B of the NES Power Pad, showing the 3×4 grid of 12 numbered pressure zones. This was the standard side used by nearly every game. (Wikimedia Commons)* ![NES Power Pad side A showing the eight-zone layout](../assets/wiki/nes-power-pad-2.jpg) *Side A of the NES Power Pad with its eight-zone layout. (Wikimedia Commons)* ### Sources 1. Power Pad - Wikipedia — https://en.wikipedia.org/wiki/Power_Pad 2. Family Trainer - Wikipedia — https://en.wikipedia.org/wiki/Family_Trainer 3. Power Pad - Science Museum Group Collection — https://collection.sciencemuseumgroup.org.uk/objects/co8226742/power-pad-dance-mat-nes-video-game-nintendo-company-ltd-1988 4. NESdev Wiki — Power Pad technical protocol — https://www.nesdev.org/wiki/Power_Pad 5. Ian Bogost — 'The Rhetoric of Exergaming' (2005) — https://bogost.com/writing/the_rhetoric_of_exergaming/ 6. Game Developer — 'Connecting NES Power Pad to PC for its 25th Anniversary' — https://www.gamedeveloper.com/programming/connecting-nes-power-pad-to-pc-for-its-25th-anniversary 7. J.A. McArthur — 'Family Trainer — 100 Greatest Video Game Franchises' — https://jamcarthur.com/2017/08/18/family-trainer-100-greatest-video-game-franchises/ --- ## Amiga Joyboard (1983) **By:** Amiga Corporation **Tags:** `HCI` `Input` `Balance Board` `Atari 2600` `Game Controller` `Full-Body Interaction` `Physical Computing` `Pre-Wii` ### Overview The Amiga Joyboard was a balance board peripheral for the Atari 2600, released in 1983 by Amiga Corporation — the same small Los Gatos / Santa Clara startup that was secretly developing the revolutionary Lorraine prototype (what would become the Commodore Amiga computer). Shaped like a large plastic platform, the Joyboard had four mechanical joystick-directional latches mounted on its underside. A player would stand on the board and lean their body forward, back, left, or right to engage the latches, translating full-body movement into digital joystick input. It shipped bundled with *Mogul Maniac*, a slalom skiing game, and was demonstrated at toy fairs and on television by Olympic freestyle skier Suzy Chaffee. Commercially, the Joyboard was a footnote — the 1983 video game crash was in full swing, and only one game officially shipped for it. But its cultural legacy is outsized. During the grueling development of the Amiga computer operating system, frustrated engineers used the Joyboard as a stress-relief device: they would sit cross-legged on it and attempt to remain perfectly still, avoiding triggering any of the directional switches. This practice, dubbed 'Guru Meditation,' became the name of the Amiga's infamous system-crash error screen — one of the most recognizable error messages in computing history. Decades later, game designer Ian Bogost created a legitimate zen meditation game for the Joyboard called *Guru Meditation*, bringing the lore full circle. ### Deep dive * **Origins.** The Joyboard was the product of Amiga Corporation's early incarnation — a period often romanticized as when the 'true' Amiga ideals were forged, before Commodore's 1984 acquisition. Founded in 1982 (originally as Hi-Toro) and funded by three Florida dentists, the company operated out of Santa Clara, California. While Jay Miner, RJ Mical, Carl Sassenrath, and Dale Luck worked in secrecy on the 'Lorraine' computer prototype, the company needed cash flow and a cover story. They entered the video game peripheral market with the Power Stick joystick, several Atari 2600 game cartridges, and the Joyboard. The Joyboard was announced at the Winter Consumer Electronics Show in January 1983 and shown again at Summer CES 1983 in Chicago. At $50 bundled with *Mogul Maniac*, it promised a new kind of gaming that used the whole body. * **Hardware.** The Joyboard was deceptively simple. It consisted of a flat plastic platform measuring roughly 15¼ by 12¼ inches with a small pivoting disc underneath, less than three inches in diameter, that contacted the floor. Inside, four mechanical directional latches — essentially the same switches found in a standard Atari 2600 joystick — were mounted on the underside of the board. When a player stood on the board and leaned their body weight in any of the four cardinal directions, the corresponding latch engaged, sending that directional signal to the console via a standard DE-9 joystick cable. A pass-through joystick port on the board allowed a conventional joystick (like Amiga's own Power Stick) to be plugged in for games that needed a fire button, letting the player control direction with their feet while pressing the button with their hands. The hardware was entirely mechanical — no pressure sensors, no accelerometers, just your body weight closing simple switches. * **Interaction.** Using the Joyboard was a radically different experience from conventional game controllers of the era, which were exclusively hand-operated joysticks, paddles, or keypads. Standing on the board required gross motor coordination and whole-body balance. In *Mogul Maniac*, the bundled slalom skiing game, players leaned left and right to navigate between ski gates while racing downhill, dodging trees. The physicality of the interaction was genuinely novel — it turned the player's entire body into the controller, years before dance pads, motion controls, or balance boards became familiar concepts. Amiga also developed *Surf's Up* (a surfing game) and *Off Your Rocker* (a pattern-matching memory game) for the Joyboard, though neither saw official release. The Joyboard could also be used with existing maze-type Atari 2600 games, offering what the company marketed as a 'different challenge.' * **Commercial fate.** The Joyboard launched into a brutal market. By 1983, the North American video game industry was collapsing — the infamous crash that would see Atari bury millions of unsold cartridges in a New Mexico landfill. Amiga Corporation's game peripherals, including the Joyboard and Power Stick, sold in very limited quantities. Only *Mogul Maniac* was officially bundled and sold. *Off Your Rocker* cartridges were completed but handed off to a third party (Pleasant Valley Video) for distribution rather than being sold directly by Amiga. *Surf's Up*, the first game developed for the Joyboard, was never released at all — only two cartridges are known to exist today. The Joyboard itself faded into obscurity almost immediately, though Amiga Corporation would soon be acquired by Commodore for $25 million in 1984, and the 'Lorraine' would become the Amiga 1000. * **Impact.** The Joyboard's most enduring legacy has nothing to do with gaming. During the early development of the AmigaOS operating system, the system crashed so frequently that engineers developed a ritual: they would sit cross-legged on a Joyboard like a meditating guru, attempting to remain perfectly still. If a developer moved enough to trigger a directional latch, their 'meditation' was broken. This practice was memorialized as the 'Guru Meditation' error screen — a red box displaying cryptic hexadecimal codes that appeared when the Amiga operating system suffered a fatal crash. The error message became legendary, referenced in everything from the Varnish HTTP accelerator to the ESP32 microcontroller firmware. In 2007, game designer and scholar Ian Bogost created *Guru Meditation*, a homebrew Atari 2600 game that turned the Joyboard into a legitimate zen meditation tool: players must sit perfectly still on the board, and if successful, an on-screen yogi rises and begins to float. The Joyboard also holds a place in HCI history as the first commercial full-body home console controller, arriving 23 years before Nintendo's Wii Balance Board (2007) and anticipating an entire genre of physically interactive gaming. ### Team * **Jay Miner.** Hardware architect and co-founder of Amiga Corporation; led development of the Lorraine prototype alongside the Joyboard era * **David Shannon Morse.** CEO of Amiga Corporation during the Joyboard's development and release * **RJ Mical.** Software engineer at Amiga Corp; later created the Amiga Intuition GUI; told the Guru Meditation origin story in Info Magazine (1987) * **Suzy Chaffee.** Olympic freestyle skier who demonstrated the Joyboard with Mogul Maniac on television and at toy fairs in 1983 * **Ian Bogost.** Game designer and scholar who created the homebrew Atari 2600 game Guru Meditation (2007) for the Joyboard, turning the lore into a working zen meditation game ### Media ![Original Amiga Joyboard balance board on a floor](../assets/wiki/amiga-joyboard-1.jpg) *The Amiga Joyboard, a plastic platform with a pivoting foot disc beneath. Players stood on it and leaned to control Atari 2600 games. Photo ©1998 Doug Spence (Hrothgar), CC BY 3.0, via Wikimedia Commons.* ![Joyboard in original retail box with Mogul Maniac cartridge and manual](../assets/wiki/amiga-joyboard-2.jpg) *Complete Joyboard set with original retail box, Mogul Maniac game cartridge, and instruction manual. From the Computer History Museum collection, catalog #102633096.* ![Amiga Joyboard](../assets/wiki/amiga-joyboard-3.jpg) *Amiga Joyboard archival image.* ![Amiga Joyboard](../assets/wiki/amiga-joyboard-4.jpg) *Amiga Joyboard archival image.* ### Sources 1. Joyboard — Wikipedia — https://en.wikipedia.org/wiki/Joyboard 2. Guru Meditation — Wikipedia — https://en.wikipedia.org/wiki/Guru_Meditation 3. How We Created the AMIGA Computer by Robert J. Mical, Info Magazine Issue 13 (1987) — https://archive.org/stream/info-magazine-13/Info_Issue_13_1987_Jan-Feb#page/n43/mode/2up 4. Pointing Devices for Personal Computers: Mice Lead the Way — InfoWorld, Aug 8, 1983 — https://books.google.com/books?id=ti8EAAAAMBAJ&dq=Amiga+Joyboard&pg=PA29 5. The Joyboard game controller — Computer History Museum (catalog #102633096) — https://www.computerhistory.org/collections/catalog/102633096 6. Amiga Joyboard — Hrothgar's Cool Old Junk Page (Doug Spence) — http://pages.total.net/~hrothgar/museum/Joyboard/index.html 7. Joyboard — Big Book of Amiga Hardware — https://bigbookofamigahardware.com/bboah/product.aspx?id=716 8. News & Products: Stand-On Game Controller — COMPUTE! Issue 40, September 1983 — http://www.atarimagazines.com/compute/issue40/news_game_controller.php 9. The Prehistory of Wii Fit — Ian Bogost, Water Cooler Games (2007) — https://web.archive.org/web/20070806233311/http://www.watercoolergames.org/archives/000823.shtml 10. Guru Meditation game — Ian Bogost — http://www.bogost.com/games/guru_meditation.shtml 11. Amiga Inc - Creators of a Dream — Amiga History Guide — http://www.ftp.bambi-amiga.co.uk/amigahistory/1stamiga.html 12. HIGH TECH — Skiing magazine, Dec 1983 (Mogul Maniac mention) — https://books.google.com/books?id=xskxzQ2I784C&dq=Amiga+Joyboard&pg=PA96 --- ## GROPE-III (1990) **By:** Frederick P. Brooks Jr., Ming Ouh-Young, James J. Batter, and P. Jerome Kilpatrick — Department of Computer Science, University of North Carolina at Chapel Hill **Tags:** `HCI` `Input` `Haptics` `Virtual Reality` `Scientific Visualization` `Molecular Graphics` `Force Feedback` `Teleoperation` ### Overview GROPE-III was a pioneering force-feedback molecular docking system developed at the University of North Carolina at Chapel Hill between 1988 and 1990. It represented the culmination of the GROPE project, which Frederick P. Brooks Jr. initiated in 1967 with the radical idea of adding a 'haptic display' — a computer display for the sense of touch — to scientific visualization. The system repurposed an Argonne National Laboratory Model E-3 Remote Manipulator (ARM), originally built for handling radioactive materials in nuclear hot cells, as a 6-degree-of-freedom (6-DOF) haptic force display. A chemist would physically grasp the ARM's handle and manipulate a virtual drug molecule, feeling real-time electrostatic forces — steric repulsion, van der Waals attraction, and Coulomb forces — rendered as push/pull resistance as the drug approached a protein receptor site. This was combined with a stereoscopic 3D visual display showing wireframe molecular models. Experiments demonstrated roughly a two-fold performance improvement over purely visual interaction for rigid-body molecular docking tasks. More importantly, chemists reported 'radically improved situation awareness,' developing a felt, physical intuition for why certain drugs docked well and others poorly — a qualitative leap in scientific understanding that visual-only tools could not provide. The work was presented in a landmark technical paper at SIGGRAPH 1990 and remains foundational to all modern haptic rendering systems. ### Deep dive * **Origins.** The GROPE project began in 1967 when Frederick P. Brooks Jr., newly arrived at UNC Chapel Hill to found the computer science department, envisioned combining Ivan Sutherland's concept of 'the ultimate display' with the sense of touch. Brooks believed that interactive computer graphics would be far more powerful if scientists could not only see but also feel their data. The project evolved through four stages: a 2-D system (GROPE-I, 1971), a 3-D system tested with a simple docking task, a 6-D system for a simple peg-in-hole task, and finally GROPE-III — a full 6-DOF molecular docking system achieving the original vision. James J. Batter built GROPE-I as his master's thesis project, using a 2-D pen-plotter-like mechanism to display force fields of interacting protein molecules. P. Jerome Kilpatrick's 1976 PhD dissertation explored kinesthetic supplementation for interactive systems using a 3-D system. Ming Ouh-Young's 1990 PhD dissertation, 'Force Display in Molecular Docking,' represented the definitive achievement: a complete 6-DOF haptic molecular docking system that was actively used by research chemists and produced genuine chemistry results. * **Hardware.** The centerpiece of GROPE-III was a modified Argonne National Laboratory Model E-3 Remote Manipulator (ARM) — a master-slave teleoperator originally designed by Raymond Goertz in the 1950s for handling radioactive materials behind protective shielding. This device provided true 6-DOF force feedback (3 translational + 3 rotational) with a large workspace suited to arm-scale interaction. The ARM was mechanically backdriveable, meaning forces applied by the computer's motors could be felt by the user gripping the handle. A VAX 11/780 minicomputer running the UNIX operating system computed intermolecular forces in real time — calculating electrostatic potentials, van der Waals energies, and steric clashes between drug molecules and protein receptor sites using force-field parameters. The system also featured a stereoscopic 3D visual display showing wireframe models of the molecules, giving the chemist both visual and haptic feedback simultaneously. * **Interaction.** A chemist using GROPE-III would grasp the ARM's handle and see a wireframe representation of a drug molecule on the stereoscopic display. By physically moving the handle, the chemist could translate and rotate the drug relative to a protein receptor site. As the drug approached the protein's active site, the system computed intermolecular forces in real time and activated the ARM's motors to resist or assist the user's motion. Electrostatic attraction would pull the drug toward favorable regions, while steric clashes (atoms trying to occupy the same space) would produce hard repulsive forces. van der Waals forces provided subtle attractive or repulsive cues. The chemist could feel the combined force field guiding the drug toward low-energy binding configurations. The key insight was that humans using their kinesthetic sense could navigate complex 6-DOF energy landscapes far more intuitively than with pure visual feedback — they could 'feel their way' to good docking solutions. * **Commercial fate.** GROPE-III was never commercialized as a product. It remained a research prototype in UNC's computer science department, used actively by collaborating research chemists to study real drug-docking problems. The ARM manipulator was large, expensive, and mechanically complex, making it impractical for widespread deployment. However, the project's findings directly influenced the subsequent development of commercial haptic devices: the PHANToM (SensAble Technologies, 1993), the Novint Falcon, and the Force Dimension Omega and Delta devices all descend conceptually from GROPE's pioneering demonstration that force feedback dramatically improves 3D interaction. Brooks' 1990 SIGGRAPH paper presciently observed that 'entertainment, not scientific visualization, will drive and pace the technology' — a prediction borne out by haptic feedback becoming standard in game controllers, smartphones, and VR systems decades before it became common in scientific computing. * **Impact.** GROPE-III established the field of haptic rendering and proved several principles now considered foundational: (1) haptic display as augmentation to visual display improves perception and understanding of both force fields and world models populated with impenetrable objects; (2) haptic-augmented interactive systems give roughly a two-fold performance improvement over purely graphical interactive systems for spatial docking tasks; (3) the most valuable result is 'radically improved situation awareness' — users develop a felt, embodied understanding of data that visual-only tools cannot provide. The project also demonstrated that repurposed teleoperator hardware could serve as high-fidelity haptic interfaces, establishing a tradition of adapting industrial robotics for HCI research. GROPE's four-stage, incremental-evaluation methodology — 2-D, then 3-D simple task, then 6-D simple task, then full application — became a model for haptics research. The 1990 SIGGRAPH paper has been cited thousands of times and remains required reading in haptics, scientific visualization, and human-computer interaction curricula. GROPE-III directly inspired SensAble's PHANToM, the UNC NanoManipulator, and the entire field of 6-DOF haptic rendering. ### Team * **Frederick P. Brooks Jr..** Project founder and leader; conceived the GROPE project in 1967; founding chair of UNC Computer Science * **Ming Ouh-Young.** Lead developer of GROPE-III; PhD dissertation 'Force Display in Molecular Docking' (1990); designed the 6-DOF molecular docking application and ran user studies * **James J. Batter.** Built GROPE-I (1971), the 2-D force-feedback precursor; co-author on GROPE-I paper and the 1990 SIGGRAPH paper * **P. Jerome Kilpatrick.** Built the 3-D force display system; PhD dissertation 'The Use of Kinesthetic Supplement in an Interactive System' (1976) * **Joseph J. Capowski.** Early contributor; 1971 MS thesis on remote manipulators as computer input devices * **Mike Pique.** Contributed to the 1988 IEEE Robotics and Automation paper on using a manipulator for force display in molecular docking * **Greg Turk.** Developed interactive collision detection for molecular graphics used in the system; later known for the Phong shading model ### Media ![Black and white photograph of the GROPE-III system showing the Argonne Remote Manipulator arm with stereoscopic display in a UNC lab](../assets/wiki/grope-iii-1.png) *The GROPE-III system at UNC Chapel Hill, showing the Argonne Remote Manipulator (ARM) arm used for 6-DOF force feedback, with the stereoscopic molecular visualization display visible behind it. From the SIGGRAPH 1990 Technical Paper presentation. (Source: ACM SIGGRAPH History Archives)* ![Diagram or photograph of the GROPE-III force feedback system at UNC, showing the ARM manipulator and display setup](../assets/wiki/grope-iii-2.gif) *The University of North Carolina force feedback system (GROPE-III). The chemist grasps the ARM handle to manipulate a drug molecule while feeling intermolecular forces. (Source: ResearchGate / Ouh-Young 1990)* ### Sources 1. Brooks Jr., Ouh-Young, Batter, Kilpatrick. 'Project GROPE: Haptic Displays for Scientific Visualization.' SIGGRAPH 1990 Technical Paper. Computer Graphics, Vol. 24, No. 4, pp. 177–185. — https://dl.acm.org/doi/10.1145/97880.97899 2. SIGGRAPH History Archives: Project GROPE entry with abstract, authors, and references — https://history.siggraph.org/learning/project-grope-haptic-displays-for-scientific-visualization-by-brooks-jr-ouh-young-batter-and-kilpatrick/ 3. Ouh-Young, Ming. 'Force Display in Molecular Docking.' PhD Dissertation, UNC Chapel Hill Computer Science Department, 1990. Tech Report 90-004. — https://www.cs.unc.edu/techreports/90-004.pdf 4. CISMM (UNC): Simulated Drug Docking — describes the Docker application, haptic feedback approach, and experimental results — https://cismm.web.unc.edu/1990/01/01/simulated-drug-docking/ 5. Batter, J.J. and Brooks, F.P. Jr. 'GROPE-I: A Computer Display to the Sense of Feel.' IFIP Congress 71, pp. 759–763. — https://www.kiphub.com/paper/61e504c460fd020254f628c8 6. Ouh-Young, M., Pique, M., Hughes, J., Srinivasan, N., Brooks, F.P. Jr. 'Using a Manipulator for Force Display in Molecular Docking.' Proc. IEEE Robotics and Automation Conference, 1988, pp. 1824–1829. — https://researchr.org/publication/MingPHSB88 7. Kilpatrick, P.J. 'The Use of Kinesthetic Supplement in an Interactive System.' PhD Dissertation, UNC Chapel Hill, 1976. — https://www.cs.unc.edu/techreports/76-004.pdf 8. Rauterberg HCI History Slides: Grope (1967) — describes evolution from 2-D to full 6-D GROPE-III system — https://rauterberg.employee.id.tue.nl/presentations/HCI-history/tsld064.htm --- ## Nintendo Hands Free Controller (1989) **By:** Nintendo of America **Tags:** `HCI` `Input` `Accessibility` `Assistive Technology` `Gaming` `NES` `Sip-and-Puff` `Alternate Input` `Quadriplegic` `Hardware` ### Overview The Nintendo Hands Free Controller was an accessibility peripheral for the Nintendo Entertainment System, released by Nintendo of America in the spring of 1989. Designed specifically for players with quadriplegia and other severe physical disabilities, it enabled gameplay entirely without the use of hands. The controller strapped onto the player's chest with shoulder harnesses and featured a chin-operated joystick for directional movement alongside a sip-and-puff tube: sipping activated the A button, puffing activated B, and harder sips or puffs triggered Start and Select. Pressure sensitivity was adjustable via knobs on the device's control panel. The controller was born from a letter. When a mother from Oklahoma wrote to Nintendo of America asking if her 12-year-old disabled child could play video games like everyone else, the company chose to engage rather than dismiss. Nintendo partnered with Seattle Children's Hospital and the National Spinal Cord Injury Association, spending nearly two years on co-design with disabled children and their physical therapists. The result was a device officially endorsed by the National Spinal Cord Injury Association — a genuinely community-informed piece of assistive technology that worked with existing NES games. Despite its technical success, the Hands Free Controller was a commercial ghost. Priced at $120 (nearly double the $79.99 NES console itself), it was sold exclusively through Nintendo's customer service telephone line — no retail, no marketing, no magazine ads, no store demos. Nintendo reportedly sold it at cost as a non-profit item. With no games designed to accommodate it and no institutional follow-through from Nintendo of Japan, the initiative died quietly. Today, very few units survive; The Strong National Museum of Play in Rochester, New York holds one in its collection. It stands as the first accessibility controller ever produced by a major gaming corporation — predating the Xbox Adaptive Controller by 29 years. ### Deep dive * **Origins: A Mother's Letter.** The Hands Free Controller traces its origins to a single letter. A mother from Oklahoma wrote to Nintendo of America's customer service department to ask whether there was any way her 12-year-old child — who had a severe physical disability — could play NES games like other children. Instead of sending a form-letter reply, Nintendo's American division chose to act on the request. They initiated a collaboration with Seattle Children's Hospital and sought the endorsement of the National Spinal Cord Injury Association. Over nearly two years, Nintendo engineers worked alongside medical professionals and — critically — disabled children and their physical therapists to prototype and refine the controller. Nintendo's own press materials from the period referred to the disabled children involved in development as 'self-advocates,' reflecting a co-design ethos that was decades ahead of its time. The result was a product developed with the community it aimed to serve, not merely for them. * **Hardware: Chin, Breath, and Straps.** The Hands Free Controller was a 2.5-pound device worn on the chest, secured by straps that wrapped around the player's shoulders like a vest. A rigid arm extended upward from the chest unit, terminating in a joystick positioned at chin-level that the player could manipulate with their mouth, chin, or tongue to replicate D-pad directional inputs. A long flexible tube ran from the chest unit to the player's mouth for sip-and-puff operation: a gentle sip triggered the A button, a gentle puff triggered B, and more forceful sips or puffs activated Start and Select. The chest-mounted control panel featured adjustment knobs to tune the pressure sensitivity and force thresholds for each input, allowing users to calibrate the controller to their individual strength and lung capacity. The entire unit connected to the NES controller port like any standard peripheral. One notable limitation was that simultaneous A+B button presses were not possible, making some games difficult or unplayable. * **Interaction Design: Playing Without Hands.** Using the Hands Free Controller required learning a new bodily vocabulary. D-pad movement became chin or tongue manipulation of a joystick; button presses became controlled breath. The mapping was intuitive in principle — sipping and puffing are easy metaphors for binary action — but demanded practice to master the pressure thresholds and to coordinate chin movement with breathing rhythms simultaneously. The adjustable sensitivity knobs were a genuinely thoughtful accessibility feature, allowing players with different levels of motor control and respiratory strength to tune the device to their capabilities. The controller worked with the existing NES game library without requiring any software modification, meaning it functioned as a drop-in replacement for the standard gamepad. However, games that required rapid alternating button presses, simultaneous button holds, or precise timing proved challenging. The device was fundamentally a one-to-one remapping of the standard NES controller inputs onto alternative physical modalities, rather than a reimagining of how games could be controlled. * **Commercial Fate: Mail-Order Obscurity.** The Hands Free Controller was released in mid-1989 at a price of $120 standalone, or approximately $179 bundled with an NES console. Adjusted for inflation, that is roughly $250–$300 today. Nintendo stated publicly that the controller was sold at cost as a non-profit item. Distribution was exclusively through Nintendo's customer service telephone line — there were no retail listings, no advertisements in game magazines, no hands-on demo units at stores or disability organizations, and no mention in Nintendo's splashy 'World of Nintendo' marketing campaigns. A June 3, 1989 press release announced the product, but beyond that and a brief mention in Nintendo's 1989 product fact sheet, contemporary media coverage was virtually nonexistent. The combination of high price, invisible distribution, and zero marketing meant that very few units reached consumers. An estimated 10,000 or fewer were produced. Today, surviving units are extraordinarily rare; complete-in-box examples have sold at auction for hundreds of dollars, and The Strong National Museum of Play holds one of the only museum-preserved specimens. * **Impact: A Ghost That Haunts the Industry.** The Hands Free Controller was the first accessibility controller ever produced by a major video game corporation — a milestone achieved 29 years before Microsoft's Xbox Adaptive Controller (2018). It demonstrated that a large gaming company could engage meaningfully with disabled players, co-design assistive hardware with medical institutions, and bring a functioning product to market at cost. Yet its legacy is defined as much by what didn't happen as by what did. Nintendo of Japan appears to have had no involvement; the project was entirely a Nintendo of America initiative. When the SNES arrived with additional face buttons and shoulder buttons, no successor or adapted version of the Hands Free was developed. Nintendo never released another accessibility controller. For the next three decades, accessible gaming hardware was left almost entirely to grassroots DIY makers, small non-profits, and third-party modders — until Microsoft's Adaptive Controller revived the template Nintendo had abandoned. The Hands Free Controller is a case study in how corporate accessibility efforts, no matter how well-intentioned, can vanish without institutional commitment and memory. It also poses an uncomfortable question: what would the gaming landscape look like today if this first step had been followed by a second? ### Team * **Nintendo of America engineers.** Internal Nintendo engineering team that designed and built the Hands Free Controller; individual names have not been publicly documented in surviving records. * **Seattle Children's Hospital.** Medical partner that provided clinical expertise and facilitated prototyping and testing with disabled children and their physical therapists. * **National Spinal Cord Injury Association.** Officially endorsed the controller and provided community guidance, ensuring the design met the needs of people with spinal cord injuries. ### Media ![NES Hands Free Controller on a white background showing the chest unit, chin joystick arm, sip-and-puff tube, and shoulder straps](../assets/wiki/nintendo-hands-free-1.jpg) *The Nintendo Hands Free Controller, 1985–1990. The Strong National Museum of Play, Rochester, New York.* ![Nintendo Hands Free Controller mail-order form from 1989, showing product description and ordering information](../assets/wiki/nintendo-hands-free-2.jpg) *Nintendo Hands Free Controller order form, 1989. The Brian Sutton-Smith Library and Archives of Play at The Strong, Rochester, New York.* ![Nintendo news release from June 3, 1989, announcing the Hands Free Controller](../assets/wiki/nintendo-hands-free-3.jpg) *Nintendo news release, June 3, 1989: 'New Nintendo Controller Assists the Physically Disabled with Video Game Play.' The Brian Sutton-Smith Library and Archives of Play at The Strong, Rochester, New York.* ### Sources 1. Hana Hanifah, "Nintendo's Forgotten Accessibility Pioneer: The 1989 Handsfree Controller" — The Strong National Museum of Play Blog (2026) — https://www.museumofplay.org/blog/nintendos-forgotten-accessibility-pioneer-the-1989-handsfree-controller/ 2. Eric Caoili, "Now you're playing with ... no hands" — Engadget (May 23, 2007) — https://www.engadget.com/2007-05-23-now-youre-playing-with-no-hands.html 3. Luke Plunkett, "The Disabled-Friendly NES Controller From The 1980's" — Kotaku (May 6, 2009) — https://kotaku.com/the-disabled-friendly-nes-controller-from-the-1980s-5241760 4. Laura Dale, "Nintendo Made a Disability Friendly NES controller in the 80's" — Access-Ability UK (April 25, 2022) — https://access-ability.uk/2022/04/25/nintendo-made-a-disability-friendly-nes-controller-in-the-80s/ 5. "Video game controller: NES Hands Free Controller" — Google Arts & Culture, The Strong National Museum of Play collection — https://artsandculture.google.com/asset/video-game-controller-nes-hands-free-controller-nintendo/iQEEzY5-d7viDA?hl=en 6. "NES Hands-Free Controller" — Consolevariations collectibles database — https://consolevariations.com/collectibles/nes-hands-free-controller 7. "Hands Free Controller – NES" — Gamepressure, "15 Weirdest Game Controllers Ever" (December 11, 2021) — https://www.gamepressure.com/editorials/15-weirdest-game-controllers-ever/hands-free-controller-nes/za4e1 --- ## DLR Control Ball (SpaceMouse) (1981) **By:** DLR (German Aerospace Center) Institute for Robotics and Mechatronics, Oberpfaffenhofen **Tags:** `6-DOF Input` `Force Input` `Spatial Controller` ### Overview The DLR Control Ball was the first 6-degree-of-freedom (6-DOF) force/torque sensor ball, developed at the German Aerospace Center's Institute for Robotics and Mechatronics beginning in 1981. A 6-axis force-torque sensor (measuring 3 force and 3 torque components) was integrated into a plastic hollow ball about the size of a tennis ball. Slight hand pressure on the ball produced translational and rotational displacements that were translated into motion speeds in 3D space. The user's hand rested on the ball; subtle push/pull/twist motions provided simultaneous control of all six degrees of freedom (X, Y, Z translation + pitch, roll, yaw rotation) without gross arm movement. The first version used strain gauges (~$8,000). By 1985, a cheaper optical measuring system using six one-dimensional position detectors was developed. The device was patented in Germany (1981), Europe (1982), and the USA (1983). It was used in the ROTEX space robot mission aboard Space Shuttle Columbia (1993) — the first remotely teleoperated robot in space — where an astronaut used a Control Ball to command a robot arm in the shuttle's payload bay. The commercial version was called Dimension 6 / Geoball (1988, by CiS Graphics, ~$3,000, named 'Product of the Year' in the USA). In 1993, the refined SpaceMouse Magellan was launched and eventually licensed to Logitech, becoming the 3Dconnexion SpaceMouse — still in production today and standard equipment on CAD workstations worldwide. Only a few hundred original Dimension 6 systems were sold, making it a rare collector's item with a direct line to one of the most enduring niche input devices in computing history. ### Deep dive * **Isometric 6-DOF: A New Input Paradigm.** Unlike position-sensing devices (mice, joysticks, Isotrak) that measure where something IS, the Control Ball measured what forces the user APPLIED. The hand rested on a stationary ball; pushing lightly forward translated the viewpoint forward in 3D space, twisting clockwise rotated it. All six degrees of freedom could be controlled simultaneously — a pilot metaphor of intuitive, strain-free spatial navigation. This isometric approach meant no desk space was consumed by movement, no arm fatigue from sweeping gestures, and no need to switch between translation and rotation modes. * **From Strain Gauges to Optics to Commercial Product.** The first prototype (1981) used strain gauges on an inner structure, costing approximately $8,000 to produce. The breakthrough was the 1985 optical system: six one-dimensional position detectors (LED + photodiode pairs) measuring the displacement of a central element suspended by springs, dramatically reducing cost. This optical approach enabled the commercial Dimension 6 / Geoball (1988) at ~$3,000. The technology was licensed to Logitech in the 1990s, becoming the SpaceMouse product line. Today's 3Dconnexion SpaceMouse uses essentially the same isometric 6-DOF principle in a compact puck form factor, and is sold in the millions to CAD professionals. * **Space Heritage: ROTEX on Columbia.** In 1993, during Space Shuttle Columbia mission STS-55, the DLR's ROTEX experiment demonstrated the first remotely controlled robot in space. An astronaut aboard Columbia used a Control Ball to teleoperate a small robot arm mounted in the shuttle's payload bay, while ground controllers in Oberpfaffenhofen also commanded the same arm with signal delays. The Control Ball's intuitive 6-DOF control was essential — in microgravity, the isometric design meant the astronaut's hand didn't need to move, just apply pressure, making it usable without anchoring the body. * **Distinction from Polhemus Isotrak.** The HCI Museum already features the Polhemus 3Space Isotrak (1987), a 6-DOF electromagnetic position tracker. These devices are complementary, not redundant. The Isotrak answers 'where is a sensor in space?' — it's for tracking. The Control Ball answers 'what forces is the user commanding?' — it's for deliberate input. They represent two fundamentally different relationships between human movement and machine: one measures position passively, the other reads force as an intentional command. ### Team * **DLR (Deutsches Zentrum für Luft- und Raumfahrt).** German Aerospace Center, Institute for Robotics and Mechatronics, Oberpfaffenhofen. Lead developer of the Control Ball technology * **Prof. Dr. Gerd Hirzinger.** Director, DLR Institute for Robotics and Mechatronics. Led the ROTEX space robot program * **CiS Graphics Inc..** West German company that commercialized the Control Ball as Dimension 6 / Geoball under DLR license (1988) * **Logitech / 3Dconnexion.** Licensee of the SpaceMouse technology since the 1990s; continues to produce SpaceMouse devices for CAD professionals ### Media ![Dimension 6 / Geoball commercial 6-DOF controller from 1988](../assets/wiki/dlr-spacemouse-2.jpg) *The Dimension 6 (also known as Geoball), the commercial version released by CiS Graphics in 1988. Source: spacemice.org.* ### Sources 1. DLR — SpaceMouse 1981-1993 official history page — https://www.dlr.de/en/rm/research/robotic-systems/human-machine-interfaces/spacemouse-1981-1993 2. SpaceMice.org — Spacemouse Classic history and technical documentation — https://spacemice.org/index.php/Spacemouse_Classic 3. SpaceMice.org — Dimension 6 technical manual and gallery — https://spacemice.org/index.php/Dimension6 4. DLR ROTEX — first remotely controlled robot in space (STS-55, 1993) — https://www.dlr.de/en/rm/research/robotic-systems/rotex 5. 3Dconnexion SpaceMouse — modern commercial descendant — https://3dconnexion.com/uk/spacemouse/ --- ## DragonDictate (1989) **By:** James K. Baker and Janet M. Baker / Dragon Systems, Inc., Newton, Massachusetts **Tags:** `Speech Recognition` `Dictation` `Natural Language` ### Overview DragonDictate-30K was the first large-vocabulary speech-to-text dictation system and arguably the single most important speech recognition product of the HCI era. Unveiled to the press on March 19, 1990 in Newton, Massachusetts, it used an 8-bit ISA peripheral card, required a 386-based PC with 6MB RAM, and shipped with a Shure noise-canceling headset microphone. The system could recognize 30,000 words — an order of magnitude beyond anything previously available for personal computers. Key features: no initial training required for 16,000 frequent words (speaker-independent models built-in); adaptive vocabulary that dynamically built and refined speech models for up to 30,000 words online during use; an 80,000-word dictionary with easy new-word addition; and the iconic 'Oops' command for error correction. The system operated in discrete-utterance mode — users had to pause distinctly between each word — producing approximately 35 words per minute. The Bakers' path to DragonDictate is itself remarkable. James and Janet Baker developed Hidden Markov Model (HMM) speech recognition at CMU and IBM Research (1975–1979), then worked at Verbex (Exxon subsidiary, 1979–1982). When Exxon exited the speech business, they founded Dragon Systems from their living room with personal savings in 1982. DragonDictate was the culmination of a decade of research, formally presented by Janet Baker at Eurospeech 1989 in Paris. The product defined the speech dictation interaction model — discrete-word input, adaptive vocabulary, 'Oops' correction, voice commands ('Go to Sleep'/'Wake Up') — that dominated consumer speech recognition until Dragon NaturallySpeaking introduced continuous recognition in 1997. Dragon Systems was ultimately acquired by Lernout & Hauspie in 2000 (later sold to ScanSoft, which became Nuance, now part of Microsoft). DragonDictate's direct descendant, Dragon NaturallySpeaking, remains one of the longest-running consumer software product lines in computing history. ### Deep dive * **Origins.** James and Janet M. Baker were pioneers of Hidden Markov Model speech recognition. After working at CMU and IBM Research (1975–1979), they joined Verbex (an Exxon subsidiary) as VP of Advanced Development and VP of Research respectively. When Exxon exited the speech business in 1982, they founded Dragon Systems from their living room in Newton, Massachusetts, using personal savings. The company grew to 300 employees and remained independent until 2000. Janet Baker presented the DragonDictate paper at Eurospeech 1989 in Paris, establishing the system's technical foundations. * **The $9,000 Dictation Station.** DragonDictate-30K required a 386-based PC with 6MB RAM and an 8-bit ISA DSP peripheral card. It shipped with a Shure noise-canceling headset microphone. The system recognized 30,000 words: 16,000 frequent words and phrases built-in as speaker-independent models (no training required), with another 14,000+ trainable on-the-fly as users added vocabulary. An 80,000-word dictionary supported easy new-word addition. Voice Console commands included 'Go to Sleep' and 'Wake Up' for system control. * **The 'Oops' Interaction Model.** The fundamental interaction pattern: user speaks a word, pauses, speaks the next word. If recognition is wrong, the user says 'Oops' and the system presents alternatives. The user chooses the correct word and DragonDictate adapts its model to reduce future errors. This discrete-utterance, adaptive-correction loop was the defining interaction model for speech dictation from 1989 until Dragon NaturallySpeaking introduced continuous recognition in 1997. At ~35 words per minute, DragonDictate was slower than skilled typing but faster than handwriting — and completely life-changing for users who couldn't type at all. * **Legacy.** Dragon Systems was acquired by Lernout & Hauspie in March 2000 for approximately $460 million in stock. L&H's subsequent bankruptcy and fraud scandal led to the assets being sold to ScanSoft (now Nuance Communications) in 2001. Nuance continued the Dragon line, and Dragon NaturallySpeaking remains one of the longest-running consumer software product lines. In 2021, Microsoft acquired Nuance for $19.7 billion. DragonDictate's discrete-word interaction model also directly influenced Kurzweil Voice, IBM ViaVoice, and every subsequent dictation product. The 'Oops' correction paradigm, adaptive vocabulary, and voice-command/talk mode switching are all direct descendants of DragonDictate's 1989 design. ### Team * **James K. Baker.** CEO and co-founder, Dragon Systems. HMM speech recognition pioneer (CMU, IBM Research, Verbex) * **Janet M. Baker.** President and co-founder, Dragon Systems. Presented DragonDictate at Eurospeech 1989. HMM speech recognition pioneer * **Dragon Systems, Inc..** Newton, Massachusetts. Founded 1982, grew to ~300 employees by 1990s ### Media ![Dragon Systems patent drawing for speech recognition method](../assets/wiki/dragondictate-1.png) *Dragon Systems patent for speech recognition method (US Patent 5,027,406, 1991). Source: USPTO.* ![DragonDictate](../assets/wiki/dragondictate-2.jpg) *DragonDictate archival image.* ### Sources 1. Janet M. Baker, 'DragonDictate-30K: Natural Language Speech Recognition,' Eurospeech 1989, Paris — https://www.isca-archive.org/eurospeech_1989/baker89_eurospeech.html 2. Seattle Times, 'Dragon Systems dictation software understands 30,000 words,' March 19, 1990 — https://archive.seattletimes.com/archive/19900319/1061934 3. Deseret News, 'Dragon Dictate Lets Computer Users Just Give Machines a Talking,' March 23, 1990 — https://www.deseret.com/1990/3/23/18852968/ 4. Simson Garfinkel, 'Enter the Dragon,' MIT Technology Review, September 1998 — https://www.technologyreview.com/1998/09/01/236899/enter-the-dragon/ 5. ACL Anthology — DragonDictate papers (H89-1019, H90-1087) — https://aclanthology.org/H89-1019.pdf 6. Dragon Systems (Wikipedia) — https://en.wikipedia.org/wiki/Dragon_Systems --- ## EyeTyper (1983) **By:** Mark B. Friedman / Sentient Systems Technology, Inc. (CMU spinoff) **Tags:** `Eye-Tracking` `Accessibility` `Camera-Based Input` ### Overview The EyeTyper was the first commercially produced camera-based eye-tracking communication device, designed to allow quadriplegics and people with severe motor disabilities to type using only their eyes. A video camera pointed at one eyeball detected corneal reflection and pupil position via infrared light, while the user looked at a physical display board bearing oversized illuminated characters (approximately 30, each 2×2 inches). Looking at a character for a configurable dwell time selected it, sending the keystroke to a computer, printer, or speech synthesizer. The device was commercialized by Sentient Systems Technology in 1983 in Pittsburgh, a spinoff from Carnegie Mellon University's Robotics Institute. Mark Friedman, a research engineer at CMU, began the project in 1980 while working with disabled children at the Rehabilitation Institute of Pittsburgh, enlisting CMU student volunteers including Gary Kiliany, who became Vice President and co-founder. The core invention — a custom 'frame encoder' board — was documented in the Johns Hopkins APL Technical Digest in 1982. The EyeTyper embodied a profound HCI paradigm: eyes as the primary physical input modality. It demonstrated that camera-based corneal-reflection eye-tracking could be made practical with 8-bit microprocessors through hardware/software co-design. The patent (US4648052A) describes a hardware frame encoder that digitized video with dual programmable thresholds, encoding only threshold-crossing events with pixel X,Y addresses into a small 1K×12-bit cache — allowing real-time analysis by an 8-bit microprocessor for the first time. The lineage from EyeTyper through DynaVox to today's Tobii Dynavox devices is the longest continuous line in eye-controlled AAC. ### Deep dive * **Origins.** Mark Friedman, a research engineer at CMU's Robotics Institute, began the project in 1980 while working with disabled children at the Rehabilitation Institute of Pittsburgh. He enlisted CMU student volunteers including Gary Kiliany (later VP and co-founder). The initial prototype was created to help a young woman with cerebral palsy communicate. The research was funded and the core invention was documented in Friedman et al., 'The Eyetracker Communication System,' Johns Hopkins APL Technical Digest, vol. 3, no. 3, 1982. * **Interaction Model.** A television camera and infrared light source were mounted behind a display board with an opening. The user sat in front of the board, and the camera observed one eye. The display board held approximately 30 oversized characters (2×2 inches each), arranged in a matrix, each containing a small indicator light. The user fixated on a character for a dwell time (adjustable from ~0.5 seconds to over a second), producing approximately 10 words per minute. The camera detected the corneal reflection (glint) and pupil center; the vector between them was mapped via a lookup table to specific character positions, with ~2–3 inches of allowable head movement. Selected characters appeared on a screen and could drive printers, speech synthesizers, or home automation. * **Technical Innovation.** The patent (US4648052A) describes a hardware frame encoder that digitized video with dual programmable thresholds, encoding only threshold-crossing events (rising/dropping above/below thresholds) with pixel X,Y addresses into a small 1K×12-bit cache memory — allowing analysis by an 8-bit microprocessor in real time. This was a radical departure from full-frame digitization and made real-time eye tracking affordable for the first time. * **Legacy.** The patent was sold to the US Navy, with revenues reinvested into further development. Sentient Systems Technology rebranded as DynaVox in 1998 (acquired by Sunrise Medical), eventually acquired by Tobii in 2014 to become Tobii Dynavox. The line from EyeTyper to today's Tobii Dynavox devices is the longest continuous lineage in eye-controlled AAC. The EyeTyper directly demonstrated the key HCI principle that an assistive technology designed for the most severely disabled users could pioneer a general-purpose input modality. ### Team * **Mark B. Friedman.** Research engineer, CMU Robotics Institute; founder of Sentient Systems Technology * **Gary J. Kiliany.** CMU student volunteer, co-founder, VP and chief engineer at Sentient Systems * **Mark R. Dzmura.** Co-inventor on patent US4648052A, engineering contributor * **Tilden Bennett.** Business co-founder ### Media ![Patent drawing showing the EyeTyper display board with oversized character layout and camera](../assets/wiki/eyetyper-1.png) *EyeTyper display board layout from US Patent 4,648,052 (filed 1983). Source: USPTO.* ![Patent diagram of the overall EyeTyper system showing camera, light source, and display board](../assets/wiki/eyetyper-2.png) *Overall system diagram showing camera, infrared light source, and display board configuration. Source: USPTO Patent 4,648,052.* ### Sources 1. UPI Archives, 'Type with your eyes' (Dec 29, 1984) — https://www.upi.com/Archives/1984/12/29/Type-with-your-eyes/8390473144400/ 2. US Patent 4,648,052 — 'Eye-tracker communication system' (filed Nov 14, 1983) — https://patents.google.com/patent/US4648052A 3. Friedman et al., 'The Eyetracker Communication System,' Johns Hopkins APL Technical Digest, vol. 3, no. 3 (1982) — https://www.jhuapl.edu/Content/techdigest/pdf/V03-N03/03-03-Friedman.pdf 4. DynaVox (Wikipedia) — historical section covering EyeTyper origins — https://en.wikipedia.org/wiki/Dynavox 5. COGAIN Wiki — Eye Typing Systems — https://wiki.cogain.org/index.php/Eye_Typing_Systems --- ## BioMuse (1990) **By:** BioControl Systems, Inc. — created by Hugh S. Lusted and R. Benjamin Knapp at Stanford University CCRMA **Tags:** `HCI` `Biosignals` `Music` `Accessibility` `Wearable` `EMG` ### Overview The BioMuse is an 8-channel programmable biosignal controller developed at Stanford University's CCRMA (Center for Computer Research in Music and Acoustics) and commercialized by BioControl Systems, Inc. beginning in 1990. The system acquires electromyogram (EMG), electrooculogram (EOG), and electroencephalogram (EEG) signals through surface electrodes, amplifies and digitizes them at 4 kHz per channel with 12-bit resolution, processes them on a Texas Instruments TMS320C25 digital signal processor, and outputs user-definable MIDI note events and continuous controller data. The production version (BioMuse v.3, 1992) was a single 17-inch rack-mount enclosure that connected via optically isolated serial link to a DOS PC. Each unit cost $20,000; over 100 were sold to research institutions including NASA, the U.S. Air Force, British Telecom, and Honeywell. Musician Atau Tanaka composed the first concert piece for the BioMuse (Kagami, 1991) and performed internationally with it for over two decades. The instrument was also deployed for accessibility: at Loma Linda Medical Center in 1991, a pre-release BioMuse enabled a disabled child to play video games using EOG control. The system appeared on CNN multiple times and was featured on the cover of Scientific American in October 1996. The BioMuse is recognized by the NIME (New Interfaces for Musical Expression) community as foundational 'prehistoric NIME' work. ### Deep dive * **Origins.** Development began in 1987 at Stanford University's CCRMA, a unique interdisciplinary crossroads where biomedical engineering met computer music. Hugh Lusted, a PhD in neurophysiology from Stanford Medical School, and R. Benjamin Knapp, a PhD in electrical engineering from Stanford, collaborated on the idea of turning bioelectrical signals into musical control data. They founded BioControl Systems, Inc. in 1989 in South San Francisco. The BioMuse was one of the first systems to treat biosignals not as passive biofeedback to be observed but as active biocontrol — a performance instrument to be wielded. Knapp and Lusted's foundational paper 'A Bioelectric Controller for Computer Music Applications' appeared in the Computer Music Journal in 1990 and established the intellectual framework for physiological computing in music. * **How It Worked.** The BioMuse system used medical-grade wet-gel electrodes in triplets (+, −, ground) per channel, held in place by elastic armbands (for EMG on forearms, biceps, and triceps) or a headband (for EEG/EOG on the scalp and around the eyes). The signal chain was: raw microvolt differential voltages → instrumentation amplifiers with software-configurable gain (1× to 10,000×) → 4 kHz, 12-bit A/D conversion per channel → TMS320C25 digital signal processor for real-time filtering, envelope following, and pattern recognition → user-programmable MIDI output via optically isolated 19.2 kbaud serial. The optical isolation in the serial output was a deliberate safety feature protecting the user from computer-side voltage spikes — a detail that reflects the medical-engineering origins of the device. A persistent practical problem: the conductive gel electrodes were notorious for sliding off with perspiration during performances. A 1992 Metro newspaper article noted the irony: 'an invention that can, with no exaggeration, turn impulses of thought and movement into music, defeated by a slimy glob of blue gelatin.' * **The Interaction Model: Body as Instrument.** The BioMuse's interaction model is fundamentally different from conventional controllers. There is no physical object to push against, no visible motion required, no haptic feedback. EMG electrodes sense the electrical activity of muscle contraction — the intention and effort that precede and produce movement, rather than the movement itself. Atau Tanaka described it as sensing 'not movement nor position, but the corporeal action that might (but might not) result in movement.' This creates a peculiar performance experience. Muscles are tensed and relaxed in empty space. Performers develop internal strategies of restraint — learning precisely how little effort is needed to trigger a note, how to sustain tension smoothly, how to separate the control of adjacent muscle groups. Scores for BioMuse works use gestural notation rather than hardware-specific instructions: 'left arm throw,' 'slowly rotate CCW to maximum,' 'right forearm clench.' For Tanaka, EMG channels were typically mapped to Yamaha DX7 FM synthesis parameters via MIDI System Exclusive messages, then later to Kurzweil K2000R synthesis and Max/MSP environments. The mappings were deeply customized per piece and per performer. * **Dual Lives: Art and Accessibility.** The BioMuse lived two parallel lives. In concert halls and galleries, it was a radical new musical instrument. Atau Tanaka's Kagami (1991) premiered at ICMC 1992 at Stanford's Frost Amphitheater. He formed Sensorband (1993–2003) with Edwin van der Heide and Zbigniew Karkowski, fusing biosensor interfaces with rock energy. The BioMuse Trio (2008–present) brought Knapp, composer Eric Lyon, and violinist Gascia Ouzounian together for chamber music with biosensors. Simultaneously, the BioMuse was deployed as an accessibility device. At Loma Linda Medical Center in 1991, a pre-release unit enabled a disabled child to play video games using EOG control. The system was used for cursor control by people with physical disabilities (presented at Virtual Reality and Persons with Disabilities conferences, 1993–1995) and for EMG-controlled prosthetics research. This dual use — art instrument and assistive technology — is characteristic of the era's best HCI work. * **Why It Matters.** The BioMuse is a landmark in embodied interaction and physiological computing. It was arguably the first commercially available programmable brain-computer/human-computer interface product, predating consumer BCIs like NeuroSky (2009) and Muse (2014) by over 15 years. It demonstrated that internal physiological states — muscle tension, eye position, brainwaves — could be treated not as medical data but as expressive control signals, establishing a paradigm that now spans accessibility, gaming, virtual reality, and interactive art. And it connected communities that rarely talked to each other: biomedical engineers, computer musicians, disability advocates, and performance artists. For a $20,000 rack-mount box with eight electrode channels, it cast a remarkably long shadow. ### Team * **Hugh S. Lusted.** Co-founder of BioControl Systems. PhD in neurophysiology, Stanford Medical School. Co-inventor of the BioMuse. * **R. Benjamin Knapp.** Co-founder and technology director. PhD in electrical engineering from Stanford. Now Professor of Computer Science at Virginia Tech and founding director of ICAT. * **Atau Tanaka.** Composer and performer. Composed the first concert piece for BioMuse (Kagami, 1991). Performed internationally with BioMuse for 25+ years. Later: researcher at Sony CSL Paris, Professor at Goldsmiths. * **Bill Putnam.** CCRMA doctoral student who wrote the pattern-recognition algorithms for gesture detection and classification on the BioMuse DSP. ### Media ![BioMuse rack-mount unit, system cable, and 8-way electrode breakout box](../assets/wiki/biomuse/biomuse-system.jpg) *The BioMuse system: rack-mount processing unit with umbilical cable connecting to an 8-channel electrode breakout box. eContact! 14.2.* ![Atau Tanaka performing with BioMuse, wearing electrode armbands on forearms and biceps](../assets/wiki/biomuse/atau-tanaka-performing.jpg) *Atau Tanaka performing with the BioMuse, wearing EMG electrode armbands. Scientific American, 1996. biocontrol.com.* ### Sources 1. Knapp & Lusted, 'A Bioelectric Controller for Computer Music Applications,' Computer Music Journal 14/1 (1990) — https://doi.org/10.2307/3680115 2. Lusted & Knapp, 'Controlling Computers with Neural Signals,' Scientific American (October 1996) — https://www.scientificamerican.com/article/controlling-computers-with-neural-s/ 3. Atau Tanaka, 'The Use of Electromyogram Signals (EMG) in Musical Performance,' eContact! 14.2 (2012) — https://econtact.ca/14_2/tanaka_personalsurvey.html 4. Tanaka & Knapp, 'Multimodal Interaction in Music using the Electromyogram and Relative Position Sensing,' NIME 2002 — https://www.nime.org/proceedings/2002/nime2002_193.pdf 5. BioControl Systems product history — http://www.biocontrol.com/producthistory.html 6. Ouzounian, 'Interview with R. Benjamin Knapp and Eric Lyon: The Biomuse Trio in conversation,' eContact! 14.2 (2012) — https://econtact.ca/14_2/ouzounian_biomuse.html 7. CCRMA 252 course notes — BioMuse section — https://ccrma.stanford.edu/CCRMA/Courses/252/sensors/node26.html 8. Tanaka & Donnarumma, 'The Body as Musical Instrument,' Hz Journal #21 — https://www.hz-journal.org/n21/tanaka.html 9. Bernardes et al., 'Prehistoric NIME: Revisiting Research on New Musical Interfaces Before 2001,' NIME 2023 — https://nime.org/proceedings/2023/nime2023_8.pdf 10. CNN National News 1989 report on BioMuse 2 — https://www.youtube.com/watch?v=SLPrpKaE2LI --- ## Etak Navigator (1985) **By:** Etak, Inc. — founded by Stanley K. Honey, Ken Milnes, Alan Phillips, George Loughmiller; seed-funded by Nolan Bushnell **Tags:** `HCI` `Navigation` `Automotive` `Map Display` `Location` ### Overview The Etak Navigator, introduced in July 1985, was the first practical in-car computer navigation system. Without GPS (which wouldn't be available for civilian use for another decade), it used compasses, wheel sensors, and map-matching algorithms to track a vehicle's position with remarkable accuracy. A green vector CRT display showed a rotating 'heading-up' map with the car as a fixed triangle in the center — a design now universal in Apple Maps, Google Maps, and every other navigation product. The unit cost $1,395–$1,595 (roughly $4,000 in 2025 dollars), stored maps on custom high-speed cassette tapes, and was the first consumer device to offer address geocoding. Between 2,000 and 5,000 units were sold. Etak was founded in 1983 by Stanley K. Honey, a world-class ocean navigator who had been navigating Nolan Bushnell's yacht in the Transpacific Yacht Race when the two men brainstormed a land navigation system during a 4am watch. Bushnell provided $500,000 in seed funding. The engineering team, drawn largely from SRI International, applied centuries of maritime dead-reckoning techniques to automobiles. The digital map database Etak built became the foundation of modern commercial digital mapping, surviving through acquisitions by News Corp, Sony, and Tele Atlas/TomTom. At least 12 Etak alumni later worked on Apple Maps. ### Deep dive * **Origins.** The idea for Etak was born during the 1983 Transpacific Yacht Race from Los Angeles to Honolulu. Stanley K. Honey, navigating Nolan Bushnell's yacht Charley, had built a custom marine navigation computer. During a 4am watch together, Bushnell said "Wouldn't it be great if you could have that for a car?" Honey replied that he knew how to build it. Bushnell said "Yeah, let's do that and I'll fund it," and provided $500,000 in seed capital. Etak was incubated at Bushnell's Catalyst Technologies facility in Sunnyvale, California. The name 'Etak' comes from a Polynesian navigational concept where ancient mariners imagined their canoes were stationary while islands 'moved' past them — directly analogous to the heading-up map display philosophy that became the product's signature innovation. * **How It Worked.** The Navigator used augmented dead reckoning: a flux-gate electronic compass mounted on the rear windshield, two variable-reluctance wheel sensors on non-driven wheels, and a topological map-matching algorithm that continuously 'snapped' the computed position to the nearest road. The core computer unit — an Intel 8088 with 256KB RAM — was housed in a shoebox-sized aluminum chassis installed in the trunk. Maps were stored on custom high-speed cassette tapes (3.5 MB each, 200 cm/sec tape speed, polycarbonate shells tested to 105°C because standard cassettes melted on dashboards). The display was a green monochrome vector CRT (not raster — too expensive at the time) available in 4.5-inch ($1,395) and 7-inch ($1,595) versions. The car was represented as a fixed triangular arrowhead in the center of the screen while the map rotated and scrolled beneath it — the 'heading-up' orientation that became the universal standard. This arrowhead symbol, designed by engineer George Loughmiller, was inspired by the spaceship from Atari's Asteroids game and is still used by Apple Maps and Google Maps today. * **Interaction Model.** The Navigator's interaction design was unusually thoughtful for 1985. Twelve soft-labeled buttons flanked the screen (six per side), with their functions changing based on the current mode. Destination entry used a two-button-per-character system where the first button selected a group of letters and the second selected the specific character — an early solution to text input on a device with minimal buttons. The system auto-completed street names from its database after the first few letters. Critically, the engineers built in a safety lockout: destination entry and manual position correction were disabled while the vehicle was in motion. This predated modern 'distracted driving' concerns by over two decades. Calibration was an ongoing, self-improving process — drivers would confirm their position at known intersections, and the system continuously refined its calibration through map-matching. With radial tires, calibration became so precise that engineers had to calculate distances on the geoid rather than a spherical earth approximation. * **Commercial Story.** The Navigator launched in July 1985 at $1,395 (4.5-inch screen) and $1,595 (7-inch), with map cassettes at $35 each. Installation required a trained technician and took about four hours. Between 2,000 and 5,000 units were sold. Notable users included Michael Jackson (who had one installed in his Mercedes-Benz) and Gary Coleman. The 1986 film Nothing But Trouble featured the Navigator in a BMW — though with a fictional color display. Selling a product whose category didn't yet exist proved extremely difficult. Etak pivoted from consumer hardware to licensing digital map data and technology to automotive suppliers: Clarion (Japan), Bosch/Blaupunkt (Germany, as TravelPilot), and GM/Delco (USA). The company was acquired by Rupert Murdoch's News Corporation in 1989 for approximately $25 million, then by Sony in 1996, and eventually became part of Tele Atlas/TomTom. The digital map data Etak created survives in modern mapping products including Apple Maps. * **Why It Matters.** The Etak Navigator established the fundamental interaction paradigm for in-car navigation that persists nearly 40 years later: heading-up display, car-centric viewpoint, soft-labeled buttons flanking the screen. It introduced the concept that a machine could 'know where you are' — a mental shift whose consequences (location-based services, ride-hailing, real-time traffic) are now so pervasive we treat them as infrastructure. The Navigator invented the universal car-navigation arrow symbol, pioneered map-matching (still used in every navigation system today), and was arguably the first consumer computing device designed to be used while operating a vehicle. The safety lockout for destination entry was decades ahead of its time. ### Team * **Stanley K. Honey.** Founder. World-class ocean navigator, former SRI researcher. Conceived the system and provided the maritime navigation expertise. * **Nolan Bushnell.** Seed investor. Founder of Atari and Chuck E. Cheese. Incubated Etak at Catalyst Technologies. Brainstormed the concept with Honey on his yacht. * **Ken Milnes.** Co-founder from SRI. Co-designed the marine navigation system for Bushnell's yacht that preceded Etak. * **Alan Phillips.** Co-founder from SRI. * **George Loughmiller.** Engineer. Created the triangular car-navigation arrow symbol, inspired by Atari's Asteroids spaceship. * **Marvin White.** Mathematician recruited from U.S. Census Bureau. One of two people in the country who understood topological map data structures. Led development of Etak's hierarchical map storage. * **Walt Zavoli.** Director of R&D. Co-authored the foundational 1986 IEEE paper on map-matching augmented dead reckoning. ### Media ![Etak Navigator on the cover of Popular Science, June 1985](../assets/wiki/etak-navigator/etak-popsci.jpg) *The Etak Navigator on the cover of Popular Science, June 1985. Stan Honey personal archive.* ![Etak Navigator hardware components: computer unit, display, cassette tapes, wheel sensors, and compass](../assets/wiki/etak-navigator/etak-equipment.jpg) *Etak Navigator hardware components: the computer unit, CRT display, cassette tapes, wheel sensors, and flux-gate compass. Stan Honey personal archive.* ![Installation of Etak Navigator display and tape drive in a vehicle dashboard](../assets/wiki/etak-navigator/etak-install.jpg) *Installation of the Etak Navigator's CRT display and cassette tape drive in a vehicle. The shoebox-sized computer unit was mounted in the trunk. Stan Honey personal archive.* ### Sources 1. Stan Honey's First-Hand Account of Etak (ETHW) — https://ethw.org/First-Hand:ETAK,_an_early_vehicle_navigation_system 2. Original Etak Technical Paper — Royal Institute of Navigation (1985) — http://honeynav.com/wp-content/uploads/2016/01/Etak-paper-RIN-York-1985.pdf 3. Computer History Museum — Etak Navigator artifact — https://www.computerhistory.org/collections/catalog/102766595 4. Smithsonian National Museum of American History — Etak Navigator display unit — https://americanhistory.si.edu/collections/object/nmah_1297162 5. Benj Edwards, Fast Company — 'Who Needs GPS? The Forgotten Story of Etak' (2015) — https://www.fastcompany.com/3047828/who-needs-gps-the-forgotten-story-of-etaks-amazing-1985-car-navigation-system 6. Map Happenings — 'A Curious Phenomenon Called Etak' (2024, written by Etak alumnus) — https://maphappenings.com/2024/04/11/story-of-etak/ 7. TIME Magazine — 'Driving by the Glow of a Screen' (April 20, 1987) — https://time.com/archive/6708893/computers-driving-by-the-glow-of-a-screen/ 8. Popular Science Cover — June 1985 — http://honeynav.com/wp-content/uploads/2016/01/Etak-Popular-Science.pdf 9. IEEE Paper — 'Map matching augmented dead reckoning' (Zavoli & Honey, 1986) — https://ieeexplore.ieee.org/document/1623458 10. Wikipedia — Etak — https://en.wikipedia.org/wiki/Etak 11. Hackaday — 'How Etak Paved The Way To Personal Navigation' (2018) — https://hackaday.com/2018/06/29/how-etak-paved-the-way-to-personal-navigation/ --- ## Nintendo R.O.B. (Robotic Operating Buddy) (1985) **By:** Nintendo R&D1 — invented by Gunpei Yokoi; named by Gail Tilden; industrial design by Lance Barr **Tags:** `HCI` `Robotics` `Game Peripheral` `Physical Computing` `Embodied Interaction` ### Overview R.O.B. (Robotic Operating Buddy, model NES-012) is a 9.5-inch-tall, battery-powered robot companion for the Nintendo Entertainment System, released in 1985. Unlike every other game peripheral before or since, R.O.B. is an output device: the NES sends commands to the robot through light flashes on a CRT screen, and the robot physically manipulates objects beside the TV. A phototransistor in R.O.B.'s head detects flashing green and black squares synchronized to the NTSC vertical blanking interval. A Sharp IR3T07 decoder chip translates the 13-bit pulse sequences into motor commands — UP, DOWN, LEFT, RIGHT, OPEN, CLOSE — and three DC motors move the robot's arms and rotating base. Only two games were produced for R.O.B.: Gyromite, where the robot pressed controller buttons by placing spinning tops on trays, and Stack-Up, where it assembled colored blocks into patterns. The robot was discontinued by 1988. Its real significance, however, was strategic: after the 1983 video game crash, retailers refused to stock game consoles. Nintendo bundled R.O.B. with the Deluxe Set NES to recast the system as a futuristic toy rather than a video game console, successfully gaining placement in toy aisles. R.O.B. was a Trojan horse — and the horse was a robot. ### Deep dive * **Origins.** R.O.B. was developed by Nintendo R&D1, the hardware team led by Gunpei Yokoi, who had already created the Game & Watch series and would go on to design the Game Boy and the D-pad. Yokoi is the named inventor on both US patents (4,729,563 and 4,815,733) covering R.O.B.'s photosensing control system. The same optical technology was used in the NES Zapper light gun. On the North American side, the product was named 'Robotic Operating Buddy' by Gail Tilden, Nintendo of America's sole marketing staff member at the time, who also designed the NES branding and packaging that deliberately avoided the term 'video game.' Industrial designer Lance Barr gave the NES and R.O.B. their distinctive gray/black 'hi-fi component' aesthetic, which helped position the system alongside VCRs and stereos rather than game consoles. * **How It Worked.** R.O.B. receives commands through optical signaling. The NES game software draws flashing patterns of green (bright) and black (dark) rectangles in a specific area of the CRT screen, synchronized to the TV's 60 Hz refresh rate. Each command is a 13-bit pattern: a 5-bit preamble (00010) followed by an 8-bit command byte. Six movement commands are supported: UP, DOWN, LEFT, RIGHT, OPEN, and CLOSE, plus a TEST command that lights R.O.B.'s head LED to confirm line-of-sight alignment. The robot contains three DC motors: one in the base for body rotation (300°, 5 stopping points), and two in the torso — one for vertical arm movement (2.75 inches of travel, 6 stopping points) and one for the pincer gripper (2.75 inches opening). R.O.B. has no limit switches; it uses timed friction clutches, which means old units frequently break. The motors make a loud grinding noise when operating. A critical limitation: R.O.B. only works with CRT televisions. LCD and plasma displays cannot reproduce the precise frame-timing that the optical protocol depends on. * **The Interaction Model.** R.O.B.'s interaction model is unique in consumer electronics history. It is an output peripheral — the computer sends commands into physical space through light, and a physical actuator responds by manipulating real objects. In Gyromite, the player uses a standard NES controller to play a puzzle-platform game. When R.O.B. needs to press a button on the second controller, the player presses START plus a direction on the D-pad, and the game flashes the command. R.O.B. picks up a spinning top from a motorized spinner, rotates to position over a colored tray, lowers the top onto the tray, and the tray's button depresses either the A or B button on controller 2. The game detects the controller input and opens or closes gates. This chain — player intention → D-pad input → software-rendered light flashes → phototransistor detection → motor actuation → physical object manipulation → second controller button press → game response — is an extraordinarily indirect control loop. It bridges the digital and physical worlds using nothing more than the TV screen that was already there. * **The Trojan Horse Strategy.** After the North American video game crash of 1983, the market collapsed from $3.2 billion to roughly $100 million. Retailers refused to stock video game consoles. Nintendo of America, under president Minoru Arakawa, made a deliberate decision: reclassify the NES as a toy, not a video game console. Every aspect was redesigned — the Famicom became the 'Nintendo Entertainment System,' cartridges became 'Game Paks,' the console was styled like a VCR with a front-loading cartridge slot, and the entire system was sold in the toy aisle. R.O.B. was the centerpiece of this strategy. The Deluxe Set ($249.99 in 1985, roughly $600+ today) bundled the NES with R.O.B., the Zapper light gun, Gyromite, and Duck Hunt. The New York City test market launched on October 18, 1985. A 12-person 'SWAT team' set up displays at 500 stores through Christmas Eve. 50,000 Deluxe Sets sold that holiday season. A January 1986 Nintendo survey found that R.O.B. was the #1 reason children wanted the NES — ahead of graphics, game variety, or anything else. But once Super Mario Bros. arrived in 1986, the standard controller proved the superior experience, and R.O.B. was quietly discontinued by 1988. The robot had done its job. * **Why It Matters.** R.O.B. is a landmark in physical computing — one of the earliest mass-market consumer devices where a computer program directly controls a physical actuator in the user's environment. The CRT flash protocol is a clever repurposing of existing display technology as a data link, anticipating modern techniques like screen-mediated device pairing and Li-Fi. And the artifact embodies a lesson about how industrial design, naming, and physical form factor can redefine a product category: a plastic robot companion transformed a dead product category into a billion-dollar industry. R.O.B. has become a beloved platform for hardware hackers; the AtariAge community reverse-engineered the undocumented Sharp IR3T07 protocol in the 2010s, and projects range from Bluetooth-controlled 3D-printed replacement parts to complete R.O.B. 2.0 rebuilds. ### Team * **Gunpei Yokoi.** Inventor, patent holder, head of Nintendo R&D1. Designed R.O.B.'s photosensing control system. Also created the D-pad and Game Boy. * **Gail Tilden.** Nintendo of America's advertising manager. Named the product 'Robotic Operating Buddy' and led the marketing strategy that recast the NES as a toy. * **Lance Barr.** Industrial designer. Created the NES/R.O.B. color scheme and the retail point-of-purchase displays topped with oversized R.O.B. heads. * **Don James.** Product designer. Worked on R.O.B. coloration, packaging, and display fabrication. * **Howard Phillips.** Warehouse manager who unboxed the first R.O.B. shipment, conducted early demos, and worked the mall tour circuit. Later became the face of Nintendo as 'Howard & Nester.' * **Minoru Arakawa.** President of Nintendo of America. Made the strategic decision to bundle R.O.B. and budgeted $50 million for the New York test launch. ### Media ![NES R.O.B. robot on white background — studio photo by Evan-Amos](../assets/wiki/nintendo-rob/rob-studio.jpg) *R.O.B. studio portrait by Evan-Amos. The robot's phototransistor 'eye' is visible in the head, alongside the Gyromite spinning top accessory. Licensed CC BY-SA 3.0 via Wikimedia Commons.* ![R.O.B. with Gyromite cartridge and sleeve on display at the Centre for Computing History](../assets/wiki/nintendo-rob/rob-with-cartridge.jpg) *R.O.B. with Gyromite cartridge and sleeve. Photographed at the Centre for Computing History, Cambridge.* ### Sources 1. Wikipedia — R.O.B. — https://en.wikipedia.org/wiki/R.O.B. 2. US Patent 4,729,563 — Yokoi, 'Robot-like game apparatus' — https://www.freepatentsonline.com/4729563.html 3. US Patent 4,815,733 — Yokoi, 'Photosensing video game control system' — https://worldwide.espacenet.com/textdoc?DB=EPODOC&IDX=US4815733 4. IGN — 'In Their Words: Remembering the Launch of the NES' (2015 oral history) — https://www.ign.com/articles/2015/10/19/in-their-words-remembering-the-launch-of-the-nintendo-entertainment-system 5. Video Game History Foundation — 'The NES Launch Collection' — https://gamehistory.org/nes-launch-collection-1985/ 6. GitHub: zfields/nes-rob — Complete reverse-engineering of R.O.B. protocol — https://github.com/zfields/nes-rob/blob/19a6b486500a0204ac7dfdeb39bb5da8dbcdc4f5/docs/research.md 7. Hackaday — 'Retro Gadgets: Nintendo R.O.B Wanted To Be Your Friend' (2023) — https://hackaday.com/2023/02/16/retro-gadgets-nintendo-r-o-b-wanted-to-be-your-friend/ 8. Polygon — 'Here's how Nintendo announced the NES in North America' — https://www.polygon.com/2015/10/31/9651584/nintendo-nes-anniversary-original-launch-documents 9. AtariAge Forum — Reverse-engineered command protocol (Tursi, 2011) — https://forums.atariage.com/topic/177286-any-interest-in-nes-rob-homebrews/ 10. Chris Kohler, 'Power-Up: How Japanese Video Games Gave the World an Extra Life' (2004) — https://books.google.com/books?id=VuA7DQAAQBAJ --- ## Private Eye (1989) **By:** Reflection Technology, Inc. (Allen Becker, Ben Wells, Nate Goldschlag) — Waltham, Massachusetts **Tags:** `HCI` `Head-Mounted Display` `Wearable` `Augmented Reality` `Persistence of Vision` ### Overview The Private Eye was a monochrome (red) head-mounted display introduced in 1989 by Reflection Technology, founded by MIT dropout Allen Becker. Unlike any display before or since, it generated an image using a vertical column of 280 red LEDs projected through a magnifying lens onto a voice-coil-driven vibrating mirror. The mirror swept the LED column horizontally at 50–100 Hz while LEDs pulsed at precise moments, relying on persistence of vision to fuse the scan into a stable 720×280 pixel raster. Weighing just 2.5 ounces, it consumed only 0.5 watts and cost $795 for the display unit ($2,000 with developer kit). The device covered only one eye. Because the human visual system fuses binocular input, text and graphics from the Private Eye appeared to float superimposed over the user's normal vision through the uncovered eye — a see-through augmented reality effect achieved without optical combiners. This was discovered serendipitously and became a defining feature. The Private Eye became the enabling display for virtually every early wearable computing project: Thad Starner's "Tin Lizzy" at MIT, CMU's VuMan for blueprint browsing, Columbia's KARMA augmented-reality maintenance system, and Doug Platt's Hip-PC. Starner wore a Private Eye-based wearable daily from 1993 and later became a technical lead on Google Glass, explicitly citing his Private Eye experience. Nintendo purchased exclusive rights to the display technology and used two Private Eye displays to create the Virtual Boy (1995). The Virtual Boy's commercial failure led directly to Reflection Technology's closure in 1996. ### Deep dive * **Origins.** Allen Becker dropped out of MIT and worked at Kurzweil Computer Products (Ray Kurzweil's reading machine company) before founding Reflection Technology in 1986. The core insight was that a mechanically scanned LED array could produce a viable raster display in an extremely compact package. Co-inventors Ben Wells and Nate Goldschlag contributed to the design. US Patent 4,934,773 ("Miniature video display system") was filed July 27, 1987 and granted June 19, 1990. * **How It Worked.** A vertical column of 280 red LEDs shines through a magnifying lens onto a mirror mounted on a voice-coil actuator. The mirror oscillates horizontally, sweeping the column of light across the user's field of view. By pulsing individual LEDs at precise moments during each sweep, the system draws successive columns of pixels onto the retina. Persistence of vision fuses these into a stable 720×280 bitmap image appearing as a virtual 15-inch display at 18 inches (22-degree field of view). The entire optical assembly fits in a light-tight box measuring 3.2 × 1.2 × 1.1 inches. * **The Accidental AR Effect.** The Private Eye was designed to be monocular — covering only one eye. Users discovered that the brain automatically fuses the display image with the real-world view from the uncovered eye, creating the illusion of a transparent screen floating in space. This required no beam splitters, no optical combiners — just human neurophysiology. MIT researchers documented this effect extensively, and it became the basis for the "glance-at" interaction model: information was available with a quick glance upward while maintaining eye contact and situational awareness. * **Wearable Computing's Enabling Display.** Before the Private Eye, head-mounted displays were heavy, power-hungry, and expensive (e.g., the VPL EyePhone at $250,000/system). The Private Eye's 2.5-ounce weight, 0.5-watt draw, and $795 price made all-day wearable computing practical. MIT's Thad Starner built his "Tin Lizzy" system around the Private Eye paired with a Twiddler chording keyboard — one hand for input, one eye for output. He wore this daily from 1993 through the late 1990s, typing 60 wpm while walking. CMU's VuMan 1 (1991) used the Private Eye for browsing blueprints hands-free. Columbia's KARMA system (1993) overlaid maintenance instructions onto real equipment via the Private Eye. * **The Nintendo Virtual Boy Connection.** Nintendo purchased exclusive rights to the Private Eye display technology for an estimated $5 million, becoming the first-ever minority investor in a US company for Reflection Technology. The Virtual Boy (1995) used two Private Eye displays to create stereoscopic 3D. It was a commercial failure — only ~800,000 units sold, discontinued within a year — and Reflection Technology closed in September 1996 as a direct result. * **Legacy.** Thad Starner, who wore a Private Eye daily for years, was hired by Google in 2010 as a technical lead on Project Glass. He has explicitly stated that Google Glass is a continuation of his Private Eye work. The Private Eye also established the "pocket computer + private head-worn display" paradigm that would later inform smartphones, smart glasses, and modern AR headsets like HoloLens and Apple Vision Pro. The device is held in the permanent collection of the Deutsches Museum in Munich. ### Team * **Allen "Al" Becker.** Founder of Reflection Technology, MIT dropout, former Kurzweil engineer. * **Ben Wells.** Co-inventor, contributed to optical and mechanical design. * **Nate Goldschlag.** Co-inventor. * **Thad Starner.** MIT wearable computing pioneer who wore Private Eye daily from 1993; later Google Glass technical lead. ### Media ![Reflection Technology Private Eye display unit, held in hand](../assets/wiki/private-eye/pe-display-unit.png) *Private Eye display unit. The 3.2-inch box contains a 280-LED array and a vibrating mirror that paints a 720×280 image onto the retina. Source: loper-os.org vintage computing archive.* ![Two separate eye views: Private Eye display image and real-world view](../assets/wiki/private-eye/pe-separate-view.gif) *Left: the red LED image from the Private Eye. Right: the real-world view through the uncovered eye. The brain fuses these into a single augmented-reality view. Source: MIT Media Lab.* ![Composite fused view showing Private Eye image overlaid on real world](../assets/wiki/private-eye/pe-composite-view.gif) *The fused view — the brain automatically superimposes the Private Eye's red image onto the real world. An accidental AR breakthrough. Source: MIT Media Lab.* ### Sources 1. Kill Screen — "Seeing Red" (definitive Private Eye history: Becker, Nintendo deal, Virtual Boy) — https://www.killscreen.com/seeing-red/ 2. Deutsches Museum — Private Eye entry (Google Arts & Culture) — https://artsandculture.google.com/asset/reflection-technology-private-eye-display/QgFnZtDAdVz0CQ 3. MIT Media Lab — Wearable Computing Timeline — https://www.media.mit.edu/wearables/lizzy/timeline.html 4. MIT — Building a head mount for the Private Eye (fusion effect documentation) — https://www.media.mit.edu/wearables/lizzy/lizzy/pe.html 5. Event Horizons — P4 Documents Archive (full scanned developer docs, schematics) — https://www.eventhorizons.com/projects/P4/p4.html 6. US Patent 4,934,773 — Miniature video display system (Becker) — https://www.freepatentsonline.com/4934773.html 7. Bill Buxton — Private Eye Brochure PDF (original sales brochure) — https://billbuxton.com/Private_Eye_Brochure.pdf 8. MIT Technology Review — Starner on Google Glass (Private Eye → Glass lineage) — https://www.technologyreview.com/2013/06/04/177780/ 9. Becker, A. (1990) — Design Case Study: Private Eye. Information Display journal — https://doi.org/10.1002/j.2637-496x.1990.tb05924.x 10. Stories by Williams — Digital Eyewear Through the Ages — https://storiesbywilliams.com/2013/09/21/digital-eyewear-through-the-ages/ --- ## Radio Drum / Radio Baton (c. 1987) **By:** Max Mathews and Bob Boie, Bell Laboratories; Andrew Schloss (percussion pioneer); later Stanford CCRMA **Tags:** `HCI` `3D Spatial Input` `Music HCI` `Gestural Controller` `Capacitive Sensing` ### Overview The Radio Drum (also called the Radio Baton) is a 3D position-sensing MIDI controller developed at Bell Laboratories in the mid-to-late 1980s. Two drumstick-like batons, each containing a radio-frequency transmitter at a slightly different frequency, move freely in the air above a flat rectangular antenna surface. The surface contains an array of receiving antenna plates (typically five copper plates). An embedded 80186 processor measures the electrical capacitance between each baton tip and the receiving antennas, computing 3D Cartesian coordinates for both batons in real time — X, Y, and Z (height above the surface) — with approximately 1mm resolution and continuous 100Hz update rates. The device was originally Bob Boie's attempt to build a "three-dimensional computer mouse." It failed in that role — but Max Mathews, the director of acoustic research at Bell Labs who had written the first-ever computer music program (MUSIC I, 1957), recognized its potential as a musical instrument. Under Mathews' direction, the Radio Drum became a performance controller. Andrew Schloss later pioneered its use as a virtual percussion instrument, developing the gesture recognition needed to detect strikes, rolls, and nuanced drumming techniques from the baton trajectories. Three decades later, the Radio Drum is still in active use. The Computer History Museum holds at least one original unit. ### Deep dive * **Origins: The 3D Mouse That Failed.** In the mid-1980s, Bell Labs engineer Bob Boie set out to build a three-dimensional computer mouse. His approach was ingenious: measure the capacitance between a handheld transmitter and an array of receiving antennas embedded in a flat surface. By computing the first moment of capacitance across the antenna array, he could derive precise X and Y position; the reciprocal of that first moment gave Z (height). An 80186 embedded processor converted five capacitance readings into 3D coordinates at ~100Hz. Best accuracy was within 0–5 cm above the surface, though useful tracking extended to approximately 1 meter. The 3D mouse concept never caught on — but Max Mathews immediately saw it as a musical instrument. * **Max Mathews: The Father of Computer Music.** Max Mathews wrote MUSIC I in 1957 on an IBM 704 — the first computer program to synthesize sound. He directed the Acoustic Research department at Bell Labs for over 30 years, creating the MUSIC-N family of synthesis languages that evolved into Csound, Max/MSP, SuperCollider, and Pure Data. By the 1970s, Mathews had shifted focus to live performance: "Starting with the Groove program in 1970, my interests have focused on live performance and what a computer can do to aid a performer." The Radio Drum was his answer — a way to give electronic musicians the same expressive, physical control that acoustic instrumentalists have over their instruments. * **Two Paradigms: Conductor and Percussionist.** Mathews developed two distinct interaction models. In the "Radio Baton" conducting paradigm, the performer uses the batons like an orchestral conductor's baton, controlling tempo, dynamics, and articulation via Mathews' Conductor Program software. Different spatial zones on the plate trigger different sections. In the "Radio Drum" percussion paradigm, pioneered by Andrew Schloss, the surface is treated as a virtual drum — the performer strikes downward, and the system detects the direction change in Z to trigger notes, with velocity derived from Z-speed. Schloss developed techniques for snare rolls and complex percussion gestures by analyzing the derivative of Z. * **Telepresence and Robotic Instruments.** David A. Jaffe's 70-minute concerto "The Seven Wonders of the Ancient World" used the Radio Drum to control a Yamaha Disklavier grand piano and a plucked-string/percussion orchestra in real time. "The Space Between Us" had the Radio Drum controlling Trimpin robotic percussion sculptures with string players distributed around the concert hall — an early example of gestural telepresence. * **Accessibility: Music for Deaf Children.** Bob Rocco applied the Radio Baton to music education for deaf children. Because the system provides strong tactile and spatial feedback — the batons vibrate, the surface provides a physical reference — deaf children could feel the relationship between their gestures and the resulting sound vibrations, creating a multisensory music experience that did not depend on hearing. * **Legacy.** The Radio Drum is one of the earliest high-bandwidth, continuous 3D free-space gestural controllers. It predates consumer VR controllers and spatial input devices by years. Its papers are foundational in the NIME (New Interfaces for Musical Expression) community. Its lineage traces back to the theremin (1917) and forward to the Leap Motion, Kinect, and Apple Vision Pro hand tracking. The Radio Drum proved that expressive, no-contact 3D control was not only possible but musically satisfying. ### Team * **Max Mathews.** Director of Acoustic Research, Bell Labs; creator of MUSIC I (1957); father of computer music. * **Bob Boie.** Bell Labs engineer who designed the capacitive sensing electronics; originally built it as a "3D mouse." * **Andrew Schloss.** Percussionist and computer musician who pioneered the Radio Drum as a virtual percussion instrument; continues development. * **David A. Jaffe.** Composer of major Radio Drum works including "The Seven Wonders of the Ancient World." * **Bob Rocco.** Applied Radio Baton to music education for deaf children. ### Media ![The Radio Baton device at Stanford's CCRMA in 2015](../assets/wiki/radio-drum/rd-ccrma-device.jpg) *The Radio Baton at Stanford's CCRMA in 2015. The batons and antenna surface remain essentially unchanged from the 1987 design. Source: Daniel Hartwig, Wikimedia Commons (CC-BY-SA 2.0).* ![Close-up of the Radio Drum antenna surface and batons at the University of Victoria](../assets/wiki/radio-drum/rd-uvic-drum.jpg) *Close-up of the Radio Drum at the University of Victoria. The foam-covered surface is a 30×30 cm antenna array. Source: UVic MISTIC Lab.* ### Sources 1. CCRMA Stanford — The Mathews Radio Baton (official project page) — https://ccrma.stanford.edu/radiobaton/ 2. University of Victoria — Radio Drum (Andrew Schloss: detailed specs, history) — https://www.ece.uvic.ca/~peterd/radiodrum.html 3. Wikipedia — Radiodrum — https://en.wikipedia.org/wiki/Radiodrum 4. Computer History Museum — Max Mathews with his Radio-Baton — https://www.computerhistory.org/revolution/computer-graphics-music-and-art/15/222/634 5. Bob Rocco — Max Mathews Radio Baton (firsthand collaboration account) — https://bobrocco.com/max_mathews_radio_baton 6. Mathews & Schloss (1989) — "The Radio Drum as a Synthesizer Controller," ICMC Proceedings 7. Mathews (1991) — "The Radio Baton and Conductor Program," Computer Music Journal 15(4) 8. CCRMA 252 — Radio Baton technical description (block diagrams, capacitance principle) — https://ccrma.stanford.edu/CCRMA/Courses/252/sensors/node27.html --- ## Broderbund U-Force (1989) **By:** Broderbund Software, Inc. — David Capper (project lead, former Mattel Toys); Stan and Avi Axelrod (electronics engineers from San Francisco Exploratorium) **Tags:** `HCI` `Touchless Input` `Infrared Sensing` `Gaming` `Motion Control` ### Overview The U-Force was a touchless infrared game controller for the Nintendo Entertainment System, released in 1989 by Broderbund Software — a company known for publishing The Print Shop, Where in the World Is Carmen Sandiego?, and Prince of Persia, not for manufacturing consumer electronics. The device unfolded like a laptop into two perpendicular panels, each housing arrays of infrared LEDs and photodetectors. Nine IR emitter-detector pairs created a sensing field about one cubic foot in volume above the device. When a player's hand moved through this field, it interrupted different IR beams; an onboard COP320 microcontroller translated beam occlusion patterns into directional controls and button presses via the standard NES controller protocol. The U-Force was genuinely sophisticated. In analog mode, it output 5-bit sensor readings — more precise than the NES's native 8-button digital protocol, presaging analog thumbsticks by seven years. DIP switches selected between six operating modes optimized for different game genres. Accessories included a "Power Bar" for boxing games, hand grips, and a T-bar flight yoke whose underside contained IR reflectors. The device's failure was comprehensive: ambient household lighting confused the IR sensors, calibration drifted during play, the lack of tactile feedback made precision impossible, and each unit required painstaking manual calibration at the factory by hand-cutting resistors and soldering capacitors. The slogan "Don't Touch!" became an ironic epitaph. IGN ranked it the 8th worst video game controller ever made. ### Deep dive * **Origins: A Software Company's Hardware Folly.** Broderbund Software was founded in 1980 by brothers Doug and Gary Carlston. By 1989, it was one of the largest educational and entertainment software publishers in the world. The U-Force was their sole foray into hardware manufacturing. The project was led by David Capper, a former Mattel Toys executive who had worked on the Intellivision. The electronics prototype was developed by Stan and Avi Axelrod from San Francisco's Exploratorium museum — an institution dedicated to hands-on science exhibits. Broderbund invested heavily, launching at the January 1989 Winter CES alongside the Power Glove. Both devices embodied the same bet: that consumers wanted to move their bodies, not just their thumbs. Both bets failed. * **The Infrared Sensing Grid.** The U-Force's two perpendicular panels contained nine infrared LED/photodetector pairs — at the time, more IR LEDs than any other consumer electronic device. The top and bottom panels fired beams in perpendicular orientations, creating a quartersphere-shaped detection volume about 12 inches in diameter. When a hand entered this volume, it blocked specific beams. The COP320 microcontroller (National Semiconductor, 20 MHz) polled the photodetectors, ran an 8-bit ADC0831 analog-to-digital converter, and computed which D-pad directions and buttons to report. * **The Calibration Nightmare.** Each unit required individual factory calibration. Groups of resistors were soldered in parallel onto the main PCB, and technicians used wire cutters to physically sever individual resistors to tune sensor sensitivity. Additional capacitors (50–100 pF, up to three in parallel) were soldered in as needed. Reverse-engineerer Kevin "Kevtris" Horton documented: "The design is pretty terrible and needed a lot of hand tweaking to make it function." Some units had resistors re-soldered and re-cut multiple times before passing quality control. This hand-tuning process was incompatible with consumer electronics manufacturing at scale — every U-Force was effectively a prototype. * **The 1989 Motion-Control Wars.** The U-Force and the Mattel Power Glove both launched in 1989 at nearly identical price points ($69.95 vs. $79.95). Both promised to replace the traditional gamepad with body-based interaction. But their approaches were diametrically opposed: the Power Glove was wearable (fiber-optic glove with ultrasonic position tracking), while the U-Force was stationary (a desktop IR field you reached into). The Power Glove sold 1.3 million units and became a cultural icon. The U-Force sold so poorly that surviving units are rare today. Together they represent two complementary visions for how the body should interact with games. * **Why It Failed: The HCI Postmortem.** The U-Force failed for reasons that are textbook HCI lessons. Environmental robustness: consumer IR sensing in 1989 could not handle living room variability. Calibration: the device required a stable sensor-environment relationship impossible to guarantee outside a lab. No tactile feedback meant users had no proprioceptive reference for the sensing field's boundaries. Gorilla-arm fatigue: holding hands extended above the device for minutes was physically uncomfortable. Software ecosystem gap: no NES games supported analog input, so the U-Force's most interesting capability was unused. Every one of these failure modes would be re-encountered with Kinect, Leap Motion, and other touchless controllers decades later. * **Legacy.** The U-Force is a landmark in the history of touchless consumer interfaces. It predates Microsoft Kinect by 21 years and the Nintendo Wii by 17. Its raw analog sensing capability anticipated the analog thumbstick era (N64, 1996) by seven years. It demonstrated — painfully — that novel interaction models require robust sensing, environmental tolerance, and software support to succeed. The reverse-engineered protocol documentation by Kevtris has made it a beloved artifact in the retro-computing community. ### Team * **David Capper.** Project lead; former Mattel Toys executive who worked on Intellivision. * **Stan Axelrod.** Electronics engineer from San Francisco's Exploratorium museum; created working prototype. * **Avi Axelrod.** Electronics engineer; co-developed the prototype with Stan Axelrod. * **Richard Bernstein.** Broderbund executive who championed the U-Force project. * **Stuart Weiss.** Broderbund executive; co-championed the hardware venture. * **Kevin "Kevtris" Horton.** Reverse-engineered the U-Force protocol and documented its internal architecture. ### Media ![U-Force controller in open position with hand hovering above the IR sensing field](../assets/wiki/uforce/uf-wikipedia.jpg) *The U-Force in its open position. Nine infrared emitter-detector pairs in the top and bottom panels create a sensing field; the player's hand interrupts beams to control on-screen action. Source: Wikipedia.* ![Internal PCB showing hand-cut calibration resistors inside the U-Force](../assets/wiki/uforce/uf-hackaday-internal.jpg) *Internal PCB showing the resistor arrays that were hand-cut at the factory to calibrate each unit's IR sensor sensitivity. Source: Hackaday / Kevtris.* ![1989 COMPUTE! Magazine press photo of U-Force with Power Bar accessory](../assets/wiki/uforce/uf-compute-press.jpg) *Original 1989 press photo from COMPUTE! Magazine showing the U-Force with Power Bar and Hand Grip accessories. Source: COMPUTE! Magazine, March 1989.* ### Sources 1. Wikipedia — U-Force — https://en.wikipedia.org/wiki/U-Force 2. Kevtris Technical Reverse-Engineering (complete protocol & circuit analysis) — http://blog.kevtris.org/blogfiles/nes/uforce.txt 3. Hackaday — "Why You've Never Heard About Nintendo's U-Force" (2022) — https://hackaday.com/2022/09/05/why-youve-never-heard-about-nintendos-u-force/ 4. Retro Handhelds — "Game Over: Broderbund U-Force" (Jim Gray, 2026) — https://retrohandhelds.gg/game-over-broderbund-u-force/ 5. Kotaku — "Don't Touch This Horror Of A NES Controller" (Luke Plunkett, 2011) — https://kotaku.com/dont-touch-this-horror-of-a-nes-controller-5755430 6. COMPUTE! Magazine Issue 106 (March 1989) — original launch coverage — https://www.atarimagazines.com/compute/issue106/news_notes_touch.php 7. Internet Archive — Original Broderbund U-Force Manual — https://archive.org/details/broderbund-u-force-manual 8. ClassicGamesBlog — U-Force review with box/accessory photos — https://classicgamesblog.com/nintendo-nes/worst-nes-accessories/uforce/ --- ## Buchla Lightning (1991) **By:** Buchla & Associates (Don Buchla) **Tags:** `Music HCI` `Gesture` `Optical Tracking` `MIDI Controller` `Infrared Sensing` `Spatial Interface` `Alternative Controller` ### Overview The Buchla Lightning is a MIDI controller designed by synthesis pioneer Don Buchla, first released in 1991. It consists of two handheld, wireless wands that emit infrared light, and an optical receiver unit that tracks their position in space using triangulation. The performer waves the wands in the air, and the system translates the wands' X-Y position, velocity, acceleration, and directional changes into MIDI note and controller data in real time. A digital signal processor analyzes gesture — downward strikes can trigger percussion, lateral movements can bend pitch, and spatial zones can define entirely different instrument behaviors. The performer literally sculpts sound from empty space. Three versions were produced: Lightning I (1991), Lightning II (1996), and Lightning III (2008). The original Lightning housed both the electronics and the optical sensor in a single box that mounted on a microphone stand. Lightning II separated the optics into a compact triangular remote head, moved the electronics into a half-rack cabinet, greatly extended the operating range (up to 12 feet high by 20 feet wide), and added a built-in 32-voice General MIDI synthesizer. Lightning III added a Z-axis (proximity) for depth sensing, though this axis was less precise than the X-Y tracking. Lightning was hand-built in small quantities by Buchla & Associates in Berkeley, California, and sold direct to musicians for $1,995. It was never a mass-market product but occupied a unique niche among experimental composers, percussionists, and electronic performers seeking an embodied, theatrical way to control synthesis. The instrument was used by notable figures including George E. Lewis, Andrew Schloss, Lê Quan Ninh, Forrest Tobey (who rang in the millennium at Times Square with Lightning wands), and Joel Davel — Buchla's long-time collaborator who helped design and test the hardware. Lightning represents Don Buchla's shift from modular synthesis toward radical new controller interfaces, and stands as one of the earliest practical optical gesture-recognition instruments for live musical performance. ### Deep dive * **Origins / Design.** Don Buchla designed Lightning during a period (1989–2004) when he deliberately stepped away from building modular synthesizers to focus entirely on creating expressive alternative MIDI controllers. Lightning was the second in this series, following the Buchla Thunder (1990), a touch-sensitive tactile controller. Buchla was driven by a belief that traditional keyboard interfaces constrained electronic music expression, and he sought to create instruments where physical gesture mapped directly to sound. The original Lightning I (model 900) housed both the optical sensor array and all control electronics in a single metal box mounted on a mic stand. The two wands contained infrared LEDs powered by non-replaceable batteries (about 2 hours of life). The system used optical triangulation: the receiver's photosensors detected the IR light from each wand and computed 2D X-Y position. The wands also had momentary push-buttons to add discrete control events. Lightning II (1996) was a major redesign. The optical receiver became a small, lightweight triangular remote head (1.5 x 6 x 8 inches, 12 ounces), while the electronics moved to a half-rack cabinet (1.7 x 8.5 x 10 inches, 3 pounds). The wands were redesigned with replaceable AA batteries providing 15–60 hours of use, a blinking LED low-battery warning, and dual-range operation. The operating area expanded dramatically to roughly 12 feet high by 20 feet wide. Internal RAM presets increased from 12 to 30, ROM presets from 3 to 30, and a memory card slot added storage for 30 additional presets per card. A built-in 32-voice General MIDI synthesizer allowed Lightning II to function as a complete standalone instrument. The supervisory microprocessor was a Texas Instruments TMS370. Lightning III (2008) kept the same price ($1,995), the same wands, and nearly identical software, but added a Z-axis (proximity/depth) sensing capability. The triangular remote sensor became rectangular. The primary improvements were in sensitivity, resolution, accuracy, and response time. All three Lightning versions used the same core gesture-recognition engine and programming interface. * **Interaction Model.** Lightning's interaction model was fundamentally spatial and embodied. The performer held one wand in each hand and moved freely within the sensor's detection zone. The system tracked four independent coordinates (X and Y for each hand) in real time, plus button state. From successive position readings, the TMS370 DSP computed instantaneous velocity and acceleration, then performed detailed gesture analysis to classify movement patterns. The performer programmed Lightning using an 'interface language' that mapped gestures to MIDI events. Common mappings included: mapping X-Y position to MIDI continuous controllers (creating invisible pitch wheels, pan pots, modulation wheels, or volume sliders in midair); analyzing strike gestures for direction and velocity to generate MIDI notes with velocity sensitivity (air drums); dividing the performance space into zones, each triggering different sounds or behaviors; and a conductor mode that analyzed beat patterns, displayed tempo deviations, detected missed beats, and transmitted a synchronized MIDI clock for controlling external sequencers. User-definable scale and tuning tables allowed pitch ranges and note selections to be mapped along any axis, with arbitrary note ordering — letting performers create 'invisible orchestras' arrayed in space. Buttons on each wand provided additional discrete triggers. The interaction was described by performer Joel Davel as resembling 'a hyperactive magician casting abracadabra spells into the ether' (Newsday), requiring both musicality and physical virtuosity. The MIDI.org article described it thus: 'Imagine if the batons held by a member of the ground crew to safely direct an aircraft into a gate at an airport controlled the pitch, timbre, and other aspects of sound generated by a synthesizer. That's essentially what Don Buchla's Lightning does.' Lightning lent itself particularly well to percussive styles, but could be programmed for any genre. * **Legacy.** Buchla Lightning occupies a pivotal position in the history of gestural music controllers. It connected the theremin (the original analog spatial instrument from 1920) with later computer-vision and motion-sensing controllers. Max Mathews's Radio Baton (1986) and Palmtree Instruments' Airdrums (1986) were contemporaries, but Lightning was uniquely sophisticated in its real-time gesture analysis, wireless operation, multi-zone spatial mapping, and integration with the MIDI ecosystem. Lightning was commercially niche — hand-built in small batches, sold direct from Buchla & Associates in Berkeley at $1,995 — but it found adoption among academic computer music centers (IRCAM, CNMAT at UC Berkeley, CCRMA at Stanford) and experimental performers. George E. Lewis composed 'Virtual Discourse' (1993) for Lightning-controlled virtual percussion and four live percussionists, premiered at the Musée des Beaux-Arts in Bordeaux. Lightning wands were famously used by Forrest Tobey to perform a 'Virtual Orchestra' during the Times Square millennium New Year's Eve celebration in 1999/2000, seen by millions worldwide. After Don Buchla's death in 2016, Lightning production ceased. The brand was acquired by a new company (Buchla USA), which focuses on the 200e modular synthesizer series and does not offer Lightning. Units occasionally appear on the secondhand market, typically selling for $1,500–$2,500. The instrument's DNA is visible in later optical controllers like the Dimension Beam/D-Beam (licensed by Roland), and it presaged the gesture-control paradigm that became mainstream with the Nintendo Wii (2006) and Microsoft Kinect (2010). Lightning was recognized in Joel Chadabe's 'Electric Sound' (1997) and Bart Hopkin's 'Gravikords, Whirlies & Pyrophones' (1996) as a landmark experimental instrument. ### Team * **Don Buchla.** Inventor, designer, founder of Buchla & Associates * **Joel Davel.** Primary hardware assistant, PCB designer (post-1995), alpha tester, preset author, and virtuoso performer * **Forrest Tobey.** Lightning virtuoso, Peabody Conservatory artist-in-residence; performed Virtual Orchestra at Times Square millennium celebration ### Media ![Buchla Lightning I system with two wands and main unit](../assets/wiki/buchla-lightning-1.jpg) *Original Buchla Lightning I (1991) with main unit, two wand transmitters, power supply, and manual. Serial #1037. (Source: MATRIXSYNTH)* ![Buchla Lightning II wands - two baton-like infrared transmitters](../assets/wiki/buchla-lightning-2.gif) *Lightning II wireless wands — baton-like IR transmitters, 11 inches long, 0.8 inches diameter, 3 ounces each, powered by a single AA cell. (Source: archived buchla.com)* ![Lightning II triangular remote optical sensor head](../assets/wiki/buchla-lightning-3.gif) *Lightning II triangular remote optical head for IR triangulation, mounted on a mic stand in front of the performer. (Source: archived buchla.com)* ### Sources 1. Wikipedia: Buchla Lightning — https://en.wikipedia.org/wiki/Buchla_Lightning 2. Buchla & Associates — Lightning II Description (archived) — https://web.archive.org/web/20130929091922/http://www.buchla.com/lightning/descript.html 3. Buchla & Associates — Lightning II Technical Specifications (archived) — https://web.archive.org/web/20130929071400/http://www.buchla.com/lightning/tech.html 4. MATRIXSYNTH: Buchla Lightning MIDI controller (detailed photos, serial #1037) — https://www.matrixsynth.com/2014/09/buchla-lightning-midi-controller-with-2.html 5. MIDI.org: Alternative Controllers (Mark Vail, features Lightning II) — https://midi.org/alternative-controllers-was-part-5 6. Joel Davel — Lightning II page (performer description, photos) — https://isproductions.com/joel/lightning.html 7. Keyboard magazine review of Buchla Lightning, September 1991, p.148 — http://www.youngmonkey.ca/nose/magazines/Keyboard-r/MIDIControllers.html 8. YouTube: What is a Buchla Lightning? (Joel Davel explains) — https://www.youtube.com/watch?v=iPAhZUZbgrU 9. YouTube: Joel Davel — Out of Thin Air on Buchla Lightning — https://www.youtube.com/watch?v=HSf8sYHWBsQ --- ## Fakespeare BOOM (Binocular Omni-Orientation Monitor) (1989) **By:** Fake Space Labs (Mark Bolas, Ian McDowall, Eric Lorimer) **Tags:** `VR` `Immersive Display` `Head-Coupled Display` `Tracking` `Mechanical` ### Overview The BOOM (Binocular Omni-Orientation Monitor) was a head-coupled stereoscopic display system built by Fake Space Labs in Mountain View, California, beginning in 1989. Rather than mount CRTs directly on the user's head — the approach taken by VR headsets like the VPL EyePhone — the BOOM suspended two high-resolution CRTs and LEEP wide-angle optics inside a viewing hood attached to a spring-counterbalanced, multi-link articulated arm. The user gripped two handles on the hood, pressed their face into the optics, and physically guided the display to any position within its operational volume. Optical encoders in each joint of the arm provided real-time 6-DOF head tracking with effectively zero latency, since the tracking was intrinsic to the display mount itself. Three models were produced: the BOOM 2 (monochrome), BOOM 2C (16-bit color), and BOOM 3C (full color). All ran at 1280×1024 resolution per eye — extraordinarily high for the era, eclipsing the ~200×300 pixel LCDs found in contemporary HMDs. Stereo FOV ranged up to approximately 100° horizontally (140° with spherical wide-angle optics). The BOOM 2 sold for approximately $27,000. The system was first shown publicly at SIGGRAPH 1991. Fakespeare Labs was founded in 1988 by Mark Bolas, Ian McDowall, and Eric Lorimer. The company split into Fakespeare Labs (R&D) and Fakespeare Systems (commercial) in 1998; Fakespeare Systems was acquired by Mechdyne Corporation in 2003. BOOM systems were deployed at NASA Ames Research Center, Sandia National Laboratories, SRI International, Boeing, DaimlerChrysler, and numerous university VR labs for scientific visualization, computational fluid dynamics, and molecular modeling. The BOOM's mechanical approach to immersive display — trading wearability for precision and rendering quality — represents a unique design philosophy in VR history, and Bolas' subsequent work at USC's Institute for Creative Technologies directly influenced the modern VR renaissance through his mentorship of Oculus founder Palmer Luckey. ### Deep dive * **Origins & Design.** Mark Bolas' 1988-89 Master's thesis at Stanford, 'Design and Virtual Environments,' was among the first efforts to map the breadth of virtual reality as a new medium. The BOOM emerged directly from this research and from Bolas' work at NASA Ames Research Center's telepresence projects. Bolas co-founded Fakespeare Inc. in 1988 with Ian McDowall and Eric Lorimer specifically to build instrumentation for VR research labs. The BOOM's mechanical design was ingenious in its constraints. A multi-link arm, similar to a desk lamp suspension but precision-engineered, supported the weight of two small CRTs (approximately 1.5-2 inch Sony tubes) and LEEP optics housed in a viewing hood. A spring counterbalance system — covered by US Patent 5,253,832 (filed July 26, 1991, issued October 19, 1993) — made the hood effectively weightless to the user. Optical encoders at each joint provided 6-DOF position and orientation tracking with resolution far finer than the magnetic or ultrasonic trackers of the era, and with no measurable latency since the tracking signal path was purely mechanical-electrical with no computer vision or radio processing required. The display resolution — 1280×1024 stereo per eye — was driven by the host workstation's graphics pipeline. The BOOM acted essentially as a specialized CRT monitor with integrated tracking. Three models offered different color capabilities: BOOM 2 (monochrome, green phosphor), BOOM 2C (16-bit color using two primary colors), and BOOM 3C (full 24-bit color). Stereo separation was achieved through the dual-CRT/LEEP optics arrangement, with options for spherical wide-angle and flat medium-field focal lengths. * **Interaction Model.** Using the BOOM was a physical, embodied experience unlike donning a headset. The user approached the viewing hood, grasped two handles on either side, and pressed their eyes against the optical ports. To look around a virtual environment, they physically pushed, pulled, and rotated the hood through space — the articulated arm translating their body movements into viewpoint changes with perfect 1:1 correspondence. There was no weight on the head, no cables snaking to the floor, no calibration drift. If you wanted to see what was behind you, you physically turned your body and pulled the hood with you. The BOOM occupied an intermediate position between CAVE-style projection environments (where the user walks freely inside a room) and HMDs (where the display is worn). It offered the rendering quality and precision of a fixed workstation monitor with the immersiveness of a head-worn display, at the cost of restricting movement to the arm's reach. This made it particularly well-suited for seated or standing-in-place applications like molecular docking, CAD review, and vehicle interior inspection — tasks where precise visual fidelity mattered more than room-scale movement. The BOOM was often paired with Fakespeare's other inventions, including the Pinch Glove (a fabric glove with conductive fingertips that detected pinching gestures for 3D manipulation) and the PUSH (a pressure-sensitive handheld input device). Together they formed an integrated immersive workbench for scientific and engineering visualization. * **Legacy.** The BOOM represents the high-water mark of a design philosophy that prioritized visual fidelity and tracking precision over wearability and affordability. As LCD technology improved and HMDs shrank, the mechanical-boom approach became less attractive relative to the freedom of untethered (or at least head-mounted) VR. But the BOOM's influence persisted in several ways. Fakespeare Labs later developed the RAVE (Reconfigurable Advanced Visualization Environment), a modular large-screen projection VR system; the ImmersaDesk, a drafting-table-style VR display; and the Fakespeare Workbench — all products that, like the BOOM, emphasized extremely high-quality stereoscopic rendering for professional and scientific users. The company's software library, VLIB, became a widely-used open-source framework for VR application development. Mark Bolas went on to become a professor at USC's School of Cinematic Arts, where he directed the Mixed Reality Lab and the Interactive Narrative and Immersive Technologies Lab. There, in 2011-2012, he and his students designed an open-source HMD using off-the-shelf mobile phone components — a project that directly inspired his lab assistant, Palmer Luckey, to build the Oculus Rift. Bolas received the IEEE VGTC Virtual Reality Technical Achievement Award in 2005. He later joined Microsoft's HoloLens team. Fakespeare Systems was acquired by Mechdyne Corporation in 2003, which continued to support BOOM installations for existing customers. Individual BOOM units occasionally surface at university surplus sales and VR history collections. The BOOM's patent, the spring counterbalanced suspension system (5,253,832), remains a key document in immersive display engineering. ### Team * **Mark Bolas.** Co-founder, lead inventor; Master's thesis at Stanford on VR design space; later USC professor and mentor to Palmer Luckey * **Ian McDowall.** Co-founder of Fakespeare Inc.; hardware engineering * **Eric Lorimer.** Co-founder of Fakespeare Inc. ### Media ![Fakespeare BOOM 3C stereoscopic display on articulated arm](../assets/wiki/fakespeare-boom-1.gif) *Fakespeare BOOM 3C interactive stereo viewer — 1280×1024 per eye, full color, spherical wide-angle optics. (Source: Stanford CDR)* ![User operating a Fakespeare BOOM display, peering into the viewing hood](../assets/wiki/fakespeare-boom-2.jpg) *A user operating a Fakespeare BOOM3C boom-mounted display, grasping the handles and peering into the viewing hood. (Photo: Fakespeare, Inc., via VRArchitect)* ### Sources 1. Stanford CDR: Fakespeare Labs BOOM 3C specifications — http://www-cdr.stanford.edu/html/DesignSpace/sponsors/boom.html 2. VRArchitect: BOOM display description with photos — https://www.vrarchitect.net/anu/cg/Display/boom.en.html 3. Wikipedia: Mark Bolas — co-founder, BOOM inventor, USC professor — https://en.wikipedia.org/wiki/Mark_Bolas 4. Wikipedia: Ian McDowall — co-founder of Fakespeare Inc. — https://en.wikipedia.org/wiki/Ian_McDowall 5. AWE Hall of Fame: Mark Bolas — BOOM, Pinch Glove, RAVE, mentor to Palmer Luckey — https://www.awexr.com/hall-of-fame/27-mark-bolas 6. US Patent 5,253,832: Spring counterbalanced boom suspension system (Bolas, filed 1991, issued 1993) — https://patents.google.com/patent/US5253832A/ 7. Bolas, M.T. (1994). Human factors in the design of an immersive display. IEEE Computer Graphics and Applications, 14(1), 55-59. — https://doi.org/10.1109/38.250920 8. The Verge: VR music videos from the '90s were amazing (Fakespeare BOOM footage) — https://www.theverge.com/2016/5/23/11744016/fakespace-virtual-reality-retro-music-video --- ## Seiko RC-1000 Wrist Terminal (1984) **By:** Seiko Epson / Seiko Instruments Inc. **Tags:** `Wearable` `Wrist-Worn` `Mobile Computing` `Watch` `Pre-Smartwatch` `Serial Terminal` `Personal Information Manager` ### Overview The Seiko RC-1000 Wrist Terminal, released in 1984, was a wristwatch that doubled as a computer terminal — one of the earliest wearable computing interfaces ever sold to consumers. Unlike Seiko's earlier Data 2000 (1983) and UC-2000 (1984) wrist computers — which used proprietary keyboard docking stations with electromagnetic induction — the RC-1000 connected directly to desktop computers via RS-232C serial cable. It was compatible with over a dozen computer platforms including the Apple II, IBM PC, Commodore 64, TRS-80, Sinclair ZX Spectrum, and MSX. Marketed as a 'Wrist Terminal,' it offered 2KB of RAM, a 12x2 character dot-matrix LCD, and six side-pusher buttons. Users wrote data using Wrist Terminal Data Manager software on their desktop, then transmitted it in a single 2051-byte dump at 2400 baud. The watch itself was receive-only — a fundamentally asymmetric interaction that prefigured today's phone-to-watch communication paradigm. The RC-1000 spawned a family including the RC-4000 'PC Datagraph' (1985) and RC-4500 'WristMac' (1988), the latter becoming NASA's choice for the first email sent from space aboard the Space Shuttle Atlantis in 1991. Seiko's computer watch program was remarkably ambitious — the same year the original Macintosh shipped, Seiko was selling a wrist-worn device with 2 kilobytes of user-addressable storage, programmable alarms with custom text, world time with city labels, and a backlight. The watch cost ¥24,000 (~$100-150) in Japan and £99.95 in the UK. ### Deep dive * **Origins & Hardware Design.** The RC-1000 was developed by Seiko Epson (Seiko Instruments Inc.) as part of a broader push into wrist-worn computing that began with the Data 2000 in 1983. While the Data 2000 and UC-2000 used proprietary wireless electromagnetic induction to communicate with keyboard docks, the RC-1000 was Seiko's first device to connect directly to general-purpose computers via industry-standard RS-232C serial. The watch contained 2KB of user-accessible RAM (organized as 80 screens of 24 characters each), divided into categories: Memos, Phone Numbers, Scheduled Alarms, Weekly Alarms, and World Time. Physical dimensions were approximately 42mm x 37mm x 11mm with a black metal bracelet or plastic strap. It was the only Seiko computer watch with an EL backlight. The watch ran on a single BR2325 lithium coin cell. * **Interaction Model.** The RC-1000's interaction model was deliberately asymmetric: all data authoring happened on the desktop. The user ran Wrist Terminal Data Manager software, which provided a menu-driven interface to create memos, schedule alarms with custom text, and configure world time zones. The software produced a formatted 2051-byte binary payload representing the watch's entire memory. To receive data, the user pressed the watch's Terminal button to enter Terminal Mode, then pressed Lock — the display showed 'RECEIVE' and awaited the data stream at 2400 baud, 8 data bits, no parity, 2 stop bits. The transfer always overwrote the entire 2KB RAM; there was no incremental update. On the wrist, the Terminal button cycled through categories and the Select button scrolled through screens. Alarms would fire with custom text on schedule. The watch could not transmit data back — a pure one-way, read-from-wrist model. * **RC Series Evolution & WristMac Legacy.** The RC-4000 'PC Datagraph' (1985) upgraded to a three-line dot-matrix display with 2KB RAM. The RC-4500 'WristMac' (1988) added colorful plastic cases and Macintosh compatibility via partner company Ex Machina. In 1991, modified WristMacs were worn by NASA astronauts aboard the Space Shuttle Atlantis (STS-43), paired with a Macintosh Portable running AppleLink. Through TDRSS satellites and modem pools, the crew sent the first email from space — with WristMacs serving as wearable reminder/notification devices. A never-worn, boxed original WristMac was auctioned in 2021 with estimates up to $100,000. The RC-1000/RC-4000/WristMac lineage represents the first commercial wrist-worn computer-terminal ecosystem, directly anticipating the Apple Watch's companion-device architecture by nearly 30 years. ### Team * **Seiko Epson / Seiko Instruments Inc..** Designer and manufacturer of the RC-1000, RC-4000, and RC-4500 wrist terminals * **Ex Machina, Inc..** Co-developed WristMac (RC-4500) software and Apple Macintosh integration in 1988 * **Byron Han.** Apple engineer who built the AppleLink-in-Space system enabling the WristMac to be used on STS-43 Atlantis ### Media ![Seiko RC-1000 wrist terminal face with 12x2 LCD and red arrow buttons](../assets/wiki/seiko-rc1000-1.jpg) *Seiko RC-1000 Wrist Terminal with its 12x2 character dot-matrix LCD and six side buttons. (Source: Old Crap Vintage Computing)* ![Original Seiko RC-1000 Japanese advertisement](../assets/wiki/seiko-rc1000-2.jpg) *Original Seiko RC-1000 advertisement showing the wrist terminal concept with desktop connection. (Source: MSX Wiki)* ### Sources 1. Old Crap Vintage Computing: Seiko RC-1000 Wrist Terminal (teardown, photos, internals) — https://oldcrap.org/2023/03/29/seiko-rc-1000-wrist-terminal/ 2. MSX Wiki: Seiko RC-1000 — Description, hardware, software, gallery, pricing — https://www.msx.org/wiki/Seiko_RC-1000 3. Rob Braun (bbraun): Reverse-engineered serial protocol, memory layout, open-source upload tool — http://www.synack.net/~bbraun/rc1000/ 4. Conventional Memories Wiki: RC Series Hardware and Software — Complete model/cable/software matrix — https://conventionalmemories.com/wiki_cm/Seiko_RC_series_hardware_and_software 5. Pocket Calculator Show: Seiko Computer Watch Fun — Family history Data 2000 through WristMac — https://www.pocketcalculatorshow.com/nerdwatch/seiko-computer-watch-fun/ 6. GitHub: ppieczul/seiko-rc-1000 — Collected software, disk images, restored BASIC program — https://github.com/ppieczul/seiko-rc-1000 7. Hodinkee: The Seiko WristMac Is The First Apple Watch (2021 auction coverage) — https://www.hodinkee.com/articles/huh-a-seiko-apple-smart-watch-is-set-to-hit-the-auction-block 8. TidBITS: AppleLink in Space (29 July 1991) — STS-43 Atlantis mission coverage — https://tidbits.com/1991/07/29/applelink-in-space/ 9. Hackaday: Seiko Had A Smartwatch In 1984 — https://hackaday.com/2024/07/16/seiko-had-a-smartwatch-in-1984/ 10. Deutsches Uhrenmuseum Furtwangen: Museum catalog entry with technical specs — https://bawue.museum-digital.de/object/29881?navlang=en --- ## Barcode Battler / バーコードバトラー (1991) **By:** Epoch Co., Ltd., Tokyo, Japan **Tags:** `HCI` `Input` `Barcode` `Tangible` `Handheld` `Gaming` ### Overview The Barcode Battler was a handheld electronic game released by Epoch Co. in Japan in March 1991 that used a built-in optical barcode scanner as its sole input mechanism. The device shipped with 32 pre-printed barcode cards depicting fantasy warriors, wizards, and enemies, but its radical premise was that players could also use any real-world product barcode — cereal boxes, cleaning supplies, snack packaging — and the device would deterministically hash the numeric barcode data into character statistics (HP, Attack, Defense) for turn-based RPG combat. The game displayed results using only 7-segment numeric characters on a monochrome LCD: no graphics, no sound effects beyond beeps, just numbers on a screen and cards in your hand. The gameplay involved swiping barcodes to generate characters and items, then engaging in alternating-turn battles across multiple modes including a 10-stage single-player story mode. An internal random number generator determined combat outcomes based on the generated stats, while hidden parameters and a secret timing mechanic added depth. The Barcode Battler II (1992) added an output port that connected to the Famicom and Super Famicom, turning the handheld into a pure barcode reader for console games — 11 games were released, including titles for Super Mario, Zelda, Doraemon, and Dragon Slayer. In Japan, the Barcode Battler was a genuine cultural phenomenon. Reports circulated of certain food products selling out because schoolchildren discovered their barcodes generated exceptionally powerful characters. Strategy guide books taught barcode-splicing techniques, and a manga series ('Barcode Fighter') ran for 30 chapters in CoroCoro Comic. In the West, it was a commercial failure, remembered today as a beloved piece of retro-tech kitsch — 'so bad it's almost cool.' The Barcode Battler pioneered concepts that would become industry standards decades later: barcode/QR scanning in games, physical-to-digital bridging (Skylanders, amiibo), and collectible card stat optimization. ### Deep dive * **Origins.** Epoch Co., founded in 1958, had produced Japan's first successful programmable console (Cassette Vision, 1981) but its Game Pocket Computer (1984) had failed. The Barcode Battler was Epoch's bid to capture the emerging Japanese 'barcode gaming fad' of the late 1980s — a brief period when toy makers realized every consumer product carried machine-readable data. By marrying the barcode scanner with an RPG format (immensely popular thanks to Dragon Quest and Final Fantasy), Epoch created a toy that turned the entire supermarket into a game cartridge. The device retailed for approximately ¥9,800. * **How It Worked.** The Barcode Battler's optical scanner read 8-digit or 13-digit JAN/EAN/UPC barcodes (and ISBN codes) swiped through a slot on the right side of the injection-moulded polystyrene body. The scanner was temperamental — swipe too fast or too slow and the screen displayed 'MISS.' A deterministic hashing algorithm mapped the barcode's numeric digits to three visible stats (HP, ST/Attack, DF/Defense) plus a hidden 'special ability' parameter. The LCD displayed only alphanumeric 7-segment characters. Game modes included a 10-stage COM mode (story), B1 (player-supplied enemies), and B2 (two-player versus). A mysterious 'B3 mode' appeared on the LCD but was never implemented. The Barcode Battler II added an output port that connected to the Famicom and Super Famicom via a BBII Interface adapter, functioning as a pure barcode reader while the console handled gameplay. Eleven console games were released from 1992–1995, spanning Super Mario, Zelda, Doraemon, Dragon Slayer, Lupin III, Spider-Man, and J-League soccer. Licensed franchise cards were sold separately for Super Mario World, Zelda: A Link to the Past, Street Fighter II, and others. * **Cultural Impact.** The Barcode Battler captured the Japanese public imagination in ways that seem absurd in retrospect. Schoolchildren cut barcodes off supermarket products without buying them, causing problems for retailers. Unscrupulous adults sold 'super-powerful' custom barcodes to naive children. Certain food products reportedly sold out when their barcodes were discovered to produce powerful in-game characters. Epoch published a regular newsletter, held official tournament events at toy stores distributing exclusive promotional cards, and commissioned the 30-chapter manga 'Barcode Fighter' (バーコードファイター) by Toshihiro Ono, serialized in Monthly CoroCoro Comic from 1992–1994. Irish supermarket chains Quinnsworth and Crazy Prices gave away 10,000 units in a 1993 promotion. In the West, the device was shelved alongside Game Boy and Game Gear — offering no graphics and temperamental scanning — and quickly vanished. * **Legacy.** Despite its commercial failure, the Barcode Battler pioneered concepts that became industry standards: barcode/QR scanning in games (Nintendo e-Reader, Skannerz, modern mobile QR games), physical-to-digital bridging (Skylanders, Disney Infinity, amiibo), collectible card battling with real-world objects, and external storage media games (echoes in Monster Rancher's CD-reading mechanic). In 2025, UK developer Tanukii Studios published Riot Gunheads, a new 36-card set compatible with the Barcode Battler II hardware, demonstrating the device's enduring appeal. ### Team * **Epoch Co., Ltd..** Japanese toy and video game company, founded 1958 by Maeda Taketora. Creator of Cassette Vision (1981) and Sylvanian Families. * **Toshihiro Ono.** Manga artist who created the 'Barcode Fighter' promotional manga series (1992–1994) ### Media ![Epoch Barcode Battler handheld with LCD display on](../assets/wiki/barcode-battler-1.png) *The Barcode Battler with its LCD display illuminated, showing numeric character stats. Source: Wikimedia Commons.* ![Barcode Battler close-up showing barcode scanner slot and card](../assets/wiki/barcode-battler-2.jpg) *Close-up of the Barcode Battler showing the card-scanning slot and a sample barcode card. Source: Wikimedia Commons.* ### Sources 1. Wikipedia — Barcode Battler — https://en.wikipedia.org/wiki/Barcode_Battler 2. Wikipedia (JA) — バーコードバトラー (exhaustive Japanese entry) — https://ja.wikipedia.org/wiki/バーコードバトラー 3. Time Extension — 'Barcode Battler: The Early 90s Classic That's So Crap It's Almost Cool' (Damien McFerran, 2025) — https://www.timeextension.com/features/best-of-2025-barcode-battler-the-early-90s-classic-thats-so-crap-its-almost-cool 4. Retro Handhelds — 'Game Over: The History of Barcode Gaming' (Jim Gray, 2025) — https://retrohandhelds.gg/game-over-the-history-of-barcode-gaming/ 5. Museum of Design in Plastics — Barcode Battler catalog entry with 10 photographs — https://www.modip.ac.uk/artefact/aibdc-004391 6. SUPERJUMP Magazine — 'Once Upon a Time, Grocery Barcodes Unlocked an RPG World' (C.S. Voll, 2025) — https://www.superjumpmagazine.com/once-upon-a-time-grocery-barcodes-unlocked-an-rpg-world/ 7. Eurogamer — 'Not even Mario and Zelda could make the Barcode Battler any good' (Jennifer Allen, 2019) — https://www.eurogamer.net/not-even-mario-and-zelda-could-make-the-barcode-battler-any-good 8. The Independent — 'Teachers swipe at bar code game' (1993 UK press coverage) — https://www.independent.co.uk/news/uk/teachers-swipe-at-bar-code-game-parents-could-face-intolerable-pressure-from-children-to-buy-goods-linked-to-a-computer-game-rhys-williams-reports-2320951.html 9. Combat King's Barcode Battler Museum (fan site) — https://barcodebattler.co.uk/ 10. Barcode Battler Cards Database (fan site) — https://cards.bimbiribase.xyz/ --- ## Talking Glove / The TalkingGlove (1988–1991) **By:** James F. Kramer and Prof. Larry Leifer, Center for Design Research, Stanford University **Tags:** `HCI` `Wearable` `Accessibility` `Gesture Recognition` `Speech Synthesis` ### Overview The Talking Glove was a self-contained, portable communication system that translated American Sign Language fingerspelling into synthetic speech in real time. Developed by James Kramer under Prof. Larry Leifer at Stanford's Center for Design Research, the system used an instrumented glove with 14 custom strain-gauge flex sensors sewn into pockets over each finger joint. A Motorola 68HC11 microcontroller sampled joint-angle data and fed it to a host computer running Kramer's 'beacon' recognition algorithm, which matched hand configurations to letters in a 14-dimensional hand-state space. When the user formed a special 'say it' handshape, a DECtalk speech synthesizer spoke the assembled word through a miniature pendant speaker worn under the shirt. The glove communicated bidirectionally: an infrared-linked pocket keyboard let hearing interlocutors type replies, which appeared on a Seiko LCD wrist display for sighted deaf users or on a refreshable mechanical braille display for deaf-blind users. An optional IntroVoice speech recognition system allowed hearing people to speak responses in structured environments. Kramer's strain-gauge sensor design was a key technical advance — unlike the VPL DataGlove's nonlinear fiber-optic sensors, these produced linear output proportional to bend angle regardless of bend radius, making them far more reliable for precise gesture recognition. The Talking Glove's commercial legacy is extraordinary. Kramer founded Virtual Technologies, Inc. in 1990 to commercialize the technology as the CyberGlove, which became the dominant hand-input device for VR research and industrial simulation for over two decades. Virtual Technologies was acquired by Immersion Corporation in 2000 for its haptic patent portfolio — patents that Immersion later leveraged in multimillion-dollar settlements with Microsoft and Sony over game controller vibration technology. The finger-joint strain-gauge sensor design lives on in CyberGlove Systems' products today. ### Deep dive * **Origins.** The problem was stark: deaf, deaf-blind, and non-vocal individuals faced profound communication barriers in everyday face-to-face situations. Interpreters were expensive, notewriting was awkward while standing, and TDD devices were impractical for spontaneous interaction in stores or restaurants. James Kramer, a 1988 Hertz Fellow pursuing his PhD in Electrical Engineering, undertook the project under Prof. Larry Leifer at Stanford's Center for Design Research. The work connected to the broader efforts of Stanford's Rehabilitation R&D Center at the Palo Alto VA Hospital, which had also developed 'Ralph' — a computer-controlled electromechanical hand that could fingerspell into a deaf-blind person's palm. While Ralph was the *output* side, the Talking Glove was the *input* side. Together they formed a complete expressive/receptive communication system. The Stanford Daily covered the project as early as November 1988. * **How It Worked.** The glove used 14 strain-gauge flex sensors — each comprising two 120-ohm Constantan foil gauges mounted back-to-back on a 1-mil polyimide backing — sewn into guiding pockets over each major finger joint. The back-to-back mounting provided temperature compensation and doubled the signal. A multiplexed Wheatstone bridge circuit, an AD7506 analog multiplexer, and an AD624 instrumentation amplifier conditioned the signals before digitization. The digitized values defined a 14-dimensional hand-state vector. Kramer's 'beacon' recognition algorithm placed stored 'beacon' points for each letter in this 14-dimensional space. When hand-state velocity dropped (indicating a held handshape), the algorithm found the nearest beacon using an optimized least-squares search — prioritizing previously-close beacons and terminating distance calculations early. A 'recognition ball' (inner hypersphere) triggered letter registration; a larger 'hysteresis ball' prevented accidental repeat recognition. After each word was spoken, beacon positions adapted to the user's signing signature. The system ran on a Motorola 68HC11 microcontroller with a DECtalk speech synthesizer, achieving practical fingerspelling speeds. * **Commercial Path.** Kramer founded Virtual Technologies, Inc. in 1990 to commercialize the instrumented glove as the CyberGlove — an 18- or 22-sensor device paired with VirtualHand software. In 1995, VTi released GesturePlus, a $3,500 fingerspelling recognition package. The 1997 CyberGrasp force-feedback glove and CyberSuit full-body mocap suit followed. Immersion Corporation acquired Virtual Technologies in 2000 for approximately $1 million, obtaining a haptic patent portfolio that generated multimillion-dollar settlements from Microsoft (2003) and Sony (2007) over game controller vibration. Immersion divested the CyberGlove business in 2009, creating CyberGlove Systems LLC, which continues to sell the products today. * **Legacy.** The Talking Glove pioneered multiple fields simultaneously: it was the first practical fingerspelling-to-speech translator for deaf communication, one of the earliest integrated wearable computer systems (combining sensors, microcontrollers, wireless communication, speech synthesis, LCD, braille, and voice recognition in a body-worn form factor), and the origin of the CyberGlove's strain-gauge sensor technology that dominated VR hand input for decades. US Patent 5,047,952 (filed 1988, granted 1991) has been cited by hundreds of subsequent patents in wearable computing and gesture recognition. ### Team * **James F. Kramer.** Lead inventor, PhD student, Hertz Fellow. Founder of Virtual Technologies, Inc. * **Prof. Larry Leifer.** Doctoral advisor. Founding director of Stanford Center for Design Research * **Peter Lindener.** Co-inventor on US Patent 5,047,952 * **William R. George.** Co-inventor on US Patent 5,047,952 * **David L. Jaffe.** Investigator at Stanford RR&D Center; worked on complementary 'Ralph' fingerspelling hand ### Media ![Patent drawing: Talking Glove system block diagram](../assets/wiki/kramers-talking-glove-1.png) *System block diagram from US Patent 5,047,952, showing the glove, microcontroller, and speech synthesis chain. Source: US Patent and Trademark Office.* ![Patent drawing: people using the Talking Glove](../assets/wiki/kramers-talking-glove-2.png) *Usage scenarios from the patent: a deaf user signing into the glove while a hearing interlocutor uses the infrared keyboard. Source: US Patent and Trademark Office.* ### Sources 1. US Patent 5,047,952 — Communication System for Deaf, Deaf-Blind, or Non-Vocal Individuals — https://patents.google.com/patent/US5047952A/en 2. Stanford RR&D Center — Kramer's Talking Glove Project Page — http://web.stanford.edu/group/rrd/TTran/glove.html 3. Kramer & Leifer, 'The Talking Glove,' ACM SIGCAPH Computers and the Physically Handicapped, Issue 43, 1989 — https://doi.org/10.1145/47937.47938 4. Wired Magazine — 'Gropethink,' interview with James Kramer, October 1998 — https://www.wired.com/1998/10/kramer/ 5. Sturman & Zeltzer, 'A Survey of Glove-Based Input,' IEEE CG&A, 1994 — http://www.cs.columbia.edu/~feiner/courses/mobwear/resources/A%20Survey%20of%20glove%20based%20input.pdf 6. CyberGlove Systems LLC — About Us — http://www.cyberglovesystems.com/about-us 7. Hertz Foundation — James Kramer Fellow Profile — https://www.hertzfoundation.org/person/james-kramer/ --- ## Performance-Driven Facial Animation (1990) **By:** Lance J. Williams, Apple Computer Advanced Technology Group **Tags:** `HCI` `Input` `Facial Tracking` `Computer Vision` `Performance Capture` `Animation` ### Overview Lance Williams' 'Performance-Driven Facial Animation,' presented at SIGGRAPH 1990 in Dallas, introduced the concept of the 'electronic mask': a live human actor whose facial expressions are captured in real time and used to drive a computer-generated 3D face. The system combined two novel subsystems: a photorealistic CG head model built by laser-scanning a human subject with a Cyberware 4020/RGB 3D color scanner and projecting photographic textures onto the geometry, and a real-time vision-based tracking system that captured the 3D positions of small retroreflective markers placed on a performer's face. The tracking system illuminated the actor's face, captured bright reflections from the retroreflective dots via one or more cameras, computed their 3D centroids in real time, and used the displacement data to deform the CG face model. Williams explicitly framed this as a solution to the 'performance problem' — the fact that physical simulation of muscles and skin could produce realistic deformations but failed to capture the nuanced timing and emotional expressiveness of an actual human performance. The paper cited early facial modeling work by Parke (1974), Badler & Platt (1981), and Waters (1987), but was the first to close the loop: a real face as real-time controller. This single-author paper, produced during Williams' tenure at Apple's Advanced Technology Group (1987–1993), is recognized as the foundational work of facial performance capture. Its influence extends through Disney's Gemini Man project (where Williams served as technical architect), modern film VFX (Avatar, Benjamin Button), and ultimately to consumer-grade facial tracking in Apple's ARKit. The Wikipedia article on 'Facial motion capture' opens its history section by citing this as 'one of the first papers discussing performance-driven animation.' ### Deep dive * **Origins.** Lance Williams came from the pioneering University of Utah computer graphics program (studying under Ivan Sutherland and David Evans) and the NYIT Computer Graphics Lab, where he invented mipmapping (1983) and shadow mapping (1978). His consulting work for Jim Henson Associates exposed him to puppetry and real-time performance, likely inspiring the 'electronic mask' concept. At Apple ATG, he had access to the Cyberware 3D scanner and the vision-tracking hardware needed to realize the system. Williams framed the motivation precisely: 'The gestures and expressions of a human actor are not the solution to a dynamic system' — a human performance cannot be generated by physics equations alone; it must be captured from a real person. * **How It Worked.** The system had two pipelines. First, model creation: a Cyberware 4020/RGB 3D color scanner laser-scanned a human subject's head to produce a dense polygonal mesh with per-vertex color. Photographs of the subject were projected onto the geometry as texture maps for photorealistic skin detail. The tracking pipeline used retroreflective markers — small dots that reflect light directly back to its source — placed at key facial feature points. A vision system with controlled illumination captured the dots as bright spots against a dark background. Software detected the centroid of each dot in the camera image, computed 3D positions via triangulation, and mapped the sparse dot positions into smooth full-face deformations using scattered data interpolation. The entire pipeline ran at interactive frame rates — a radical departure from the laborious keyframing that dominated facial animation at the time. * **Impact.** Williams' paper established the paradigm that drives all modern facial performance capture. He later served as Chief Scientist at Walt Disney Animation Studios and technical architect on Disney's Human Face Project (the Gemini Man test), which directly extended his 1990 work. He received a 2001 Technical Academy Award for 'pioneering influence in the field of computer-generated animation and effects for motion pictures.' The 2006 SIGGRAPH Course on 'Performance-Driven Facial Animation' and a 2023 Springer survey on facial capture for digital humans both trace their lineage to this work. From marker-based optical capture to head-mounted camera rigs to Apple's TrueDepth camera and ARKit face tracking — all descend from the concept Williams demonstrated in 1990. * **Legacy.** Beyond the technical contribution, the paper's philosophical stance was influential: that computer animation should preserve and transmit human performance rather than replace it. Williams wrote that the 'electronic mask offers a means for the traditional talents of actors to be flexibly incorporated in digital animations.' Lance Williams died in 2017, having shaped computer graphics through mipmapping, shadow mapping, view interpolation, and this foundational work on performance-driven facial animation. ### Team * **Lance J. Williams (1949–2017).** Sole author. Researcher at Apple ATG, previously NYIT Computer Graphics Lab. Inventor of mipmapping and shadow mapping. Later Chief Scientist at Walt Disney Animation Studios. 2001 ACM SIGGRAPH Coons Award, 2002 Academy Award for Technical Achievement. ### Media ![SIGGRAPH 1990 paper title page showing facial tracking concept](../assets/wiki/williams-facial-animation-1.jpg) *Title page of Williams' SIGGRAPH 1990 paper, showing the retroreflective marker concept. Source: ACM SIGGRAPH History Archive.* ### Sources 1. Williams, L. 'Performance-Driven Facial Animation,' ACM SIGGRAPH Computer Graphics, Vol. 24, No. 4, pp. 235–242, August 1990 — https://doi.org/10.1145/97880.97906 2. SIGGRAPH History Archive — Performance-Driven Facial Animation by Williams — https://history.siggraph.org/learning/performance-driven-facial-animation-by-williams/ 3. Wikipedia — Lance Williams (graphics researcher) — https://en.wikipedia.org/wiki/Lance_Williams_(graphics_researcher) 4. Wikipedia — Facial Motion Capture (cites Williams 1990 as foundational) — https://en.wikipedia.org/wiki/Facial_motion_capture 5. Cartoon Brew — The Secret History of Disney's Gemini Man (confirms Williams as technical architect) — https://www.cartoonbrew.com/feature-film/secret-history-disneys-gemini-man-quest-make-convincing-cg-human-152149.html 6. University of Utah obituary for Lance Williams — https://www.price.utah.edu/2017/08/30/celebrated-u-computer-graphics-researcher-dies 7. Macworld — Williams' 2002 Academy Award coverage — https://www.macworld.com/article/153032/scitechawards.html --- ## Convolvotron (1988) **By:** Crystal River Engineering (Scott Foster), under contract from NASA Ames Research Center VIEW lab **Tags:** `HCI` `Audio` `Spatial Audio` `VR` `NASA` ### Overview The Convolvotron was the first system capable of real-time binaural spatialization of multiple independent sound sources — that is, making sounds appear to come from precise locations in 3D space through standard stereo headphones. Developed by Scott Foster under a NASA contract for the VIEW (Virtual Interface Environment Workstation) lab at NASA Ames Research Center, the first prototype was delivered in 1988. Crystal River Engineering (CRE) was incorporated in 1989 as a commercial spin-off, offering the Convolvotron as a two-board set for IBM PC compatibles priced at $14,995. The system's core innovation was a custom massively-parallel ALU convolution engine — each board carried 128 16×16 ALUs capable of 320 million multiply-accumulate-shift operations per second, integrated with a Texas Instruments TMS320C25 digital signal processor. Up to eight boardsets could run in parallel, spatializing 32 anechoic sound sources or 8 sources with first-order wall reflections. The system performed real-time convolution of dry audio signals with head-related transfer functions (HRTFs) measured from human subjects. As the listener moved their head (tracked by a Polhemus magnetic sensor), the Convolvotron re-convolved each virtual sound source through the appropriate binaural HRTF pair, creating the illusion that sounds remained fixed in space regardless of head movement. At SIGGRAPH 1991, the system was demonstrated combined with a Fake Space Labs BOOM viewer and SGI workstation, letting a user act as 'architect' of a virtual concert hall — moving walls, placing virtual instruments, and hearing the acoustic consequences in real time. The echoic room model was good enough that blind test subjects could navigate virtual spaces by sound alone. The Convolvotron spawned a product family (Acoustetron, Beachtron, Alphatron) and was used in landmark VR artworks including Brenda Laurel's *Placeholder* (1993, using 4 Convolvotrons for 16 simultaneous spatial sound sources) and Char Davies' *Osmose* (1995). CRE was acquired by Aureal Semiconductor in 1996; its technology was distilled into the A3D consumer 3D audio API. Aureal went bankrupt in 2000 and its assets were acquired by Creative Technology. ### Deep dive * **Origins.** The Convolvotron was born inside NASA Ames' VIEW lab, directed by Dr. Scott Fisher. VIEW aimed to build a complete immersive virtual environment for astronaut training. The visual component was the head-mounted display (which became the VPL EyePhone). The audio component — the part that would make the virtual world sound real — was contracted to engineer Scott Foster. Foster built a custom digital signal processing architecture specifically for real-time HRTF convolution, something that had never been done outside of slow, non-interactive laboratory experiments. The first prototype was delivered to NASA in 1988. * **How It Worked.** The interaction pipeline: (1) A person wore stereo headphones with a Polhemus magnetic head-tracker attached. (2) Dry (anechoic) audio sources were prepared for up to four independent virtual sound sources. (3) As the person moved their head, the Convolvotron received head-orientation data from the host computer and selected the appropriate binaural HRTF pair for each source's spatial position relative to the listener's current head orientation. (4) The custom ALU convolution engine performed real-time convolution of each dry source signal with the selected HRTFs — essentially applying a pair of very long FIR filters (one per ear) that encoded all the subtle frequency-dependent filtering, interaural time differences, and interaural level differences that the human auditory system uses to localize sound. (5) The resulting binaural signal was output to the headphones, creating an 'externalized' 3D sound image where virtual sources appeared to exist at specific locations outside the head. The system achieved source position updates at >30 Hz for smooth, artifact-free motion. * **Why It Matters to HCI.** The Convolvotron established that spatial audio could be a bidirectional interaction channel, not passive output. The user's head movement was the input; the changing sound field was the output. This made auditory space something you could move through and interact with, not just listen to. The system demonstrated that spatial audio could replace visual displays for certain navigation tasks (blind subjects successfully navigated virtual spaces). It proved that multiple simultaneous sound streams could be segregated and attended to when spatialized. It pioneered 'interactive auralization' — designing architectural acoustics through real-time auditory feedback — a paradigm that prefigured all modern acoustic simulation tools. Critically, the Convolvotron established the core technical architecture that remains standard in VR spatial audio today: HRTF-based convolution, real-time interpolation between measured HRTF positions, head-tracker coupling, and the separation of anechoic source rendering from environmental reflection modeling. ### Team * **Scott Foster.** Founder of Crystal River Engineering, hardware architect of the Convolvotron. Built the custom parallel ALU convolution engine. * **Dr. Elizabeth M. Wenzel.** NASA Ames Auditory Perception Lab. Led HRTF measurement and psychoacoustics research. Co-author of the foundational 1990 paper 'Real-time digital synthesis of virtual acoustic environments.' * **Dr. Scott Fisher.** Director of NASA VIEW lab. Conceived the immersive VR system the Convolvotron was built for. Also co-founded Telepresence Research. * **William Chapin.** Chief Engineer at CRE (1996–1997). Later founded AuSIM in 1998 to continue serving high-end simulation markets after Aureal dissolved CRE. ### Media ![SIGGRAPH 1991 Immersive Pavilion — Convolvotron demo with BOOM viewer and SGI workstation](../assets/wiki/convolvotron-1.jpg) *SIGGRAPH 1991 Immersive Pavilion: 'Virtual Acoustic Environments — The Convolvotron' by Elizabeth Wenzel and Scott Foster. The demo combined a Crystal River Engineering Convolvotron with a Fake Space Labs BOOM viewer and Silicon Graphics workstation. Source: ACM SIGGRAPH History Archives.* ### Sources 1. SIGGRAPH History Archive — Virtual Acoustic Environments: The Convolvotron — https://history.siggraph.org/experience/virtual-acoustic-environments-the-convolvotron-by-wenzel/ 2. NASA Spinoff 1992 — 3D Audio System — https://spinoff.nasa.gov/node/8965 3. Wikipedia — Crystal River Engineering — https://en.wikipedia.org/wiki/Crystal_River_Engineering 4. Stanford CDR — Convolvotron Hardware Description — http://www-cdr.stanford.edu/DesignSpace/sponsors/Convolvotron.html 5. AuSIM — Company Origins (CRE history) — http://www.ausim3d.com/about/origins.html 6. Wenzel & Foster (1990) — Real-time digital synthesis of virtual acoustic environments — https://doi.org/10.1145/91394.91431 7. Brenda Laurel — Placeholder Project Notes (Convolvotron usage) — https://www.tauzero.com/Placeholder/Hypertext/Crystal_River/Convolvotron_1.html 8. Wenzel (1992) — 'Three-dimensional virtual acoustic displays' (book chapter in 'Virtual Reality: Theory, Practice, and Promise') — https://ntrs.nasa.gov/citations/19920004500 --- ## HeadMaster (1986) **By:** Personics Corporation (Concord, MA), later Prentke Romich Company (Wooster, OH) **Tags:** `HCI` `Accessibility` `Head Tracking` `Ultrasonic` `Cursor Control` ### Overview The HeadMaster was a head-operated cursor control system that translated rotational head movement into cursor movement on a computer display. It consisted of a lightweight (3 oz / ~85g) headset worn over the head, holding three 40 kHz ultrasonic receivers (piezoelectric transducers). A small control unit (approximately 5.5 × 5.13 × 1.5 inches, 5 lbs) sat on top of the computer monitor and housed the ultrasonic transmitter. The headset connected by wire to the control unit, which plugged into the computer's mouse port (Macintosh ADB, Apple II, or IBM serial/PS2). A sip-and-puff mouth switch — a thin tube the user puffed into — functioned as the mouse button. The system was invented by Keith K. Davison, who filed US Patent 4,682,159 on June 20, 1984 (granted July 21, 1987), originally assigned to Personics Corporation of Concord, Massachusetts. Personics shipped the first HeadMaster units in April 1986, priced at $795 for Apple Macintosh. The patent and technology were acquired by the Prentke Romich Company (PRC) of Wooster, Ohio in 1989, which continued development through the 'HeadMaster Plus' and eventually a wireless 'HeadMaster 2000' version demonstrated at CSUN 1999. The interaction was purely rotational: yaw (turning the head left/right) controlled horizontal cursor movement, pitch (nodding up/down) controlled vertical movement. Translational head movements (leaning toward or away from the screen) were ignored by design. The system used phase-comparison circuitry built from discrete JK flip-flops to produce signed (direction + magnitude) position signals — a notably elegant analog solution predating microcontrollers. The 40 kHz wave was sampled at 1,000 times per second with a 4 MHz time base, achieving phase measurement resolution of 100 counts per wavelength cycle, translating to approximately 300 parts per inch of spatial resolution. The included ScreenTyper software placed an on-screen keyboard strip (~1 inch tall) at the bottom or top of the Macintosh screen with characters arranged by frequency of use — not QWERTY — to minimize the head movement needed for typing. ### Deep dive * **Origins.** The HeadMaster emerged at a pivotal moment in personal computing: the Macintosh had introduced the graphical user interface to consumers in 1984, but the mouse — the primary input device for GUIs — required hand and arm control. For people with quadriplegia, ALS, cerebral palsy, spinal cord injuries, and other motor impairments, the mouse was a barrier. Personics Corporation, a small Massachusetts company, set out to solve this by making the head itself the pointing device. The patent application, filed in June 1984, explicitly critiques the then-available alternatives: 'manipulating the mouse is difficult, and it often takes several hours to fully master' and 'the constant shifting required between the mouse and the keyboard makes mice virtually useless for word processing and accounting spread sheets.' The HeadMaster's pitch was different: it required no hands at all, used 'a natural and ordinary human movement,' and the person's hands never needed to leave the keyboard. * **Interaction Model.** The HeadMaster used relative (not absolute) head positioning — like a mouse, not like a touchscreen. You didn't need to sit perfectly centered. The software included a velocity-based gain: fast head movements produced proportionally larger cursor jumps; slow movements gave fine pixel-level control. A hysteresis dead zone suppressed cursor jitter from natural head tremor — you could breathe and blink without the cursor vibrating. The sip-and-puff switch provided a clean, discrete click without requiring any limb movement. For text entry, the ScreenTyper on-screen keyboard showed characters arranged by frequency (space and 'e' nearest the center), dynamically shifting the keyboard strip between top and bottom of the screen so the user could see context. The promotional brochure's headline was blunt and brilliant: 'If you can move your head, you can move your world.' * **Legacy and Museum Significance.** The HeadMaster survived as a product line for approximately 20 years — remarkable longevity for specialized HCI hardware. It is held in two major museum collections: the Smithsonian National Museum of American History (catalog #NMAH_1297824, part of the 'Input Devices and Controllers' collection) and the Computer History Museum (catalog #102662701, gift of Lon Safko). In the first rigorous three-way head-pointer comparison study (Angelo et al., 1991), the HeadMaster and the Trace Center's Long-Range Optical Pointer tied for top performance, both significantly outperforming the FreeWheel infrared reflective system. PRC merged with Saltillo in 2019 to become PRC-Saltillo; the HeadMaster line appears to have been discontinued sometime after the 2000s, superseded by camera-based head tracking and eye-gaze systems. But its core insight — that embodied head movement, not hands, could drive the graphical interface — remains a foundational concept in accessibility HCI and anticipatory design. ### Team * **Keith K. Davison.** Inventor. Filed US Patent 4,682,159 in 1984 for Personics Corporation. Designed the ultrasonic phase-comparison tracking system. * **Personics Corporation.** Concord, Massachusetts. Originally developed and marketed the HeadMaster starting in 1986. (Distinct from the Personics music-recording company of Menlo Park, CA.) * **Prentke Romich Company (PRC).** Wooster, Ohio. Acquired the patent and technology in 1989. Barry Romich (co-founder/president), David Hershberger, and Lamar Schlabach led continued development into HeadMaster Plus and HeadMaster 2000. * **Lon Safko.** Donated the HeadMaster unit to the Computer History Museum. Author and assistive technology advocate. ### Media ![US Patent 4,682,159 Figure 1 — HeadMaster system overview: operator wearing headset facing CRT with transmitter on top](../assets/wiki/headmaster-1.png) *US Patent 4,682,159 (Davison / Personics Corp, 1984) Figure 1: System overview showing operator wearing the three-receiver headset facing a CRT display with ultrasonic transmitter mounted on top. The circuitry box connects headset, transmitter, and computer. Source: Google Patents/USPTO.* ![US Patent 4,682,159 Figure 2 — Headset receiver placement: left and right receivers along horizontal line near ears, top receiver centered above](../assets/wiki/headmaster-2.png) *US Patent 4,682,159 Figure 2: Headset receiver placement. Left and right receivers lie along a horizontal line at ear level; the top receiver sits centered above them, off the horizontal line. This three-point geometry isolates horizontal and vertical rotation components. Source: Google Patents/USPTO.* ### Sources 1. US Patent 4,682,159 — 'Apparatus and method for controlling a cursor on a computer display' (Davison / Personics Corp) — https://patents.google.com/patent/US4682159A/en 2. Smithsonian National Museum of American History — HeadMaster collection entry — https://americanhistory.si.edu/collections/object/nmah_1297824 3. Computer History Museum — HeadMaster catalog entry — https://www.computerhistory.org/collections/catalog/102662701 4. Personics promotional brochure — 'Introducing HeadMaster' (1986) — https://docslib.org/doc/4664137/introducing-headmaster 5. Prentke Romich — HeadMaster Plus Manual (full PDF) — https://file.prentrom.com/122/HeadMaster-Plus-Manual.pdf 6. Angelo, Deterding & Weisman (1991) — Three-system head-pointer comparison study (HeadMaster, FreeWheel, LROP) — https://pubmed.ncbi.nlm.nih.gov/10147558/ 7. Open Assistive — Ultrasonic Head Tracker Mouse rebuild project with photos — https://openassistive.org/item/ultrasonicheadtrackermouse-zy9/ 8. RESNA 2003 — Head pointer technology comparison survey — https://www.resna.org/sites/default/files/legacy/conference/proceedings/2003/Papers/ComputerAccess/Anson_CA_Headpointers.htm --- ## VPL DataSuit (1989) **By:** VPL Research (Redwood City, California) — Jaron Lanier, Ann Lasko-Harvill, Young Harvill, Thomas Zimmerman **Tags:** `HCI` `VR` `Wearable` `Motion Capture` `Full-Body` ### Overview The VPL DataSuit was a full-body Lycra/spandex outfit instrumented with the same fiber-optic bend sensor technology used in VPL's DataGlove. First described in the 1988 IEEE Compcon paper 'From DataGlove to DataSuit,' the suit contained 30+ joint sensors measuring bending along arms, legs, and trunk. Each sensor operated on the principle of optical attenuation: a light source sent illumination through a length of optical fiber with a treated section that leaked light when flexed; a photodetector measured the output, producing an analog signal proportional to joint angle (covered by US Patents 4,542,291 and 4,937,444). Signals were digitized by 6502 microcontrollers — the same architecture as the DataGlove — and transmitted (tethered) to a host computer, typically a Silicon Graphics IRIS workstation. The DataSuit was not sold as a standalone consumer product. It was part of VPL's complete 'Reality Built for Two' (RB2) multi-user VR system, which combined the DataSuit (full-body input), EyePhone HMD (stereoscopic display), DataGlove (hand input), and AudioSphere (spatial audio). VPL's 'Body Electric' visual programming language interpreted body posture data, and the 'Isaac' rendering engine displayed a real-time 3D avatar in the virtual environment. The complete system cost upwards of $250,000. The DataSuit was featured in VPL's showroom demonstrations and trade shows (including the Nissho Iwai showroom in Tokyo), was used by the U.S. Olympic Committee for sports performance analysis, and gained mass cultural visibility through its appearance in the 1992 science fiction film *The Lawnmower Man*. VPL filed for bankruptcy in 1990; its patents were sold to Thomson-CSF in 1992 and subsequently acquired by Sun Microsystems in 1998. Though commercially unsuccessful, the DataSuit established the conceptual template for every full-body tracking system that followed — from motion capture in film production to contemporary VR bodysuits. ### Deep dive * **Origins at VPL Research.** VPL Research was founded by Jaron Lanier in 1984 in Redwood City, California. 'VPL' stood for 'Virtual Programming Languages' — a reference to Lanier's concept of 'post-symbolic communication,' the idea that body movement itself could become a programming language. The DataGlove (invented by Thomas Zimmerman) was the first step — a single-hand fiber-optic gesture input device. The DataSuit was the logical extension: if one hand could communicate with the machine, why not the whole body? Ann Lasko-Harvill joined as Chief Designer of Data Suits, bringing expertise in tailoring and ergonomics. She created suits sized for different body types — male and female anthropometrics — which was unusual attention to bodily diversity in 1980s tech hardware. The 1988 IEEE paper 'From DataGlove to DataSuit' by Blanchard, Harvill, and colleagues formally introduced the concept. * **Interaction Model.** The interaction pipeline was: (1) Performer wears the DataSuit — a tight Lycra outfit with fiber-optic sensors at each major joint. (2) As the performer moves, joints bend, causing optical fibers to attenuate light proportionally. (3) 6502 microcontrollers digitize the analog bend signals from all 30+ sensors. (4) VPL's Body Electric visual programming language on a host workstation interprets the full-body posture data. (5) The Isaac rendering engine displays a real-time 3D avatar mirroring the performer's body in the virtual environment. (6) In the RB2 system, two performers in separate DataSuits could interact in the same virtual space — the first multi-user full-body VR experience. The experience was immersive in the original sense: you saw your virtual body move as your physical body moved, creating a powerful sense of presence despite the tether and the limited frame rate. * **Cultural Impact and The Lawnmower Man.** Brett Leonard's 1992 film *The Lawnmower Man* used the VPL DataSuit and EyePhone as key visual elements in its depiction of a gardener who enters a virtual world through a full-body VR rig. The film was a commercial success, grossing $32 million against a $10 million budget, and it introduced the concept of full-body immersive VR to mainstream audiences. While the film's depiction of VR as a consciousness-altering technology was science fiction, the hardware shown was real. For millions of viewers, the DataSuit *was* virtual reality — a sleek black bodysuit with cables, sensors, and the promise of total sensory immersion. This cultural visibility, combined with the DataGlove's licensing to Mattel for the Power Glove (1989), made VPL Research the public face of VR's first wave. ### Team * **Jaron Lanier.** Founder of VPL Research. Coined the phrase 'Virtual Reality.' Conceived of post-symbolic communication via full-body interfaces. * **Ann Lasko-Harvill.** Chief Designer of Data Suits. Responsible for tailoring, ergonomics, and anthropometric fit across body types. Described as 'A Hero Behind the VR Headset' (proto.life, 2021). * **Young Harvill.** VP of Engineering, fourth employee at VPL (joined 1985). Worked on DataGlove and RB2 integration. Creator of Swivel 3D software. * **Thomas G. Zimmerman.** Co-founder. Invented the DataGlove prototype and the foundational fiber-optic bend sensor technology used in both DataGlove and DataSuit. * **Chuck Blanchard.** Created Body Electric visual programming language. Co-author of the 1988 'From DataGlove to DataSuit' paper. * **Jean-Jacques Grimaud.** Co-founder and President. ### Media ![VPL DataSuit on display at Nissho Iwai showroom, Tokyo — full-body Lycra suit with fiber-optic sensors visible along arms and legs](../assets/wiki/vpl-datasuit-1.jpg) *VPL Research DataSuit, circa 1989, displayed at the Nissho Iwai showroom in Tokyo. The suit contains 30+ fiber-optic bend sensors measuring joint angles along arms, legs, and trunk. Photo by Dave Pape (1999), public domain. Source: Wikimedia Commons.* ### Sources 1. Wikipedia — VPL Research — https://en.wikipedia.org/wiki/VPL_Research 2. Blanchard, Harvill et al. (1988) — 'From DataGlove to DataSuit' (IEEE Compcon) — https://doi.org/10.1109/cmpcon.1988.4925 3. proto.life (2021) — 'A Hero Behind the VR Headset' (profile of Ann Lasko-Harvill) — https://proto.life/2021/09/a-hero-behind-the-vr-headset/ 4. US Patent 4,937,444 — 'Optical flex sensor' (VPL Research) — https://patents.google.com/patent/US4937444A/en 5. Wired (1998) — 'Sun Snaps Up Original VR Patents' — https://www.wired.com/1998/02/sun-snaps-up-original-vr-patents/ 6. Wikimedia Commons — VPL DataSuit photo by Dave Pape (public domain, 1999) — https://commons.wikimedia.org/wiki/File:VPL_DataSuit_1.jpg 7. SIGGRAPH 94 Course Notes — David Sturman, 'A Brief History of Motion Capture for Computer Character Animation' — https://dl.acm.org/doi/10.1145/192161.192243 --- ## Minsky Sandpaper / Computational Haptics Sandpaper System (1990) **By:** Margaret Minsky at MIT Media Lab, with collaborators at UNC Chapel Hill (Frederick P. Brooks Jr., Ming Ouh-young, Oliver Steele, Michael Behensky) **Tags:** `HCI` `Haptics` `Force Feedback` `Texture Synthesis` `MIT Media Lab` `VR` ### Overview The Minsky Sandpaper system (formally 'Computational Haptics: the Sandpaper System for Synthesizing Texture for a Force-Feedback Display') was developed by Margaret Minsky at the MIT Media Lab beginning in the late 1980s, with the foundational paper presented at SIGGRAPH 1990. It consisted of a custom-built 2-DOF force-feedback joystick coupled with software that could algorithmically synthesize the feel of virtual surface textures — sandpaper, rubber, velvet, corduroy, and brushed metal — by modulating lateral (tangential) forces in real time as the user moved the joystick. The core innovation was the lateral-force algorithm: rather than attempting to physically reproduce surface microgeometry with vibrating pins or vertical actuators, Minsky treated texture as a programmable force field computed from a height-field representation. This insight — that convincing haptic textures could be rendered entirely through in-plane forces at ~1 kHz servo rates — marked the birth of computational haptics as a research field. The physical device was an integrated assembly of two DC servo motors mounted at right angles within a wooden-and-metal box, driving a joystick through direct-drive linkages. Optical encoders provided position sensing; the motors operated in current-drive mode for proportional torque. A custom ISA-bus interface board connected to a Sun workstation or early PC. Users could explore an entire palette of virtual materials — fine and coarse sandpaper, rubber (damping-dominant), corduroy (oriented ridges), velvet (directional friction anisotropy), and brushed metal (directional striations) — with texture changes occurring instantaneously, as there were no physical texture plates to swap. Minsky, collaborating with psychologist Susan Lederman, conducted perceptual studies validating that users could reliably distinguish synthesized textures and that perceived roughness matched real-world psychophysical data. The SIGGRAPH 1990 paper 'Feeling and Seeing: Issues in Force Display' (with co-authors Ouh-young, Steele, Brooks, and Behensky) has accumulated over 880 citations. Minsky's 1995 doctoral thesis remains available through MIT DSpace and is widely cited as foundational in the haptics literature. ### Deep dive * **How Virtual Texture Was Synthesized.** The Sandpaper system modeled each virtual surface as a 2D height field h(x,y), typically a 32×32 to 128×128 array. At each servo cycle (~1 kHz), the system sampled the joystick position, interpolated the local gradient of the height field, and computed restoring forces: F_x = −k_x · ∂h/∂x and F_y = −k_y · ∂h/∂y. Different textures were produced by varying the spatial frequency content of h(x,y): fine sandpaper used high-frequency filtered noise, corduroy used oriented ridges, and rubber used low-frequency damping. An optional velocity-dependent damping term (F ← F − b·v) produced the characteristic 'catch-and-release' stick-slip sensation of coarse grit. Crucially, no normal-force (vertical) actuator was needed — the brain interpreted the lateral force variations as surface roughness, a remarkable perceptual illusion that validated the entire approach. * **The Hardware: Wooden Box, DC Motors, Metal Linkages.** The joystick used two Pittman-series iron-core DC servo motors mounted at right angles, driving the handle through direct-drive linkages to minimize backlash and friction. Optical encoders on the motor shafts provided position sensing. The motors operated in current-drive mode — controlling motor current directly produced proportional torque, which translated to force at the handle. A custom ISA-bus interface card read encoder positions and commanded motor currents. All texture computation ran on the host CPU (a Sun workstation or early PC). Two generations of hardware were built: the original force-feedback joystick (1984–89) and a smaller 'pingpong joystick' interface for later experiments. The system required only 2 DOF (planar motion) to produce convincing sensations across a wide range of virtual materials. * **Intellectual Lineage: Minsky, Media Lab, and UNC.** Margaret Minsky, daughter of AI pioneer Marvin Minsky, earned her BS in Mathematics from MIT and her PhD in Media Arts and Sciences from the MIT Media Lab (1995), advised by Nicholas Negroponte. The Sandpaper work was conducted at the Media Lab during its foundational era. Concurrently, Margaret was a Visiting Scholar at UNC Chapel Hill's Computer Science Department, collaborating with Frederick P. Brooks Jr. — the Turing Award winner behind the IBM System/360 and UNC's pioneering VR/graphics research. Brooks and his student Ming Ouh-young had developed the GROPE haptic display for molecular docking; Minsky's texture work complemented this by adding surface feel to the haptic vocabulary. The 1990 SIGGRAPH paper's author list (Minsky, Ouh-young, Steele, Brooks, Behensky) is a who's-who of early haptics and VR research. * **From PhD Thesis to Foundational Citation.** The Sandpaper system was first presented at the 1990 ACM SIGGRAPH Symposium on 3D Interactive Graphics. Minsky's 1995 PhD thesis, 'Computational Haptics: the Sandpaper System for Synthesizing Texture for a Force-Feedback Display,' remains widely cited. A 1996 follow-up paper with Susan Lederman, 'Simulated Haptic Textures: Roughness,' validated the psychophysical accuracy of the synthesized textures. Minsky later reflected on the field's trajectory in 'Will Haptics Research Parallel Computer Graphics Research?' (ICAT 1997), drawing explicit parallels between the early days of computer graphics and the nascent field of computational haptics. Her 'Home Haptics' technical report (MIT AI Lab, 1996) explored bringing texture feedback into consumer contexts — remarkably prescient given today's haptic-enabled phones, game controllers, and VR devices. ### Team * **Margaret Minsky.** Lead researcher, inventor of the lateral-force algorithm. PhD MIT Media Lab (1995). Daughter of AI pioneer Marvin Minsky. Later directed research at Atari Cambridge Laboratory and Interval Research Corporation. * **Frederick P. Brooks Jr..** Turing Award winner (1999). Led IBM System/360 development, founded UNC's VR research program. Co-author on the 1990 SIGGRAPH paper and host of Minsky as Visiting Scholar at UNC. * **Ming Ouh-young.** PhD student of Brooks at UNC Chapel Hill. Worked on the GROPE molecular docking haptic display and co-authored the 1990 SIGGRAPH paper. * **Oliver Steele.** Software collaborator and co-author on the 1990 SIGGRAPH paper. Longtime collaborator of Margaret Minsky. * **Michael Behensky.** Hardware engineering collaborator. Co-author on the 1990 SIGGRAPH paper. * **Susan Lederman.** Psychologist specializing in tactile perception. Co-author with Minsky on 'Simulated Haptic Textures: Roughness' (1996). * **Nicholas Negroponte.** Co-founder and chairman of the MIT Media Lab. Served as Minsky's doctoral advisor. ### Media ![Margaret Minsky with the force-feedback joystick, photographed by Peter Menzel](../assets/wiki/minsky-sandpaper-1.webp) *Margaret Minsky with the Sandpaper force-feedback joystick. The wooden box houses DC servo motors, optical encoders, and direct-drive linkages that rendered virtual textures through lateral forces. Photo by Peter Menzel. (mminsky.com)* ![Close-up of haptic hardware — motors, linkages, and the wooden box enclosure](../assets/wiki/minsky-sandpaper-2.webp) *Inside the Sandpaper joystick: Pittman-series DC servo motors mounted at right angles with direct-drive linkages and optical encoders for precise position sensing. (mminsky.com)* ![Force-Feedback Joystick as preserved in the King's College London research collection](../assets/wiki/minsky-sandpaper-3.jpg) *The force-feedback joystick preserved in the Margaret Minsky research collection at King's College London — one of the surviving artifacts of computational haptics' origin moment. (King's College London)* ![Margaret Minsky with the joystick, archival print of the Peter Menzel photograph](../assets/wiki/minsky-sandpaper-4.jpg) *Archival print of Peter Menzel's photograph of Margaret Minsky with the Sandpaper joystick, from the King's College London research collection. (King's College London)* ### Sources 1. Minsky, M. (1995). Computational haptics: the Sandpaper system for synthesizing texture for a force-feedback display. PhD Thesis, MIT. Advisor: Nicholas Negroponte. — https://dspace.mit.edu/handle/1721.1/29094 2. Minsky, M., Ouh-young, M., Steele, O., Brooks, F. P., & Behensky, M. (1990). Feeling and Seeing: Issues in Force Display. ACM SIGGRAPH Computer Graphics, 24(2), 235–241. (880+ citations) — https://doi.org/10.1145/91394.91451 3. Minsky, M. & Lederman, S. J. (1996). Simulated Haptic Textures: Roughness. ASME IMECE, DSC-Vol. 58. — https://doi.org/10.1115/imece1996-0365 4. Margaret Minsky — Research Page (mminsky.com) — https://mminsky.com/research.html 5. Margaret Minsky — King's College London Research Collection — https://www.kcl.ac.uk/research/margaret-minsky 6. Margaret Minsky — Exploratorium Tinkering Studio — https://www.exploratorium.edu/tinkering/tinkerers/margaret-minsky 7. Margaret R. Minsky — ACM SIGGRAPH History Archives — https://history.siggraph.org/person/margaret-r-minsky/ 8. Margaret Minsky — HKUST(GZ) Computational Media and Arts faculty profile — http://cma.hkust-gz.edu.cn/faculty-regular/margaret-minsky/ 9. Marvin Minsky obituary — MIT News (confirms Margaret Minsky as daughter) — https://news.mit.edu/2016/marvin-minsky-obituary-0125 --- ## Quantel Paintbox (1981) **By:** Quantel Ltd. (Peter Michael, Richard Taylor, Paul Kellar, Martin Holbrook) **Tags:** `Graphics HCI` `Pressure-Sensitive Stylus` `Broadcast Graphics` `Digital Painting` `Workstation` `Tablet` ### Overview The Quantel Paintbox was a dedicated broadcast television graphics workstation released in 1981 by the British company Quantel (QUANtized TELevision). Priced at $250,000 (roughly $900,000 in 2025), it was a 24-bit, true-color, real-time digital painting system built entirely in hardware — effectively a room-sized accelerated graphics card — using a Motorola 68000 CPU and hundreds of custom-programmed ICs. Its defining HCI innovation was a **patented pressure-sensitive stylus and drawing tablet**: artists could paint, airbrush, and blend colors with natural pressure control, using pop-up menus summoned by a flick of the pen. This was the first time a pressure-sensitive stylus existed for computer interaction. The Paintbox launched at the 1981 NAB Show in Las Vegas. The Weather Channel was its first U.S. customer (serial #1), replacing stick-on weather symbols with digital maps. Within five years, the Paintbox was producing virtually all on-screen television graphics globally — news graphics (NBC, ABC, CBS), weather maps (BBC, using Paintboxes controlled via Apple Lisa computers), sports overlays, title sequences, music videos, and pop-promo graphics. MTV launched the same year and its entire visual identity was built on Paintbox output. Artist Martin Holbrook worked with Quantel's engineers to design the user interface, which remained virtually unchanged for 15 years. He was the first to complain of 'Tennis Neck' from looking between screens, which led directly to the invention of pop-up menu overlays on the working display. The system required no computer knowledge: traditionally trained illustrators could sit down and paint within minutes, as demonstrated when 80-year-old Sir Hugh Casson produced a finished painting after 30 minutes of instruction. The Paintbox also had a high-resolution Graphic Paintbox variant used for print — creating album covers for Queen's 'The Miracle', Nirvana's 'Nevermind', Beastie Boys' 'Paul's Boutique', and movie posters for The Silence of the Lambs and JFK — five years before Photoshop existed. Quantel later sued Adobe for patent infringement of Paintbox features in Photoshop, losing in 1997 when Alvy Ray Smith and Richard Shoup demonstrated prior art from the 1970s SuperPaint system. Of the hundreds sold worldwide, only two original DPB-7001 series machines survive today, and roughly 22 units of all Paintbox versions are known to exist, about a dozen in working order. ### Deep dive * **The pressure-sensitive stylus — a world first.** The Paintbox's most significant HCI innovation was the pressure-sensitive stylus and tablet — something that literally did not exist before the Paintbox. Quantel's engineers developed a touch-tablet and pen rather than using a mouse, driven by the insight that artists needed to control the opacity and flow of digital paint in the same natural way they controlled physical brushes. The stylus detected pressure and translated it into variable opacity, brush size, and paint flow. Colors actually mixed on the canvas — digital paint blended with existing colors just like oil or acrylic. The tablet surface was used only as a position input; artists quickly learned to look at the screen rather than the tablet, establishing the eye-screen/hand-tablet separation that is now standard for all graphics tablets. Pop-up menus were invoked by flicking the pen, replacing the older system of physical menus printed on the tablet surface. Quantel held international patents on this pressure-sensitive stylus technology, which were later cited in their 1990s lawsuit against Adobe over Photoshop's brush tools. * **Hardware that was software — the giant accelerated graphics card.** The Paintbox was a 24-bit (8 bits per RGB channel) true-color system producing broadcast-quality PAL (DPB-7001) or NTSC (DPB-7000) video output in real time. It used a Motorola 68000 CPU and was built around hundreds of SSI logic ICs held together by custom-programmed PALs (Programmable Array Logic ICs). The only way Quantel's engineers could make a painting system fast enough to keep up with an artist's natural hand movements was to move all creative functions — brushes, paint mixing, stenciling, cut-and-paste — into dedicated hardware. The Paintbox was effectively a giant accelerated graphics card. The hard drive was a Fujitsu M2294 'Eagle' — a 14-inch Winchester drive weighing over 100 pounds that stored only 335 MB (roughly 6 seconds of uncompressed SD video). Operators had to constantly copy work onto magnetic tapes to free drive space. The original 1981 machines had a dedicated framestore, stencils and layers (added 1982), and digital font/text functions (by Pepper Howard, 1983). The second-generation V-Series (1989) replaced SSI logic with Altera CPLD and FPGA ICs, added a cordless stylus, better tablet, upgraded keyboard, and cost $80,000–$100,000. * **Revolutionary impact on TV production.** Before the Paintbox, TV graphics were produced by hand — artists drew on paper, which was then filmed and digitized. The Paintbox collapsed a two-day graphic production cycle into 15 minutes. Roger Goodman, ABC's director of production development, told The New York Times in 1984: 'It used to be that we had a staff of artists who drew and drew. But with the Paintbox an artist can come up with a graphic in 15 minutes that used to take two days.' By the mid-1980s, most graphics and visual effects on TV worldwide were created on a Paintbox. It defined the 1980s TV aesthetic: saturated colors, chrome gradients, flying logos — a look that became synonymous with the decade. Design critic Glenn Adamson noted the Paintbox's influence was simultaneous with MTV (which also launched in 1981), and that together they created the visual language of 1980s pop culture. BBC weather presenters stood in front of chroma-key screens and used clickers to advance Paintbox-created slides stored on Apple Lisa computers. NBC Nightly News, CBS Evening News, and ABC Sports all built their on-air graphics around the Paintbox. The system was used for the 1984 Los Angeles Olympics broadcast graphics, Doctor Who special effects, Top of the Pops titles, and countless TV commercials. * **The operator economy — $500/hour artists in short supply.** Early Paintbox users were not artists but broadcast technicians, due to union rules that only allowed engineers to operate the expensive equipment. This explains why early 1980s TV graphics often looked gaudy and same-y — they were made by people mesmerized by the technology, not by trained designers. As the technology matured, independent 'operators' emerged who were paid $500/hour — an extraordinary rate for the era. But training was scarce: unless you worked at a major network or post-production house, there was no way to learn. Creator Martin Holbrook himself left Quantel in 1986 to open his own post-production company in SoHo. Quantel gave three Paintboxes to UK art schools in the mid-1980s to broaden access to the tool. The machines ran 24/7 in post-production facilities, booked solid by advertising agencies and broadcast clients. This created a fascinating HCI dynamic: an interface so intuitive that non-computer-users could create professional work, but access was gate-kept by price, unions, and scarce training — a pattern that would repeat with later professional creative tools. * **From Paintbox to Photoshop — the great patent war.** In 1985, Quantel developed the Graphic Paintbox, a higher-resolution print-quality variant that revolutionized the photo manipulation industry five years before Photoshop. It was used for the photo-composite album covers of Queen's 'The Miracle' (1989), Nirvana's 'Nevermind', and Beastie Boys' 'Paul's Boutique', plus movie posters for The Silence of the Lambs and JFK. When Adobe launched Photoshop in 1990, Quantel sued for patent infringement, claiming Photoshop used Paintbox's patented features — including the pressure-sensitive stylus digital painting system. Quantel won a 1990 case against Spaceward's Matisse (a cheaper Paintbox clone) in London's High Court. But against Adobe in 1997, Quantel lost. Alvy Ray Smith (co-founder of Pixar, creator of the first 24-bit RGB paint system Paint3 in 1977) testified that he had seen the Paintbox at NAB and immediately recognized it as a hardware implementation of Dick Shoup's SuperPaint concepts from 1973. A photograph was produced in court proving that digital airbrush features Quantel claimed to have invented predated the Paintbox at Smith's NYIT lab. The Delaware judge invalidated all five of Quantel's U.S. patents, clearing Adobe. The case is a landmark in HCI intellectual property history — and a demonstration that software/hardware patents on interaction techniques are fragile against prior art from the research community. * **Artists, art, and legacy.** The Paintbox attracted major fine artists. David Hockney created his first digital art on a Paintbox in June 1985, calling them 'colored glass drawings' and describing the experience as 'painting with light on glass.' He said the colors had 'an almost neon glow' impossible in any other medium. Richard Hamilton, Howard Hodgkin, Larry Rivers, Sidney Nolan, and Jennifer Bartlett all created original works on the Paintbox for the BBC series 'Painting with Light' (1987). Quantel employed a hundred digital artists by the late 1980s to improve and demonstrate Paintbox features. The Computer Arts Society held a 50th anniversary Quantel Paintbox exhibition in 2023, curated by Adrian Wilson. The Dire Straits music video 'Money for Nothing' (1985) used Paintbox backgrounds and textures alongside a Bosch FGS-4000 3D system; it won MTV's first-ever Video of the Year award. Of the hundreds of Paintboxes sold, only two original DPB-7001 series machines survive — one in a museum, one privately restored. Approximately 22 total units of all versions are known, with about a dozen in working order — making surviving machines extraordinarily rare artifacts of professional creative HCI. ### Team * **Sir Peter Michael.** Founder of Quantel (1973); previously founded Micro Consultants Group. Knighted in 1989. Also founded Cosworth Engineering, Classic FM radio, and the Peter Michael Winery. * **Richard Taylor OBE.** Chairman of Quantel from 1975 until 2005; led the company through its golden age of Paintbox, Harry, Henry, and iQ product lines. Died 2009. * **Paul Kellar MBE.** Quantel Research Director; instrumental in many of Quantel's technical breakthroughs including the Paintbox architecture, digital framestore technology, and dynamic rounding. * **Martin Holbrook.** Professional illustrator who worked with Quantel's development team to design the artist-oriented Paintbox interface. Demonstrated the prototype at the 1981 NAB launch. His complaint about 'Tennis Neck' from looking between two screens led to the pop-up menu system. Left Quantel in 1986 to open his own post-production company. * **Ian Walker.** Undertook the original research and computer simulations of artist tools (brushes, paint, chalk) that were later transferred to hardware for the Paintbox. * **Bob Pank.** Product manager at Quantel during the Paintbox era; later wrote a retrospective on the Paintbox's creation for the 30th anniversary. * **Pepper Howard.** Implemented the font and text functions for the Paintbox in 1983, bringing typography into broadcast graphics for the first time. * **Anthony Stalley & John Coffey.** Co-founders of Quantel alongside Peter Michael in 1973. The name 'Quantel' was coined by Peter Owen's wife Rhiannon over breakfast, derived from 'Quantised Television.' ### Media ![Quantel Paintbox 7001 workstation with Paintbox V logo](../assets/wiki/quantel-paintbox-1.jpg) *The Quantel Paintbox 7001 series workstation, showing the Paintbox V logo from the 1990 second-generation model. (Wikimedia Commons, CC BY-SA)* ![Interior view of a Quantel Paintbox showing the rack of custom circuit boards](../assets/wiki/quantel-paintbox-2.jpg) *Inside the Quantel Paintbox: hundreds of custom ICs and PALs implemented all painting functions in dedicated hardware — a room-sized accelerated graphics card. (Wikimedia Commons, CC BY-SA)* ![Quantel Paintbox monitor viewing screen menus and large drawing tablet with stylus](../assets/wiki/quantel-paintbox-3.jpg) *The Paintbox's pressure-sensitive stylus and drawing tablet, with pop-up menus displayed on the CRT monitor — the interface that defined broadcast graphics production for over a decade. (Wikimedia Commons, CC BY-SA)* ![Vintage Quantel Paintbox showing on-screen graphical menus and drawing tools](../assets/wiki/quantel-paintbox-4.jpg) *The Quantel Paintbox graphical interface, showing the pop-up menu system and drawing tools — remarkably consistent across the product's entire 15-year lifespan. (Wikimedia Commons)* ### Sources 1. Quantel Paintbox - Wikipedia — https://en.wikipedia.org/wiki/Quantel_Paintbox 2. How Quantel's Paintbox Revolutionized TV Graphics 40 Years Ago — TV Technology (Adrian Wilson, 2021) — https://www.tvtechnology.com/opinion/how-quantels-paintbox-revolutionized-tv-graphics-40-years-ago 3. Quantel Paintbox History: The Stylus That Revolutionized Television — Tedium (David Buck, 2022) — https://tedium.co/2022/03/25/quantel-paintbox-history/ 4. The Quantel Paintbox — a pioneering computer graphics workstation (Bob Pank, Quantel blog, 2011, archived) — https://web.archive.org/web/20121108191518/http://blog.quantel.eu/2011/03/the-quantel-paintbox-a-pioneering-computer-graphics-workstation/ 5. Quantel - Wikipedia (company history, founders, product timeline) — https://en.wikipedia.org/wiki/Quantel 6. Peter Michael (engineer) - Wikipedia — https://en.wikipedia.org/wiki/Peter_Michael_(engineer) 7. Quantel Digital Paintbox 7001 — Powerhouse Museum Collection (Sydney) — https://collection.powerhouse.com.au/object/607626 8. The Big Box of Magic: A Love Letter to the Quantel Paintbox — UX Planet (Mat Venn, 2022) — https://uxplanet.org/the-big-box-of-magic-ebc1fc6c5cc4 9. Quantel Paintbox — Computer Arts Society Exhibition Catalogue (2023) — https://www.computer-arts-society.com/exhibitions/CAS-Quantel-Paintbox-Catalogue.pdf 10. Paintbox: Art x Engineering — Google Arts & Culture / Museum of Engineering Innovation — https://artsandculture.google.com/story/paintbox-art-x-engineering-museum-of-engineering-innovation/QwXxUjPEZ8tMEQ --- ## Tongue Touch Keypad (TTK) / Tongue Activated Communications Controller (1991) **By:** Zofcom Inc. / Zofcom Systems Inc. (Palo Alto, CA), later New Abilities Systems Inc. Principal Investigator: Daniel Fortune. **Tags:** `HCI` `Accessibility` `Assistive Technology` `Tongue Interface` `Intraoral` `Wearable` `Quadriplegia` `Environmental Control` `Dental Appliance` ### Overview The Tongue Touch Keypad (TTK) was a hands-free computer input device consisting of a custom-fitted intraoral dental retainer modified to include a nine-key membrane keypad, a digital encoder, and a low-power radio transmitter. Mounted against the roof of the mouth like an orthodontic retainer, the keypad was operated by touching different positions on the keypad with the tongue. Each key press was digitally encoded and transmitted via a low-frequency (approximately 2 MHz) amplitude-modulated magnetic flux field to a receiver positioned near the user's head. The companion Smartlink Controller decoded the signals and translated them into text input, mouse cursor movement, or equipment control commands — supporting an Apple Macintosh computer, powered wheelchair, television, VCR, telephone, page turner, and other household devices. The TTK concept originated at Zofcom Inc., a small Palo Alto company founded by Daniel Fortune, with SBIR Phase I funding in 1984 ($50,000 from HHS) for 'Tongue Activated Computer Control for the Handicapped.' A Phase II award followed in 1987 ($147,000 from NIH). In 1990, the U.S. Department of Education awarded a Phase I SBIR ($29,520) specifically to adapt the TTK and Smartlink System for educational applications. The FDA cleared the 'TongueTouch Keypad and Zofcom Control System' as a Class II powered environmental control system in April 1991 (510(k) K911101). By 1994, the successor company New Abilities Systems received FDA clearance for the 'UCS 1000 with TongueTouch Keypad Wheelchair' (K932786), integrating tongue control directly into powered wheelchair operation. User adoption was small but life-changing. Stacy Bibb, a young man with severe athetoid cerebral palsy and quadriplegia, began using the TTK in 1991 at age 17 and relied on it for over 25 years. In his mother's words, 'He took to the TTK like a fish to water.' Approximately 70 quadriplegic users ultimately received TTK devices before the company went bankrupt. When it did, users like Stacy lost their ability to communicate beyond stick-out-tongue-for-yes for three full years until volunteer engineers built a replacement. ### Deep dive * **Origins: From Tongue Switch to Tongue Keyboard.** The TTK's lineage traces back to work at Thomas Jefferson University in the early 1980s. Philip Katz, Henry S. Brenman, Louis D. Lowry, and Harold Schwartz developed a series of intraoral devices including an artificial larynx and a tongue-activated environmental control switch (US Patent 4,550,427, 1985; US Patent 4,605,927, 1986; US Patent 4,783,656, 1988). Their key insight: since lingual function is usually preserved in quadriplegia (the tongue is connected to the brain via cranial nerves, not the spinal cord), an intraoral switch on a dental appliance could bypass physical disability entirely. The Thomas Jefferson device used a single pair of Ag-AgCl contacts bridged by the tongue to activate an intraoral FM transmitter sending control signals to an external receiver. But a single switch is inherently limiting — it can only do one thing. Zofcom's breakthrough was to scale this to a full nine-key membrane keypad integrated into a palatal splint, transforming the tongue from a binary switch into a multi-channel input organ. * **Hardware: The Palatal Splint That Became a Keyboard.** The TTK was fabricated as a custom-fitted dental retainer, typically molded from acrylic polymer, shaped to fit comfortably against the roof of the wearer's mouth. Embedded within the palatal surface was a nine-key membrane keypad — essentially a miniature version of the membrane switches found in early electronic calculators and computer keyboards, but sized and contoured for tongue operation. The keypad was connected to a digital encoder chip that assigned a unique binary code to each key press. A low-power radio transmitter — operating via magnetic flux field coupling at approximately 2 MHz using an air-core inductor coil wound around the periphery of the retainer — broadcast the encoded keystrokes wirelessly to an external receiver. The use of magnetic near-field transmission (rather than conventional RF) was a deliberate design choice to minimize power consumption while maintaining reliable signal through the oral tissue. The entire electronic assembly was potted in medical-grade silicone adhesive to protect it from saliva and the hostile intraoral environment. Battery power came from small lithium or silver oxide cells embedded in the retainer. An important power-saving innovation was a delay circuit that required continuous tongue contact for a threshold duration before activation, preventing inadvertent key presses and extending battery life. * **Interaction Design: Typing with Your Taste Buds.** Operating the TTK required learning a new bodily vocabulary. The nine keys were arranged on the palatal retainer in a grid pattern, and the user learned to touch specific positions on the roof of their mouth with the tip of their tongue. Because the tongue rivals the fingers in tactile sensitivity, spatial awareness, and speed, users could develop remarkable proficiency. The Smartlink Controller translated key presses into different modes: in text-entry mode, each key corresponded to a letter, word, or phrase; in mouse mode, directional keys moved the cursor; in environmental control mode, keys mapped to appliances and devices. The SBIR abstract from 1990 explicitly claimed that the text entry rate of the TTK was 'superior to other computer access input devices which are currently available to the disabled.' Crucially — and this was a major psychological factor — the TTK was 'essentially invisible when worn.' Unlike head pointers, mouth sticks, or external switch arrays that visibly marked the user as disabled, the TTK was hidden inside the mouth. For disabled children and teenagers especially, this invisibility was transformative: it reduced self-consciousness and improved willingness to engage with technology in social settings. * **Clinical Deployment and User Stories.** Stacy Bibb, born with severe athetoid cerebral palsy that left him quadriplegic and nonverbal at 80 pounds with the developmental abilities of a 4-month-old, received his first TTK in 1991 at age 17. Before the TTK, he could only make noises with his tongue. With the TTK, he could type messages, play video games, control his wheelchair, and operate a computer. His mother Portia recalled, 'I was so proud of him!' The device served him for over 25 years through multiple technology upgrades — from infrared to Bluetooth. Approximately 70 other quadriplegic individuals received TTK systems. The human cost of specialized assistive hardware's fragility became apparent when New Abilities Systems went bankrupt: users like Stacy lost their voice entirely, reduced to binary communication (stick out tongue for 'yes,' close mouth for 'no') for three years until a volunteer game designer named Jason Eldred built a replacement using a 99-cent Halloween mask and a metal contact, later refined by UCSD engineering students. * **Legacy: The Tongue Interface Genealogy.** The TTK established the fundamental paradigm — intraoral, tongue-operated, wireless, multi-channel — that every subsequent tongue-computer interface has followed. The Georgia Tech Tongue Drive System (2008–present, Maysam Ghovanloo) replaced the physical keypad with a magnetic tracer on the tongue and Hall-effect sensors on a headset, trading mechanical contacts for magnetic tracking — but preserved the core insight that the tongue is a high-bandwidth input channel. The Augmental MouthPad (2024, MIT spinoff) returns to the palatal retainer form factor but adds a touch-sensitive trackpad and IMU for continuous cursor control. MIT's MouthIO platform (2024) generalizes the concept into a fabrication toolkit for custom intraoral interfaces. In a 2008 NBC News article, Ghovanloo's team explicitly acknowledged the TTK as predecessor: 'A Palo Alto, Calif.-based company, newAbilities Systems Inc., has already designed a nine-button keypad placed on the roof of the mouth to control electronics.' The TTK's story also serves as a lasting warning about the sustainability challenges of niche assistive hardware — when the company fails, the users are the ones who lose their voice. ### Team * **Daniel Fortune.** Founder of Zofcom Inc. and Principal Investigator on all three SBIR awards (1984, 1987, 1990). Led development of the Tongue Touch Keypad and Smartlink System. * **Zofcom Inc. / Zofcom Systems Inc..** Palo Alto, CA (3962 Nelson Court). Small company (1–4 employees, under $500K revenue) that developed the TTK. Received SBIR awards from HHS/NIH (1984, 1987) and Department of Education (1990). Filed US Patent 5,523,745 (1991/1996). * **New Abilities Systems Inc..** Successor company to Zofcom. Filed and received FDA 510(k) K932786 for the 'UCS 1000 with TongueTouch Keypad Wheelchair' in 1994. Later went bankrupt, leaving ~70 TTK users without support. * **Philip Katz, Henry S. Brenman, Louis D. Lowry, Harold Schwartz.** Thomas Jefferson University. Developed the intra-oral lingually operated switch and FM transmitter (US Patents 4,550,427, 4,605,927, 4,783,656, 1983–1988) that served as the foundational technology precursor to the multi-key TTK. * **Jason Eldred.** Professional game designer (worked on The Last of Us Part II for Sony PlayStation 4). In 2020, when Stacy Bibb's Bluetooth TTK failed due to COVID manufacturing delays, Eldred built a replacement two-button tongue-touch system in one week using a 99-cent Halloween mask. ### Media ![Intraoral appliances with built-in electronics: (a) Tongue-Touch Keypad, the dental retainer with nine-key membrane keypad and embedded electronics](../assets/wiki/tongue-touch-keypad-1.png) *The Tongue Touch Keypad (TTK) intraoral appliance with nine-key membrane keypad and embedded transmitter. From Huo & Ghovanloo (2014), Sensors 14(11):21565, referencing the original Zofcom/New Abilities design.* ![US Patent 5,523,745 Figure 1: block diagram of the tongue activated communications controller system](../assets/wiki/tongue-touch-keypad-2.png) *US Patent 5,523,745 (Zofcom Systems Inc., filed 1991) Figure 1: System block diagram showing the intraoral tongue keypad, encoder, transmitter, external receiver, and controller connected to controlled devices. Source: Google Patents/USPTO.* ### Sources 1. SBIR.gov — 'ADAPTATION OF TONGUE TOUCH KEYPAD AND SMARTLINK SYSTEM TO EDUCATIONAL APPLICATIONS' (Zofcom Inc., 1990, DoEd Phase I, $29,520). Full abstract with technical description of the nine-key membrane keypad, digital encoder, radio transmitter, and Smartlink Controller. — https://www.sbir.gov/awards/125752 2. SBIR.gov — Zofcom Inc. Company Portfolio. Shows Phase I award in 1984 and Phase II award in 1987 for 'Tongue Activated Computer Control for the Handicapped.' — https://www.sbir.gov/portfolio/354566 3. FDA 510(k) K911101 — 'TONGUETOUCH KEYPAD AND ZOFCOM CONTROL SYSTEM' (Zofcom Inc., cleared April 25, 1991). Class II powered environmental control system. — https://fda.report/PMN/K911101 4. FDA 510(k) K932786 — 'UCS 1000(TM) WITH TONGUETOUCH KEYPAD WHEELCHAIR' (New Abilities Systems Inc., cleared March 28, 1994). — https://fda.innolitics.com/submissions/PM/subpart-d—physical-medicine-prosthetic-devices/ITI/K932786 5. US Patent 5,523,745 — 'Tongue activated communications controller' (Zofcom Systems Inc., filed 1991, issued 1996). Detailed technical description of the intraoral keypad, magnetic flux coupling transmitter, and multi-device controller. — https://www.freepatentsonline.com/5523745.html 6. US Patent 4,783,656 — 'Intra-oral control unit and system' (Thomas Jefferson University, filed 1986, issued 1988). Precursor: single-switch intraoral FM transmitter on a dental appliance for environmental control. — https://www.freepatentsonline.com/4783656.html 7. Mountain Shadows Support Group — 'Tongue-Touch Keypad Gives Voice to Resident' (Constant Contact). Stacy Bibb's story: 25+ years with the TTK, starting in 1991 at age 17. — https://myemail.constantcontact.com/Tongue-Touch-Keypad-Gives-Voice-to-Resident.html 8. Mountain Shadows Support Group — 'Come Closer and Touch His Cheek' (2023). Details about the TTK as a dental retainer device; the company's bankruptcy; Stacy's three years without the device. — https://mtnshadows.org/2023/06/come-closer-and-touch-his-cheek/ 9. NBC News / Associated Press — 'Turning the tongue into a computer control pad' (Aug 24, 2008). Describes Georgia Tech Tongue Drive System and explicitly references newAbilities Systems Inc.'s nine-button keypad as predecessor. — https://www.nbcnews.com/id/wbna26338543 10. Huo & Ghovanloo (2014) — 'An Arch-Shaped Intraoral Tongue Drive System with Built-in Tongue-Computer Interfacing SoC,' Sensors 14(11):21565. Includes photograph of the original TTK dental retainer alongside newer tongue-drive devices. — https://www.mdpi.com/1424-8220/14/11/21565 --- ## Aesthedes (1984) **By:** Claessens Product Consultants / Aesthedes NV, founded by Dominique P.G. Claessens in Hilversum, Netherlands **Tags:** `CAD` `Workstation` `Design` `Keyboard` `Vector Graphics` `Dutch` `Prepress` ### Overview The Aesthedes was a dedicated graphic-design workstation developed by Dutch industrial designer Dominique Claessens and his company Claessens Product Consultants, commercially launched in 1985. Its core design philosophy was radical: every function should have its own physical key, and every view its own physical screen. No overlapping windows, no nested menus, no modifier-key combinations — just direct physical access to every command. The Aesthedes 1 packed approximately 583 membrane-switch keys into the desk surface, organized into functional 'islands' (layer selection, colour wheel, geometric operations, text entry, etc.). Three 20-inch Barco RGB monitors displayed the composite view, zoom view, and working-layer view simultaneously; three 12-inch monochrome data screens showed project data, colour values, and command history. Under the desk: ten Motorola 68000 microprocessors, 1.9 MB RAM, 2.4 MB graphics memory, and a 20 MB hard disk running Microware OS-9. The entire system weighed 220 kg and cost approximately 300,000 Dutch guilders (roughly $150,000 USD in mid-1980s money) — the price of 30 middle-class cars. Between 200 and 250 units were produced. Customers included the Dutch State Printing Office (for banknotes and security documents), Total Design in Amsterdam (three units), Marks & Spencer, Volvo, Mercedes, Volkswagen, Ford UK, and Heineken. The Aesthedes was used to design the Dutch 25-guilder 'Robin' banknote (1989), Dutch traffic signs, and countless consumer packaging designs. The Aesthedes 2 (1989) upgraded to dual Motorola 68020 processors, added CMYK support, a pull-out QWERTY keyboard tray (bringing the total to ~636 keys), and optional Macintosh connectivity — the very machine that would render it obsolete. Total Design, the legendary Dutch design agency led by Wim Crouwel, acquired three Aesthedes computers and nearly went bankrupt from the investment. In 1990, they put all three machines on the street for bulky-waste collection. Claessens sold Aesthedes NV to Belgian monitor manufacturer Barco Graphics in November 1989; production ceased shortly after. Today only about seven units are known to survive, with two fully operational at the HomeComputerMuseum in Helmond, Netherlands, restored through years of painstaking volunteer work after being rescued from an Amsterdam university basement. ### Deep dive * **The Key-Per-Function Philosophy.** Dominique Claessens' foundational belief was that a designer should 'be able to start immediately, without knowledge of computers.' The insight was that switching between 'creative brain' (visual thinking, spatial reasoning) and 'cognitive brain' (remembering keyboard shortcuts, navigating menus) broke the design flow. His solution was extreme: a dedicated physical key for every single function. No Ctrl, Alt, or Cmd keys — those were 'modifiers,' his were 'keepers.' The Aesthedes 1 membrane desk had roughly 583 keys; the Aesthedes 2 added a hidden pull-out QWERTY tray for text entry, bringing the total to approximately 636 keys — likely the most keys ever on a production computer. The keys were organized into coloured islands: 64 layer-select keys, a colour-wheel island, boolean operation keys, move/mirror/rotate blocks, and named-function sections. Each island had its own red ENTER key. The training manual included printed mini-maps showing where each key was located on the desk, because finding the right key among 636 was itself a non-trivial task. The keyboard *was* the GUI — what you saw printed on the membrane was what you got, with no abstraction between physical input and software function. * **Six Screens, No Overlap.** Rather than stacking information in overlapping windows (a concept that barely existed yet), the Aesthedes gave every information view its own physical monitor. The three 20-inch Barco RGB colour monitors showed: (left) a zoom view of the current layer at up to 100× magnification; (center) the composite view with all 64 layers stacked; (right) the working layer in monochrome cyan. Three 12-inch monochrome data screens below displayed project parameters, RGB values per layer, and the last 10 commands executed. All six screens updated simultaneously — no window to bring to front, no tab to click. The canvas itself was enormous: 64,000 × 64,000 coordinate units with 64 layers. Units could be defined so that a map of the Netherlands appeared at actual life scale, with distance measurements in kilometers. Each layer held one colour; higher-numbered layers visually covered lower ones. The system was purely vector-based, with B-spline curves for smooth shapes, and output through plotters or a raster image processor (the APD, a separate Aesthedes-styled peripheral) for colour-separated film. * **The Designer-Operator Paradox.** Despite Claessens' vision of an immediately accessible machine, the Aesthedes was so complex that most agencies hired dedicated operators — trained specialists who sat between the designer and the machine. At Total Design, the workflow reversed entirely: the designer had to complete the entire conceptual process beforehand, clearly describing every detail to the operator, who then executed it. As designer Robert van Rixtel recalled, 'You had to have completed the conceptual process before you started. That's totally the opposite nowadays because you can usually sketch directly on the computer.' Frustrated by the communication gap, van Rixtel once grabbed a transparency sheet, taped it to the computer screen, and penciled his design directly on it. 'It worked.' The Aesthedes also had a notorious UNDO key — physically present on the keyboard, but the function was never implemented. Pressing it did nothing. Designers learned to save to floppy disk before every risky operation. * **The Dutch 25-Guilder Banknote.** The Aesthedes played a key role in designing the Dutch 25-guilder 'Robin' ('Roodborstje') banknote, introduced in 1989 and designed by Jaap Drupsteen. Drupsteen used three computer systems sequentially: the Quantel Paintbox for the first sketch, the Aesthedes to refine the intricate anti-counterfeiting linework (its enormous vector precision was ideal for guilloche patterns), and a Tekari drafting computer for fine details. The Dutch State Printing Office (Sdu), which leased its Aesthedes to the central bank for the project, used the machine specifically for designing 'moeilijk na te maken documenten' — hard-to-forge documents including giro cheques, state lottery tickets, and all Dutch traffic signs. Drupsteen went on to use the same workflow for subsequent notes: the 100-guilder 'Little Owl' (1992), 1,000-guilder 'Lapwing' (1996), and 10-guilder 'Kingfisher' (1997). * **Commercial Fate: The Macintosh Kills the Behemoth.** The Apple Macintosh (1984) cost roughly 25,000–40,000 guilders — an order of magnitude less than the Aesthedes's 300,000–400,000. While the Aesthedes required trained operators and proprietary software, the Mac ran off-the-shelf applications and let designers work directly. The Aesthedes 2 even offered optional Macintosh connectivity — the irony of selling the machine that would destroy you as a peripheral. As the UvA Computer Museum notes: 'Ultimately, the Macintosh would make its Aesthedes host obsolete, as it became apparent that most of the work could be done on the Mac.' A single repair board for the Aesthedes cost as much as a complete Macintosh. Total Design scrapped their three units in 1990. Claessens sold the company to Barco Graphics in November 1989. Some machines remained in service until the turn of the century. An Aesthedes 3 was developed but never shipped as hardware — it became a software-only solution running on Silicon Graphics machines. * **Rescue and Restoration.** By 2018, there were 'no schematics, no pictures, no manuals, no videos' of the Aesthedes online. The HomeComputerMuseum in Helmond, Netherlands, reverse-engineered everything — even the Barco monitors lacked surviving documentation. They tracked down former employees and users through social media, who shared knowledge and surviving materials. In March 2024, the museum crowdfunded €3,160 to rescue an Aesthedes 1 from the University of Amsterdam, which had lost all operational knowledge of it. Transport alone cost €1,500. The software was password-protected with 'long forgotten passwords'; source code had been discarded after the company's shutdown. First power-on: 2021. 90% operational: 2022. Fully working: January 2025. Two working Aesthedes computers now sit side by side at the museum — the only two in the world known to be fully operational. ### Team * **Dominique P.G. Claessens (1922–2019).** Founder and inventor. Studied monumental art at the Rijksakademie Amsterdam, then industrial design. Founded Claessens Product Consultants in 1960 in Hilversum. Began conceptualizing the Aesthedes in the mid-1970s. Won the Gravisie design award for the Aesthedes in 1984. * **Paul Brown.** UK-based artist-programmer who started developing Aesthedes software in 1979. * **Henne Hautma.** Electronics integration. * **Hans (C.J.) van den Berg.** Former Aesthedes engineer who later assisted the UvA Computer Museum with technical data, manuals, and spare parts. * **Claessens Product Consultants / Cartils.** The design consultancy that developed the Aesthedes. Still operating today as Cartils (branding/packaging agency). * **Aesthedes NV.** Corporate entity formed to commercialize the workstation. Offices in Hilversum, London, Cologne, and Los Angeles. Sold to Barco Graphics NV in November 1989. * **HomeComputerMuseum (Helmond, NL).** Current custodian of two fully operational Aesthedes units. Led the restoration project from 2018 to 2025. ### Media ![Aesthedes 2 console with six screens and membrane keyboard desk](../assets/wiki/aesthedes-1.jpg) *Aesthedes 2 console showing the three colour monitors, three data screens, and 636-key membrane desk. (Wikimedia Commons)* ![Fully restored Aesthedes 2 at HomeComputerMuseum Netherlands](../assets/wiki/aesthedes-2.jpg) *Fully restored Aesthedes 2 at the HomeComputerMuseum, Helmond. (Wikimedia Commons)* ![Two working Aesthedes computers side by side at HomeComputerMuseum](../assets/wiki/aesthedes-3.jpg) *Two working Aesthedes computers — the only pair known to be operational anywhere. (Wikimedia Commons)* ![Aesthedes 1 in use at Computer Aided Visuals, Amsterdam, 1988](../assets/wiki/aesthedes-4.jpg) *Aesthedes 1 in use at Computer Aided Visuals, Amsterdam, 1988. (Wikimedia Commons)* ### Sources 1. Wikipedia: Aesthedes — https://en.wikipedia.org/wiki/Aesthedes 2. Dutch Wikipedia: Aesthedes (extensive technical and UI detail) — https://nl.wikipedia.org/wiki/Aesthedes 3. AIS/Design: 'Total Design and the Case of the Aesthedes Computer' (Karin van der Heiden, 2016) — https://web.archive.org/web/20170306103027/http://www.aisdesign.org/aisd/en/total-design-sistema-aesthedes-cambiare-gli-strumenti-del-graphic-design-olanda-negli-anni-ottanta 4. Shift Happens: 'The Modifiers vs. The Keepers' (Marcin Wichary, 2022) — https://newsletter.shifthappens.site/archive/the-modifiers-vs-the-keepers/ 5. HomeComputerMuseum: Aesthedes collection page — https://www.homecomputermuseum.nl/en/collectie/aesthedes/aestedes/ 6. HomeComputerMuseum Labs: Project Aesthedes restoration timeline — https://labs.homecomputer.museum/uncategorized/project-aesthedes/ 7. GoFundMe: Rescue and Restore the Aesthedes 1 (March 2024) — https://www.gofundme.com/f/rescue-and-restore-the-aesthedes-1 8. UvA Computer Museum: Aesthedes page — https://ub.fnwi.uva.nl/computermuseum/aesthedes.html 9. De Nieuwe Schatkamer: The 25-Guilder Robin Banknote — https://www.denieuweschatkamer.nl/en/money-collection/extraordinary-money-extraordinary-stories/the-25-guilder-robin-banknote 10. KBD.news: Aesthedes 2 keyboard analysis — https://kbd.news/Aesthedes-2-1096.html 11. SIGGRAPH History: Aesthedes Inc. exhibitor profile — https://history.siggraph.org/exhibitor/aesthedes-inc/ 12. Bitsavers: Aesthedes archive (manuals, software) — http://bitsavers.informatik.uni-stuttgart.de/pdf/aesthedes/ 13. New Scientist: 'Computer Graphics Challenges Artists' (Sept 5, 1985) — https://books.google.com/books?id=6uYQcwmQO3QC&pg=PA35 14. YouTube: Aesthedes Promotional Video — https://www.youtube.com/watch?v=vO0a8veCOek --- ## RDI Halcyon (1985) **By:** RDI Video Systems (Rick Dyer, founder), Carlsbad, California **Tags:** `Gaming` `Voice Recognition` `Laserdisc` `Speech Synthesis` `Interactive Movie` `CES` ### Overview The RDI Halcyon was a voice-controlled laserdisc home video game console developed by RDI Video Systems, founded by Rick Dyer in Carlsbad, California. Demonstrated at CES in January 1985 and priced at $2,500 (approximately $7,400 in 2024 dollars), the Halcyon was an audacious attempt to bring conversational speech interaction to the living room. The system consisted of a Z80-based computer unit, a Pioneer laserdisc player, and a noise-canceling headset with microphone. The defining interaction model was voice: rather than joysticks or keyboards, players spoke commands aloud, and the Halcyon's speech recognition engine interpreted them in context to navigate branching full-motion video narratives and play games. Before each session, users trained the Halcyon to recognize their voice by reading sample phrases — an early example of speaker-dependent speech recognition in a consumer device. During gameplay, the system would recognize commands like 'Halcyon, I choose to go left' or 'Halcyon, fire' and respond with synthesized speech confirmation. The Halcyon's AI persona — 'Halcyon' itself — was a synthesized voice that served as narrator, game master, and interactive companion, addressing the player by name. The launch titles included 'Thayer's Quest' (a fantasy adventure), 'The Land of the Dead' (a horror game), NFL Football, and an interactive version of the cartoon 'Heathcliff.' Despite its technical ambition, the Halcyon was a spectacular commercial failure. RDI Video Systems had been funded largely by profits from Dyer's earlier hit, the laserdisc arcade game 'Dragon's Lair' (1983), but the Halcyon burned through those resources. The $2,500 price point, limited software library, unreliable speech recognition in noisy living rooms, and the 1983 video game crash's aftermath all contributed to its demise. Estimates of total production range from as few as 2 to perhaps 10-12 units, making it one of the rarest video game consoles ever produced. Today, surviving units are museum pieces, with examples at the National Videogame Museum in Frisco, Texas. ### Deep dive * **Voice as the Only Controller.** The Halcyon's most distinctive feature was that it was controlled almost entirely by voice. Players wore a lightweight headset with a noise-canceling microphone, and the system's speech recognition was the primary input — unusual even by today's standards. While some games supported a traditional joystick as a fallback (plugged into a 4-pin connector on the back of the keyboard unit), the intended experience was conversational. The voice recognition was speaker-dependent: before playing, users trained the system by repeating sample phrases, allowing the Halcyon to build a voice model. The system provided feedback by repeating recognized commands using its built-in speech synthesizer, giving users confirmation that their command had been understood. The speech recognition vocabulary was limited to game-specific command sets — 'go left,' 'go right,' 'open door,' 'use key' — but the interaction felt genuinely futuristic in 1985. However, recognition was notoriously unreliable, especially in environments with background noise or multiple speakers, a limitation that undermined the entire 'hands-free' promise. * **Hardware: Z80 + Laserdisc + Voice.** Under the hood, the Halcyon was a hybrid system: a Z80A CPU running at 4 MHz with 64 KB of RAM and 8 KB of ROM handled voice recognition and game logic, while a Pioneer LD-700 or LD-V6000 series laserdisc player (purchased separately or bundled) provided full-motion video and CD-quality audio. The computer unit connected to the laserdisc player via RS-232 serial, sending seek commands to jump between video segments based on the player's spoken choices. This branch-on-choice approach created an 'interactive movie' experience years before the term existed — the laserdisc held a branching video tree, and the voice recognition selected which branch to play next. The system also included an external QWERTY membrane keyboard (for setup and text entry) and composite video output for connection to a television. Unlike contemporary game consoles that generated graphics in real time, the Halcyon was fundamentally a video playback controller with a voice interface grafted on top. * **The Dragon's Lair Legacy.** The Halcyon was born from the profits of one of the most successful arcade games of the early 1980s: 'Dragon's Lair' (1983), created by Rick Dyer and animated by Don Bluth. Dragon's Lair used laserdisc technology to deliver full-motion cartoon animation in an arcade cabinet, and it earned approximately $32 million in its first year. Dyer reportedly invested $20 million of those profits into developing the Halcyon, believing that laserdisc-based interactive entertainment was the future of home gaming. RDI Video Systems was established specifically to pursue this vision. But the home market was dramatically different from the arcade — consumers expected robust, reliable interaction, not the precise-timing joystick moves of Dragon's Lair — and the Halcyon's voice recognition couldn't match the reliability of a joystick. Dyer would later say of the project: 'We were too far ahead of the technology.' * **The Games: Interactive Movies Before FMV Gaming.** Only two games are known to have been completed for the Halcyon: 'Thayer's Quest' (a high-fantasy adventure set in a kingdom called Weigard, with the player as the hero Thayer) and 'The Land of the Dead' (a horror game based on the 1968 film 'Night of the Living Dead'). Additionally, 'NFL Football' was demonstrated at CES as a Laserdisc-based sports title featuring John Madden providing commentary — with the player's spoken commands acting as the quarterback calling plays. An interactive version of the cartoon 'Heathcliff' was also shown. 'Thayer's Quest' was later ported to other platforms (CD-i, DVD, iOS), but the Halcyon originals were laserdisc-and-voice exclusives. The game design was constrained by the branching-video format: each spoken command triggered a seek to a specific frame on the laserdisc, which could take 1-3 seconds, creating noticeable pauses between command and response. * **The Halcyon AI Persona.** One of the most distinctive aspects of the Halcyon was its synthesized voice personality. The system addressed players by name (entered during setup) and adopted a conversational tone — 'Greetings, Sarah. I am Halcyon. What would you like to play?' — creating the impression of an intelligent companion rather than a mute game console. This was a deliberate design choice: Rick Dyer envisioned Halcyon as not just a game machine but a 'home companion' that could read bedtime stories, help with homework, and control other home electronics. The Halcyon's name itself was chosen to evoke calm and tranquility ('halcyon days'), positioning the device as a soothing, intelligent presence in the home — a precursor to smart speakers like Amazon Echo and Google Home by 30 years. The 1985 CES demonstration showed Halcyon reciting a poem, answering questions, and engaging in light banter with booth visitors. * **Commercial Fate: Ten Units and Oblivion.** The Halcyon was announced at CES in January 1985 with a planned retail launch for late 1985 at $2,500. But the timing was disastrous: the 1983 video game crash had gutted the home console market, retailers were gun-shy, and $2,500 was an astronomical price for a game console (a Nintendo Entertainment System would launch at $180 the same year). RDI Video Systems had poured an estimated $20 million into development but ran out of money before mass production could begin. Only a handful of units were ever built — estimates range from 2 to 12 — primarily for trade show demonstrations and investor pitches. The company folded shortly after. Surviving Halcyon units are among the holy grails of video game collecting. The National Videogame Museum in Frisco, Texas, holds a unit and sometimes displays it. A few units have surfaced at auction, with one selling for approximately $8,500. The Halcyon's laserdisc games were later repurposed: 'Thayer's Quest' was ported to the Philips CD-i in the 1990s, and Rick Dyer later worked on other interactive movie projects, though none achieved the Halcyon's audacious scope. ### Team * **Rick Dyer.** Founder of RDI Video Systems. Creator of the arcade hit 'Dragon's Lair' (1983) with animator Don Bluth. Invested an estimated $20 million of Dragon's Lair profits into developing the Halcyon. Visionary behind the voice-controlled interactive home entertainment concept. * **RDI Video Systems.** Carlsbad, California startup formed to commercialize laserdisc-based interactive entertainment. Funded primarily from Dragon's Lair arcade revenue. Demonstrated the Halcyon at CES 1985. Folded shortly after the Halcyon's commercial failure. * **Advanced Products and Technologies / APT.** The company or division responsible for manufacturing the Halcyon hardware. Some sources reference APT as the manufacturing arm of RDI. * **Don Bluth.** Animator who created the visuals for Dragon's Lair's follow-up content, some of which was planned for Halcyon. ### Media ![RDI Halcyon console, keyboard, and headset](../assets/wiki/rdi-halcyon-1.jpg) *The RDI Halcyon system: computer unit, membrane keyboard, and voice headset. Photo from handheldmuseum.com collection.* ![RDI Halcyon promotional flyer](../assets/wiki/rdi-halcyon-2.jpg) *RDI Halcyon promotional flyer showing the console, headset, and Thayer's Quest game. (Handheld Museum)* ### Sources 1. Wikipedia: Halcyon (console) — https://en.wikipedia.org/wiki/Halcyon_(console) 2. Polygon: 'The Story of the Halcyon, the Most Rare Console in History' (2018) — https://www.polygon.com/videos/2018/3/1/17063348/halcyon-rare-console-history 3. AtariHQ: RDI Halcyon detailed history and photos — https://atarihq.com/mainsite/rdi-halcyon/ 4. Giant Bomb: Halcyon wiki entry — https://www.giantbomb.com/rdi-halcyon/3045-116/ 5. The Dragon's Lair Project: Halcyon history — https://www.dragons-lair-project.com/community/related/halcyon/ 6. Old-Computers.com: RDI Halcyon — https://www.old-computers.com/museum/computer.asp?c=954 7. RDI Halcyon promotional brochure scans — https://atarihq.com/mainsite/rdi-halcyon/ 8. Video Game Console Library: Halcyon — https://www.videogameconsolelibrary.com/pg80-halcyon.htm 9. YouTube: Rare Halcyon Console Footage at CES 1985 — https://www.youtube.com/results?search_query=RDI+Halcyon+CES+1985 --- ## Talking Signs / Remote Infrared Audible Signage (RIAS) (1979) **By:** Smith-Kettlewell Eye Research Institute (SKERI), San Francisco. Invented by William (Bill) Loughborough. **Tags:** `Accessibility` `Infrared` `Navigation` `Ambient Interface` `Environmental HCI` `Assistive Technology` `Wayfinding` ### Overview Talking Signs (originally 'Talking Lights') is a remote infrared audible signage system that allows blind and visually impaired travelers to independently locate and identify destinations, transit facilities, and services. First conceived by William Loughborough in 1979 at the Smith-Kettlewell Eye Research Institute in San Francisco, the system consists of fixed infrared transmitters that continuously broadcast digitally recorded spoken messages on modulated infrared light beams, and handheld receivers carried by blind users. When a user points the receiver toward a transmitter, the spoken message is heard through a built-in speaker; the signal grows clearer and louder as the user points more directly toward the source, providing intuitive directional feedback. Unlike audio beacons that broadcast sound to everyone in an area, Talking Signs are silent to the unaided ear and provide information only to the person carrying a receiver — preserving privacy and avoiding noise pollution. The technology evolved through the 1980s with contributions from Bill Crandall, Bill Gerrey, Albert Alden, Erich Sutter, and B.L. Bentzen at SKERI. Loughborough left SKERI to found Love Electronics in Goldendale, Washington, which commercialized the system with transmitters priced at $150 and receivers at $250. By the mid-1990s, large-scale deployments were installed in San Francisco's Powell Street BART/Muni station (93 transmitters across three levels), Market Street intersections, the San Francisco New Main Library, and transit systems in Seattle, New York, and Washington DC. Mitsubishi later produced transmitters and receivers at scale. Formal human-factors studies demonstrated dramatic improvements in independent navigation: blind participants using Talking Signs began crossing streets during the Walk phase 99% of the time (compared to 66% without) and needed help finding crosswalks only 1% of the time (compared to 19%). In 2000, the technology was incorporated into US federal accessibility standards (ADAAG 703.7). In 2016, Joshua Miele at SKERI created 'overTHERE,' a free iOS app that simulates the directional pointing interface using GPS and compass data, giving the Talking Signs concept a software-only afterlife used by thousands daily. ### Deep dive * **Infrared Beams as Ambient Interface.** The core interaction is deceptively simple: a transmitter at a fixed location continuously broadcasts a digitally recorded spoken message (e.g., 'Powell Street BART station — escalator to trains') modulated onto a 25 kHz FM subcarrier on infrared light at 850–950 nm wavelength. A blind user carries a pocket-sized receiver (4 × 2 × 1 inches) with a photodiode sensor behind a directional aperture. Scanning the environment by pointing the receiver in different directions, the user hears spoken messages when the aperture is aligned with a transmitter. The signal provides natural directional feedback: clarity and loudness increase as pointing accuracy improves and distance decreases; pointing away causes the signal to become staticky and eventually squelch. Multiple overlapping signals are resolved by FM capture effect — the stronger signal (closer or more directly pointed) captures the receiver, requiring approximately a 20 dB power ratio. Because infrared is line-of-sight and blocked by walls, it naturally matches the behavior of visual signs — you can't 'hear' a sign around a corner any more than you could see one. The transmitter broadcasts continuously, meaning the user chooses when to access the information (a deliberate ADA-conscious design choice to keep the system 'refusable'). The intelligence is entirely in the receiver; the transmitter is a 'dumb' repeater. This split — smart receiver, dumb infrastructure — presages the smartphone-as-sensor paradigm by decades. * **The 1991 SKTF — A Technical Primary Source of Extraordinary Depth.** The Fall 1991 issue of the Smith-Kettlewell Technical File (SKTF), edited by Bill Gerrey and still available in full online, is one of the richest primary source documents in the museum's research archive. Across dozens of pages, it provides complete schematics for both transmitters and receivers, a bill of materials with prices, beam-dispersion physics calculations, installation geometry guidelines, human-factors deployment philosophy, and circuit-level explanations. The transmitter used a 512K-bit EPROM for ~8 seconds of sampled speech at 64 Kbps, modulating an FM subcarrier with a CD4046 phase-locked loop. The receiver used six Siemens BPW34 photodiodes in parallel behind a Kodak Wratten Filter No. 87C (passing 80% IR, blocking 99.5% visible light), with an LM311 comparator providing squelch with RC hang time. The document addresses practical deployment concerns: how to align transmitters so beams don't bleed between floors, how to handle direct sunlight (which contains IR), how to design street-sign arrays with 48 dual-LEDs for crosswalk coverage. The document even includes a troubleshooting section and a parts-ordering guide with 1991 pricing: $0.60 per LED in small quantities, $150 for a custom-message transmitter, $250 for a receiver. Gerhard Sollner of the SKTF later wrote a supplementary issue with refinements. * **Human Factors: The Science of Ambient Wayfinding.** Talking Signs is one of the most rigorously evaluated accessibility interventions in HCI history. Bill Crandall and B.L. Bentzen at SKERI, working with UCSB geographers James Marston and Reginald Golledge, conducted multi-year field studies funded by the Federal Transit Administration and PATH/UCTC. At San Francisco's Powell Street Station, 35 of 36 blind participants successfully completed easy routes independently, with 24 completing medium and hard routes — including participants with only written instructions (no hands-on training). At street intersections, the improvement was dramatic: participants using Talking Signs began crossing during the Walk phase 99% of the time (vs. 66% without), started from within the crosswalk 97% of the time (vs. 70%), and needed help finding the crosswalk only 1% of the time (vs. 19%). One participant remarked that in Powell Station he was 'truly equal' to sighted travelers. The formal Steering Committee recommended RIAS as the 'preferred technology enabling print-handicapped persons to travel independently in transit facilities.' These findings directly informed the US Access Board's adoption of RIAS into building code ADAAG 703.7, which specifies the modulation frequency (25 kHz), wavelength range (850-950 nm), and optical power density (26 picowatts/mm² at receiver aperture) as federal requirements. * **Infrastructure Economics: Why the City Didn't All Speak.** Despite the proven effectiveness, Talking Signs never achieved universal deployment. SKERI's own assessment is candid: 'The question of who would pay for large-scale transmitter installation and receiver distribution proved insurmountable, and Talking Signs were never adopted broadly enough to make them a universal accommodation.' The capital cost of installing and maintaining hundreds of physical transmitters across a city — each requiring power, weatherproofing, and periodic re-recording — was a barrier that neither transit agencies nor city governments were willing to fund at scale. The 1995 Powell Street installation (93 transmitters, $300/sign for interior deployments) was funded by an FTA demonstration grant, not an operational budget. The receivers, at $250 each, also required distribution and maintenance. This infrastructure problem — brilliant interaction design undone by deployment economics — is a recurring theme in ambient and ubiquitous computing, and Talking Signs is one of its earliest and most instructive case studies. * **The Digital Afterlife: overTHERE (2016).** In 2016, Smith-Kettlewell scientist Joshua Miele — who is himself blind — released 'overTHERE,' a free iOS app that translates the Talking Signs interaction model into a software-only experience. Instead of physical infrared transmitters, overTHERE uses Google Places and OpenStreetMap data as 'virtual transmitters' and the iPhone's compass and GPS as a 'virtual receiver.' The user holds the phone flat and sweeps it around their body; as the phone points toward a nearby destination, that destination is announced through headphones or the speaker, with audio spatialization providing the same directional feedback as the original hardware. The app supports 20+ languages and is used by thousands of blind travelers daily worldwide — solving the infrastructure problem by piggybacking on a device users already carry. Miele developed overTHERE at a Google MakeAthon in 2015, where it won the Improved Mobility prize. The project page at SKERI notes that funding is being sought for a new version as of 2025. This 40-year arc — from modulated IR beams to smartphone compasses, from dedicated hardware to ubiquitous platforms — makes Talking Signs one of the longest continuously researched interaction models in HCI. ### Team * **William (Bill) Loughborough.** Original inventor (1979). Published 'Talking Lights' in the Journal of Visual Impairment & Blindness. Left SKERI to found Love Electronics, which commercialized the system. * **William (Bill) Crandall, PhD.** Principal investigator at SKERI's Rehabilitation Engineering Research Center. Led transit deployments and human-factors evaluations. Presented at CSUN 1998. * **Billie Louise (B.L.) Bentzen, PhD.** Co-investigator, Accessible Design for the Blind. Led intersection-crossing research. Co-authored the definitive Project ACTION transit guide (1995). * **William (Bill) Gerrey.** Editor of the Smith-Kettlewell Technical File. Designed receiver circuits and wrote the definitive Fall 1991 SKTF issue on Talking Signs. * **Dr. Erich Sutter.** Designed the first FM receiver for Talking Signs; chose FM modulation to reject ambient light interference. * **Albert Alden.** Designed front-end receiver circuitry and digital modulators. * **James Marston, PhD & Reginald Golledge, PhD.** UC Santa Barbara geographers. Led multi-year field experiments on campus, transit, and intersection deployments. Secured PATH/UCTC research grants. * **Joshua Miele, PhD.** SKERI scientist. Created Virtual Talking Signs project (2011) and the overTHERE iOS app (2016), continuing the Talking Signs lineage into the smartphone era. * **Smith-Kettlewell Eye Research Institute (SKERI).** San Francisco-based research institute focused on blindness and visual impairment. Home to the Talking Signs project for over 40 years. Published the SKTF and hosted the RERC program. ### Media ![Talking Signs handheld receiver and wall-mounted transmitter](../assets/wiki/talking-signs-1.jpg) *Talking Signs receiver (left) and wall-mounted infrared transmitter (right). (Smith-Kettlewell Eye Research Institute)* ### Sources 1. Wikipedia: Remote Infrared Audible Signage — https://en.wikipedia.org/wiki/Remote_infrared_audible_signage 2. SKTF Fall 1991 (complete issue): Talking Signs schematics, parts list, deployment guide — https://www.ski.org/sktf-fall-1991/ 3. SKERI: Talking Signs project page (40-year history) — https://www.ski.org/project/talking-signs/ 4. Crandall, Bentzen, Myers, Steed (1995): 'Talking Signs Remote Infrared Signage: A Guide for Transit Managers' (FTA Project ACTION) — https://ntlrepository.blob.core.windows.net/docs/95-0051-7.html 5. Crandall et al. (1999): 'Remote Infrared Signage Evaluation for Transit Stations and Intersections,' JRRD 36(4) — http://www.rehab.research.va.gov/jour/99/36/4/crandall.pdf 6. Crandall (1998): 'Talking Signs Remote Infrared Audible Signage,' CSUN 1998 Conference — https://www.dinf.ne.jp/doc/english/Us_Eu/conf/csun_98/csun98_063.html 7. Loughborough (1979): 'Talking Lights,' JVIB 73(6) — https://www.ski.org/publication/talking-lights/ 8. Brabyn & Brabyn (1983): 'An Evaluation of Talking Signs for the Blind,' Human Factors 25(1) — https://pubmed.ncbi.nlm.nih.gov/6840772/ 9. Marston & Golledge: UCSB RIAS research overview — https://people.geog.ucsb.edu/~marstonj/DIS/OVERVIEW.html 10. Marston & Golledge photos and illustrations — https://people.geog.ucsb.edu/~marstonj/PICTURES.html 11. SKERI: overTHERE app project page — https://www.ski.org/project/overthere/ 12. ADA Accessibility Guidelines (ADAAG) 703.7 — Remote Infrared Audible Sign Systems — https://www.access-board.gov/adaag-1991-2002.html --- ## Canon Cat (1987) **By:** Jef Raskin / Information Appliance Inc., manufactured by Canon Inc. **Tags:** `HCI` `Input` `Interface Paradigm` `Keyboard` `Text` `Computing` ### Overview The Canon Cat (model V777) was a task-dedicated desktop microcomputer released in July 1987 by Canon Inc., designed by Jef Raskin — Apple employee #31 and the initiator of the Macintosh project — through his Palo Alto company Information Appliance, Inc. It was the most complete commercial implementation of Raskin's radical interface philosophy: a text-centric, keyboard-driven computing appliance with no files, no applications, and no operating system in the conventional sense. All work occurred in a single unified document stream, navigated by content rather than by spatial position or hierarchical filing. Priced at $1,495 (~$4,200 in 2025), approximately 20,000 units were manufactured before Canon discontinued it after only six months. The Cat's defining interaction innovation was the LEAP system: two bright pink thumb keys below the spacebar. Holding a LEAP key and typing characters caused the cursor to jump in real-time to the nearest matching text — incremental search as the sole navigation mechanism. There was no mouse, no cursor keys, no menus, and no icons. Commands were issued via chorded key combinations using the USE FRONT key, and a hidden Forth programming environment lurked beneath the surface. The entire machine was a coherent argument about how humans and computers should relate — and it lost to the Macintosh, Windows, and the file-folder metaphor that Raskin himself helped set in motion. ### Deep dive * **Origins.** Jef Raskin joined Apple in 1978 as employee #31 and initiated the Macintosh project in 1979, naming it after his favorite apple variety. His vision was for a low-cost, keyboard-driven 'people's computer' — what he called PITS ('Person In The Street') — aimed at non-technical users at a $500 price point. When Steve Jobs took over the Macintosh project in 1981 and transformed it into a mouse-driven, graphically rich machine with a much higher price tag, Raskin left Apple in 1982 to pursue his own vision. He founded Information Appliance, Inc. (IAI) in Palo Alto and built the Swyft prototype (Motorola 68008-based), followed by the SwyftCard for the Apple IIe (1985, $89.95) as an interim product. IAI then licensed the full system to Canon Inc., which manufactured and marketed the Cat through its typewriter division — not its computer division. This organizational misalignment, combined with the 1987 Black Monday stock market crash (which caused IAI's investors to pull funding), doomed the product. Canon discontinued the Cat after just six months, allegedly due to internal politics between its professional and consumer divisions. * **The LEAP Navigation System.** The defining interaction innovation of the Canon Cat. Two bright pink LEAP keys sit below the spacebar — one for forward search, one for backward. To navigate anywhere in your document, you hold a LEAP key and begin typing. The cursor jumps in real-time to the nearest occurrence of those characters. Release the LEAP key, and you're positioned precisely where you wanted to be. This means you navigate by *content*, not by spatial position — you leap to remembered words or phrases rather than scrolling or clicking through a file hierarchy. Additional LEAP mechanics: LEAP + SHIFT scrolls the view. Tapping LEAP alone moves one character ('Creep'). Pressing both LEAP keys together highlights text between the cursor and the previously leapt location, which can then be moved by leaping again. LEAP + USE FRONT + 'Leap Again' finds the next occurrence of the same search term. A dedicated PAGE key handles page-by-page navigation and creating new blank pages. The genius is that there is exactly one mechanism, learned once, applied everywhere. Commands are found the same way as content — by leaping. There is no modal distinction between 'content mode' and 'command mode.' This is search-as-UI taken to its logical extreme, decades before Spotlight, Alfred, the browser omnibox, or command palettes. * **No Files, No Applications.** The Cat has no file system. No hierarchical folders. No Save or Open commands. All documents exist in a single persistent stream of text. You navigate by content (leaping to remembered words), by recency (the cursor returns to where you last were when you power on), and by time. Raskin's argument was that people remember what they wrote about and approximately when they wrote it — but do not reliably remember where they filed it. The machine should organize around human memory, not the other way around. There are also no separate applications. A built-in dictionary (90,000 words) checks spelling automatically. The CALC key performs calculations inline. Rows and columns function as a spreadsheet with formulas. An internal 300/1200 bps modem handles telecommunications — highlight text and press SEND to transmit. All of these capabilities are simply available everywhere, not locked inside separate programs. A hidden setting even unlocks a complete Forth programming environment. Users can type Forth code directly into a document, highlight it, and execute it via USE FRONT + ANSWER — output appears inline. Canon did not advertise this capability; IAI published programmer documentation openly. * **Modeless, Habit-Forming Interface.** Raskin was emphatically anti-modal — he believed that interfaces should never trap users in states where the same action produces different results depending on context. The Cat's keyboard has blue front-face labels on keycaps (visible when looking down at the keys). Holding the USE FRONT key activates these secondary functions as chords. Release USE FRONT, and the operation ends — no mode persists. There's also an EXPLAIN key (USE FRONT + N) that, when invoked after an error beep, inserts explanatory prose into your document rather than displaying a modal dialog box. Raskin's design principle was that interfaces should exploit human habit formation. With only one interaction paradigm to learn, the Cat could become second nature — muscle memory, not cognitive load. This philosophy, later codified in his book *The Humane Interface* (2000), was rooted in cognitive psychology: habits form best when a single stimulus always produces a single response. The Cat was engineered to be habit-forming. * **Hardware.** The Cat ran on a Motorola 68000 CPU at 5 MHz with 256 KB of DRAM and 256 KB of system ROM, written entirely in tForth ('token-threaded Forth'). Storage was a single 3.5-inch 256 KB floppy drive (custom Canon MD-3301). The 9-inch monochrome CRT displayed 672 × 344 pixels (80 × 24 characters). It weighed 17 pounds (7.7 kg). Raskin's original design called for no hard power switch — the Cat would remain in low-power sleep and wake instantly when you typed, capturing every keystroke even before the display fully lit. Canon engineers infamously added a hard power switch, believing its absence was an oversight. * **Commercial Fate and Legacy.** The Cat sold approximately 20,000 units — not nothing, but far short of what its ambitions demanded. Canon's typewriter division marketed it poorly; reviewers praised the interface but the market had already chosen WIMP interfaces. Ezra Shapiro's BYTE magazine review (October 1987) called it 'A Spiritual Heir to the Macintosh.' IAI closed in 1991 after investors pulled funding following the 1987 Black Monday crash. Raskin continued developing these ideas through his later Archy project (2005, originally 'The Humane Environment'). Today the Cat's influence echoes in unified workspace tools like Notion, Coda, and Roam Research; in the LEAP function recently added to the Left editor by Hundred Rabbits; and in every command palette and omnibox that lets users navigate by typing what they want. The Cat asked what computing would look like if content, not applications, was the organizing principle — and we are still answering that question. ### Team * **Jef Raskin.** Apple employee #31, initiator of the Macintosh project. Founded Information Appliance Inc. in 1982 after leaving Apple. Designed the Cat's entire interface philosophy. * **Information Appliance, Inc. (IAI).** Palo Alto company founded by Raskin. Developed the Swyft prototype and SwyftCard before licensing the full system to Canon. * **Canon Inc..** Manufactured and marketed the Cat through its typewriter division. Discontinued the product after 6 months. ### Media ![Canon Cat front profile](../assets/wiki/canon-cat-1.jpg) *Canon Cat V777 Work Processor. Source: Wikipedia (CC-licensed)* ![Close-up of Canon Cat keyboard showing pink LEAP keys](../assets/wiki/canon-cat-2.jpg) *The pink LEAP keys below the spacebar — the Cat's sole navigation mechanism. Source: OldComputers.net* ### Sources 1. Wikipedia — Canon Cat — https://en.wikipedia.org/wiki/Canon_Cat 2. Raskin Center — Canon Cat Manual & Documentation — https://raskincenter.org/jef/published/cat-manual/ 3. OldComputers.net — Canon Cat — http://www.oldcomputers.net/canon-cat.html 4. Old Vintage Computing Research — Refurb Weekend: Canon Cat (Cameron Kaiser, 2024) — https://oldvcr.blogspot.com/2024/05/refurb-weekend-canon-cat.html 5. Lee Byron — til/leap (LEAP interaction analysis) — https://leebyron.com/til/leap/ 6. Reproof Blog — The Canon Cat and the Mac that Steve Jobs Killed — https://www.reproof.app/blog/on-designing-a-more-humane-computer 7. BYTE Magazine, October 1987 — Ezra Shapiro review — https://archive.org/stream/byte-magazine-1987-10-rescan/1987_10_BYTE_12-11_Heuristic_Algorithms#page/n125/mode/2up 8. DigiBarn Computer Museum — Canon Cat collection — https://www.digibarn.com/collections/systems/canon-cat/index.html --- ## Puma RS Computer Shoes (1985) **By:** PUMA AG, designed by Dr. Peter Cavanagh and Heinz Gerhäuser **Tags:** `HCI` `Wearable` `Sensing` `Input` `Sports` `Foot-Mounted` ### Overview The PUMA RS-Computer ('Running System'-Computer Shoe) was a commercially released running shoe with an integrated computer module in the right heel, launched in spring 1985 at $200 USD (roughly $575 in 2025). Developed by sports biomechanics researcher Dr. Peter Cavanagh and microelectronics engineer Heinz Gerhäuser of the University of Erlangen, the shoe used a custom gate-array integrated circuit to measure the timing between successive right-foot ground contacts. Rather than counting steps like a pedometer, it used a stride-length profiling algorithm calibrated to each individual runner: as a runner runs faster, the time between footfalls decreases predictably, allowing the system to compute distance, speed, and caloric expenditure. The interaction ritual defined the product: press a button on the heel to start recording, run, press again to stop, then at any later time open a flap on the heel, connect a 16-pin serial cable to an Apple IIe, Commodore 64, or IBM PC printer port, and load the software from a 5.25-inch floppy disk to download and analyze the data. A 45-page manual and multiple-user support reflected the reality that personal computers were expensive shared resources. The shoe was a commercial failure — the market simply was not ready for body-worn activity tracking — but it anticipated every interaction pattern of modern fitness wearables by two decades. PUMA reissued it as a limited edition of 86 pairs with Bluetooth and a smartphone app in 2018. ### Deep dive * **Origins: Biomechanics Meets Microelectronics.** The RS-Computer originated from a challenge issued by PUMA CEO Armin Dassler (son of company founder Rudolf Dassler). Dassler wanted technological differentiation from rival Adidas — founded by his uncle Adolf Dassler after the brothers split the original Dassler shoe company following WWII. He told Cavanagh: 'Do whatever you have to do, but get me this high technology shoe. He didn't care what it was. He didn't care how much it cost.' Cavanagh, a PhD in human gait analysis from the University of London and a 2:45 marathoner, had become PUMA's sports science advisor after interviewing Dassler for his 1980 book *The Running Shoe Book*. His key insight was rejecting simple pedometers in favor of stride-length profiling: by measuring the timing between footfalls and calibrating to each runner's personal stride characteristics, the system could predict distance more accurately than step-counting. He collaborated with Gerhäuser, a microcomputer engineer at the University of Erlangen near PUMA headquarters, to build the custom gate array — roughly 600–1,000 transistors on a single chip — that served as the shoe's brain. The first prototype was a transparent Plexiglas box attached to the back of a conventional running shoe, with visible electronics inside. Cavanagh still owns this prototype. The infamous planning meeting brought German and American teams together on Catalina Island, California — helicoptered in at Dassler's expense. * **The Interaction Ritual.** Using the RS-Computer was a multi-step ritual that reveals the paradigms of mid-1980s personal computing. First came a one-time calibration: the runner visited a 400m track, ran multiple laps at increasing speeds while counting strides, and entered this data into the software to build their personal stride-length profile. For each run thereafter, the user pressed a button on the right heel to start recording, ran, then pressed it again to stop. At any later time — perhaps days later — they opened a protective flap on the heel, connected a 16-pin serial cable from shoe to computer printer port, loaded the software from a 5.25-inch floppy disk, and downloaded the run data. The software (written in Applesoft BASIC primarily for the Apple IIe) calculated distance, time, speed, and calories burned. It provided historical graphs by week, month, and year, allowed users to add comments to individual runs, and could program distance targets — the shoe would beep when the runner reached the goal. The manual was 45 pages long, which Cavanagh later described as 'a typical academic approach to a consumer product.' The shoe also supported multi-user setups, since a $1,000+ Apple IIe was often shared by an entire household or office. Only the right shoe contained active electronics; the left shoe had an identical plastic bump for symmetry but was empty. A flap-covered 16-pin serial connector port protected the data connection when running. * **Sensing Technology: Stride-Length Profiling.** Unlike modern step counters that simply tally impacts, the RS-Computer measured the elapsed time between successive right-foot ground contacts. Cavanagh's biomechanical research showed that as running speed increases, the time between footfalls decreases in a predictable, runner-specific way. By building a personal calibration curve — time-between-strides mapped to known running speeds from the track calibration — the system could extrapolate distance and speed from raw timing data with greater accuracy than pedometer-based approaches of the era. The custom gate array in the right heel processed these timing signals. A small LED served as a status indicator. The shoe could be programmed to beep when the runner reached a pre-set target distance — an auditory feedback mechanism that prefigured modern pace alerts. * **Commercial Fate.** The RS-Computer was a commercial failure. Running Magazine wrote: 'No person, however rich, should ever pay a hundred dollars for a pair of running shoes.' A Washington Post reviewer mocked Cavanagh's use of 'computer-ese' like 'interfacing compatibility' and 'user friendliness.' Sports Illustrated described the heel bulge as the shoe's 'crowning feature' and portrayed Cavanagh as a '2:45 marathoner with a Monkish aspect.' Several factors doomed it: $200 was extremely expensive for running shoes; personal computer ownership was not yet ubiquitous; the calibration ritual and 45-page manual created high friction; and the concept of self-tracking for fitness was, as Cavanagh later reflected, '15 to 20 years ahead of its time.' Nike conducted market research at the time that found 'no solid market for computerized shoes.' Cavanagh's 2018 reflection captures the bittersweet legacy: 'I'm a little regretful that the technology wasn't better accepted at the time and I think we could have short-circuited the activity tracking developments by perhaps 15 to 20 years.' In December 2018, PUMA reissued the RS-Computer as a limited edition of 86 individually numbered pairs (referencing 1986) at €650/~$740. The update replaced the gate array with a three-axis accelerometer and Bluetooth connectivity, added USB charging, and paired with an iOS/Android app featuring 8-bit retro graphics and a built-in retro game. Cavanagh called it 'a nice affirmation that it was a good idea whose time had not yet come.' * **HCI Significance.** The RS-Computer is a boundary object between footwear, sensing hardware, and personal computing. It is arguably the first body-worn, computer-connected activity tracker in history — preceding the Nike+iPod Sport Kit (2006) by two decades and Fitbit (2009) by nearly a quarter century. Every interaction pattern modern wearables take for granted was present in this 1986 shoe: start/stop recording, personal calibration, longitudinal data tracking, goal-setting with feedback, and data export to a computing platform. What was missing was the infrastructure to make it effortless — ubiquitous personal computing, wireless connectivity, automatic activity detection, and a cultural readiness for self-quantification. The RS-Computer was the right idea at the wrong time, and its failure illuminates how much of HCI success depends not on the interaction model itself but on the ecosystem surrounding it. Original units survive at the Bata Shoe Museum in Toronto, the DigiBarn Computer Museum, and the PUMA Archive in Herzogenaurach. Dr. Cavanagh still owns the original transparent-Plexiglas first prototype. ### Team * **Dr. Peter Cavanagh.** PhD in human gait analysis (University of London, 1968). Professor at Penn State, Cleveland Clinic, and University of Washington. PUMA's sports science advisor. Marathoner (2:45 PB). Developed the stride-length profiling algorithm. * **Heinz Gerhäuser.** Microelectronics engineer, University of Erlangen. Built the custom gate array integrated circuit that served as the shoe's processor. * **Armin Dassler.** Owner/CEO of PUMA AG, son of founder Rudolf Dassler. Issued the challenge to create a 'high technology shoe' with effectively unlimited resources. * **PUMA AG.** Herzogenaurach, West Germany. Athletic footwear company founded by Rudolf Dassler. The RS-Computer was the flagship product of the new Running System (RS) collection. ### Media ![Puma RS Computer Shoe connected to Apple IIe](../assets/wiki/puma-rs-computer-shoes-1.jpg) *Original RS Computer shoe with 16-pin serial cable connecting to an Apple IIe computer. Source: DigiBarn Computer Museum* ![Puma RS Computer Shoe on display](../assets/wiki/puma-rs-computer-shoes-2.jpg) *RS Computer Shoe on display at a museum collection. Source: Wikimedia Commons* ### Sources 1. PUMA Official — Dr. Peter Cavanagh Interview (March 2018) — https://about.puma.com/en/node/1750 2. Tech Briefs — How Fitness Wearables Began (April 2019) — https://www.techbriefs.com/component/content/article/34297-how-fitness-wearables-began-with-a-plug-in-sneaker 3. PUMA Official — History of RS — https://about.puma.com/en/this-is-puma/archive-stories/history-of-rs 4. Sports Illustrated Vault (May 13, 1985) — Contemporary review — https://www.si.com/vault/1985/05/13/622432/puma-is-off-and-running-into-the-computer-age-with-a-thinking-shoe 5. Wikipedia — RS-Computer — https://en.wikipedia.org/wiki/RS-Computer 6. Sneaker History — PUMA Built a Fitbit in 1986 — https://sneakerhistory.com/puma-built-a-fitbit-in-1986/ 7. DigiBarn Computer Museum — Computer Tennis Shoes — https://www.digibarn.com/collections/weirdstuff/computer-tennis-shoes/ 8. US Patent 4771394A — Computer shoe system — https://patents.google.com/patent/US4771394A/en --- ## VersaBraille (1979) **By:** Telesensory Systems Inc. (TSI), Mountain View, California **Tags:** `HCI` `Output` `Tactile` `Accessibility` `Braille` `Display` ### Overview The VersaBraille was the first American refreshable Braille display, introduced by Telesensory Systems Inc. (TSI) in December 1979. It was a portable, battery-powered device that combined a 20-cell refreshable Braille display, a Braille keyboard, and cassette-tape data storage into a single unit — functioning as a Braille notetaker, a reading machine, and a computer terminal via RS-232 serial interface. The display used piezoelectric bimorph reeds: tiny crystals that bend when voltage is applied, pushing pins up through holes to form Braille dots, and bending the opposite way to retract them. The same fundamental technology, first invented by Oleg and Andrée Tretiakoff in France for their 1976 Digicassette, still powers most Braille displays today. TSI was founded in 1970 by Stanford electrical engineering professor John Linvill and Stanford Research Institute researcher James C. Bliss. Their first product, the Optacon (1970), was a tactile imaging device that converted printed text into a vibrating pin array — but it reproduced letter shapes, not Braille. The VersaBraille was TSI's second major product and the first to give blind computer users direct, dynamic Braille access to electronic text. Weighing roughly 4 lbs and costing several thousand dollars, it became many blind people's first introduction to computing concepts in the United States. ### Deep dive * **Origins and the Tretiakoff Connection.** The piezoelectric Braille cell was invented by Oleg Tretiakoff, a Russian-born French inventor, working with his wife Andrée Tretiakoff in Paris. Their company ELINFA introduced the Digicassette in 1976 — the world's first commercially available paperless Braille machine. It used bimorphous piezoelectric reeds to raise and lower Braille dots, stored data on standard C-90 cassette tapes (300,000 Braille characters per tape — equivalent to a 220-page paperback), and supported RS-232 serial connection for computer terminal use. TSI co-founder Jim Bliss recounts in his AFB oral history that TSI was deeply impressed by the Digicassette. They brought Tretiakoff to California and tried to negotiate a distribution and manufacturing agreement. When the deal fell through, TSI launched its own research and development project to build an American version — which became the VersaBraille. The piezoelectric reed technology was very similar to what TSI had already developed for the Optacon's tactile array, giving them deep in-house expertise. The VersaBraille is thus a direct descendant of the Digicassette, adapted and refined by one of Silicon Valley's earliest assistive-technology companies. * **Interaction Mechanics: Three Modes in One Device.** The VersaBraille was a genuinely multi-modal device. In Notetaker mode, users entered text via the Braille keyboard (6 Braille dots + spacebar, electronic and sensitive to light touch) and stored it on cassette. In Reading Machine mode, they could read pre-recorded Braille documents on the 20-cell display. In Computer Terminal mode, the RS-232 serial port connected to desktop computers, modems, teletypewriters, and printers, allowing blind users to read screen output in Braille. The reading interaction was carefully designed. An advance bar along the top edge of the Braille line moved forward through text; a back-up key moved backward. Four navigation keys — Chapter, Page, Paragraph, and Word — were arranged by unit size (largest to smallest) for intuitive document traversal. A word search function could instantaneously scan an entire Braille page for any character string. A place indicator key reported the current chapter name, page number, and exact character position. Editing capabilities included deleting and inserting at the character, word, paragraph, page, and chapter levels, all through chorded key combinations. * **The Piezoelectric Braille Cell.** The core transducer that makes refreshable Braille possible. Each Braille cell contains 8 piezoelectric bimorph reeds (one per dot position). A piezoelectric crystal bends physically when voltage is applied — in one polarity, the reed curves upward, pushing a pin through a hole in the display surface to create a raised dot. Reverse the voltage, and the reed curves downward, retracting the pin. This electromechanical action happens silently and quickly enough for real-time reading. The VersaBraille's 20-cell display meant 160 individually addressable dots. Each cell could display any 8-dot Braille pattern. The 8-dot format (rather than traditional 6-dot Braille) allowed the bottom two dots to encode additional information like cursor position, capitalization, and formatting — making it suitable as a computer terminal where visual formatting cues needed tactile equivalents. The same piezoelectric principle, refined over decades, still dominates the Braille display market. Modern devices like the Orbit Reader and HumanWare BrailleNote use the same fundamental transducer mechanism — a rare case in HCI where a 1970s invention remains essentially unchanged. * **TSI and Silicon Valley Accessibility.** Telesensory Systems represented an unusual fusion of Stanford engineering, Silicon Valley entrepreneurship, and disability rights. John Linvill, the company's co-founder, had a blind daughter — his motivation was deeply personal. Jim Bliss brought expertise in tactile perception from Stanford Research Institute. The company employed top Silicon Valley talent (Stanford PhDs and MBAs), had Canon as an investor and distributor, and operated with the ambition of a tech startup — but its mission was accessibility. The Optacon had already established TSI's credibility. For the first time, blind people could read any printed document independently — not just Braille books, but mail, newspapers, labels, and handwritten notes. The VersaBraille extended this independence into the digital realm. TSI went bankrupt in March 2005 (Chapter 7), but its legacy shaped five decades of assistive technology. * **Museum Holdings and Legacy.** Several original VersaBraille units survive in museum collections. The American Printing House for the Blind (APH) Museum in Louisville, Kentucky holds multiple units including the VersaBraille system (accession 1995.1) and a VersaBraille II+. The Múzeum špeciálneho školstva in Levoča, Slovakia holds a VersaBraille P2D (1979 model). The Deutsches Museum in Munich exhibits the BRAILLEX prototype — the parallel German development by F.H. Papenmeier GmbH (1975, piezoelectric version by 1979), which received the Louis Braille Prize. Refreshable Braille remains one of computing's most profound assistive technologies. For blind programmers, writers, students, and knowledge workers, the ability to read screen output in real time through touch was — and remains — transformative. The VersaBraille was the device that first made this possible at personal-computer scale. ### Team * **Oleg and Andrée Tretiakoff.** French inventors who patented the piezoelectric Braille cell (1975) and created the Digicassette (1976), the world's first paperless Braille machine. * **Dr. John G. Linvill.** Stanford electrical engineering professor. Co-founded TSI in 1970. Father of a blind daughter — his motivation was deeply personal. * **Dr. James C. Bliss.** Stanford Research Institute researcher specializing in tactile perception. Co-founded TSI with Linvill. Led the VersaBraille development after the Tretiakoff deal fell through. * **Telesensory Systems Inc. (TSI).** Mountain View, CA company founded 1970. Created the Optacon (1970) and VersaBraille (1979). Employed top Silicon Valley talent. Filed Chapter 7 bankruptcy in 2005. ### Media ![VersaBraille system with Braille display and keyboard](../assets/wiki/versabraille-1.jpg) *VersaBraille system, ca. 1982. A 20-cell refreshable Braille display with Braille keyboard and cassette storage. Source: APH Museum* ![VersaBraille P2D model from 1979](../assets/wiki/versabraille-2.jpg) *VersaBraille P2D (1979 model), showing the 20-character display and RS-232 interface. Source: Múzeum špeciálneho školstva, Levoča, Slovakia* ### Sources 1. APH Blog — Blindness History Basics: Refreshable Braille Display — https://www.aph.org/blog/blindness-history-basics-a-brief-history-of-the-refreshable-braille-display/ 2. AFB Oral History — Jim Bliss (TSI co-founder), Part 2 — https://www.afb.org/blindness-and-low-vision/using-technology/interviews-technology-pioneers/jim-bliss/part-2-4-5700 3. APH Museum — VersaBraille System (Object 1995.1) — https://sites.aph.org/museum-virtual-exhibit/vex2/A8918B72-511E-44D5-841D-383803736892.htm 4. Duxbury Systems — VersaBraille Owner's Manual, Volume 1 — https://www.duxburysystems.org/downloads/library/texas/apple/cnthesis/versabr.htm 5. Papenmeier Rehatechnik — History Page — https://www.papenmeier-rehatechnik.de/en/history/ 6. US Patent 4,305,067 — Tretiakoff piezoelectric Braille cell — https://www.freepatentsonline.com/4305067.html 7. Wikipedia — Telesensory Systems — https://en.wikipedia.org/wiki/Telesensory_Systems 8. Wikipedia — Refreshable Braille Display — https://en.wikipedia.org/wiki/Refreshable_braille_display --- ## DataHand Keyboard (1990) **By:** DataHand Systems, Inc. / Industrial Innovations (inventor: Dale J. Retter) **Tags:** `HCI` `Input` `Keyboard` `Ergonomic` `Accessibility` ### Overview The DataHand is an unconventional computer keyboard introduced by DataHand Systems, Inc. in 1990, designed to eliminate wrist motion and finger extension entirely. Each of the user's five fingers rests in an individual padded well containing five magnetic switches: press down (center), or nudge north, south, east, or west. The layout maps approximately to QWERTY — pressing 'up' with the left four fingers types QWER, while pressing 'down' (center press) types ASDF. Thumb clusters handle mode switching between letters, numbers/symbols, and function/mouse modes. The keys use magnets for return action (not springs) and optical sensors for activation, requiring only about 1mm of movement and minimal force. The two hand units split apart and can be positioned independently. The system was developed through the late 1980s by Dale Retter at Industrial Innovations (Scottsdale, Arizona), presented at the 1989 Human Factors Society annual meeting, and brought to commercial production in 1990. DataHand Systems marketed the keyboard primarily to computer users suffering from repetitive strain injury and carpal tunnel syndrome. ### Deep dive * **Origins.** Dale J. Retter invented the DataHand to address his own repetitive strain injury. The concept was developed through Industrial Innovations of Scottsdale, Arizona, with early prototypes dating to 1989. The first public presentation was at the Human Factors Society 33rd Annual Meeting in 1989, where Leland Knight presented a paper on the 'Design, Potential, Performance, and Improvements in the Computer Keyboard and Mouse.' A follow-up evaluation by William Ferrill appeared in Advances in Industrial Ergonomics and Safety in 1992, providing independent assessment. DataHand Systems, Inc. was formally founded in 1985 and began manufacturing in 1990. The original model, later designated the DH200, used magnetically-held keys with optical sensors — a deliberately low-force mechanism designed to minimize finger fatigue. * **Interaction Model.** Each finger-well has five magnetic switches (center + N/S/E/W) actuated by sub-millimeter finger movements. This requires no wrist movement and almost no finger extension — the hands remain completely stationary on palm rests. The keyboard is split into left and right units that can be positioned and angled independently. The layout approximates QWERTY: the home row is accessed by center-presses, the row above by upward nudges, and the row below by downward nudges. Sideways nudges access columns normally reached by lateral finger movement (e.g., G and H). Three thumb-activated mode keys switch between: Normal mode (letters), Numbers/Symbols mode, and Function/Mouse mode (which lets the same finger movements control a cursor). The Pro II model added macro recording. Learning the DataHand takes approximately one month of dedicated practice to reach normal typing speed. An industrial evaluation by Ferrill (1992) found the design promising for reducing cumulative trauma disorders. * **Hardware.** The keyboard uses magnetic key return — each key is held in its neutral position by small magnets, and optical sensors (opto-interrupters) detect when a key has been moved from neutral. This eliminates conventional springs and allows very low activation force. Each finger-well cluster is individually adjustable for finger length and palm size. The two hand units connect via a 15-pin serial-style cable. The DH200 model (1990-1995) had a distinctive sculpted beige shell. Later models included the Personal (non-programmable) and Professional II (with macro recording). The keyboard does not function in direct sunlight (optical sensors are ambient-light-sensitive) and requires periodic cleaning to prevent dust from blocking the sensors. DataHand also sold a 'DataChair' — an office chair with DataHand keyboard halves mounted on the armrests — for $1,600. * **Legacy.** The DataHand achieved cult status among ergonomic keyboard enthusiasts and RSI sufferers. It appeared in films including Contact (1997, as spaceship controls) and Stormbreaker (2006), and on TV's Mighty Morphin Power Rangers. DataHand Systems ceased manufacturing in 2008 due to supplier issues, but the design has inspired multiple open-source recreations: the DodoHand (2013, 3D-printed), the lalboard (2019, 3D-printable with hand-solderable PCBs), and the Svalboard (2023, small-run production including trackpoint and trackball options). The DataHand remains a touchstone in ergonomic keyboard design — proof that the QWERTY keyboard can be rethought at the level of individual finger biomechanics. ### Team * **Dale J. Retter.** Inventor of the DataHand concept, developed to address his own RSI * **Industrial Innovations (Scottsdale, AZ).** Company that developed the early DataHand prototypes (1989-1991) * **DataHand Systems, Inc..** Company founded 1985 to manufacture and market the DataHand keyboard * **Leland Knight.** Presented the DataHand design paper at the 1989 Human Factors Society meeting * **William Ferrill.** Author of independent ergonomic evaluation of DataHand (1992) ### Media ![Overhead view of DataHand keyboard showing both hand units with finger wells](../assets/wiki/datahand-keyboard-1.jpg) *Overhead view of DataHand keyboard units providing full computer keyboard and mouse functionality. Photo by Datahandfan, CC BY-SA 3.0, via Wikimedia Commons.* ![Right hand unit of a DataHand Professional II keyboard showing finger wells](../assets/wiki/datahand-keyboard-2.jpg) *The right-hand unit of a DataHand Professional II keyboard, showing five finger wells and thumb controls. Photo via Wikimedia Commons.* ### Sources 1. Wikipedia: DataHand — https://en.wikipedia.org/wiki/DataHand 2. Octopup.org: Detailed DataHand owner review with historical photos of 1989-1991 prototypes by Dale Retter and Industrial Innovations — https://octopup.org/computer/datahand 3. Knight & Retter, 'DataHand: Design, Potential, Performance, and Improvements in the Computer Keyboard and Mouse', Human Factors Society 33rd Annual Meeting, 1989 — https://octopup.org/img/computer/datahand/19890000--DataHand--Design-Potential-Performance-and-Improvements-in-the-Computer-Keyboard-and-Mouse--Leland-Knight.pdf 4. Ferrill, 'Preliminary Test and Evaluation of DataHand', Advances in Industrial Ergonomics and Safety IV, 1992 — https://octopup.org/img/computer/datahand/1992--DataHand--Advances-in-Industrial-Ergonomics-and-Safety--William-Ferrill.pdf 5. Industrial Innovations DataHand Informational Prospectus, 1990 — https://octopup.org/img/computer/datahand/1990--Datahand--Industrial-Innovations--Informational-Prospectus.pdf 6. Microsoft Buxton Collection: DataHand entry — https://www.microsoft.com/buxtoncollection/detail.aspx?id=75 7. Hackaday: 'Inputs Of Interest: The Differently Dexterous DataHand' (2020) — https://hackaday.com/2020/04/20/inputs-of-interest-the-differently-dexterous-datahand-directionalizes-digits/ --- ## The Drawing Prism (1985) **By:** Richard Greene **Tags:** `HCI` `Input` `Art` `Drawing` `Optical` ### Overview The Drawing Prism is an optical direct-drawing computer input device presented by Richard Greene at SIGGRAPH 1985. It uses a large transparent prism as a drawing surface. A video camera underneath views the surface at an angle where it can only image the points of optical contact between drawing tools and the surface — a principle known as frustrated total internal reflection (FTIR). A layer of transparent liquid helps tools make optical contact. The camera output is digitized and processed in real time, building up a drawing in the frame buffer as the artist moves tools along the surface. Any light-colored object — brushes, fingers, palette knives — can be used. The result is a device that bridges traditional artistic technique with digital image creation, allowing continuously adjustable line qualities, textures, and effects that conventional computer input devices of the era could not produce. ### Deep dive * **Origins and Principle.** Richard Greene developed the Drawing Prism to solve a specific problem: artists using computer graphic input devices could not produce the same visual effects achievable with traditional tools and media. The device uses one face of a large transparent prism as a drawing surface. A video camera views that surface from below at an angle such that it can only image points of optical contact — where a drawing tool touches the surface, it frustrates the total internal reflection, creating a visible point of light. These images are digitized and processed in real time, building up a drawing. The user sees the accumulating image on a monitor. A layer of transparent liquid (such as mineral oil) between the tool and the glass ensures reliable optical contact. The device was presented at SIGGRAPH 1985 in San Francisco. * **Interaction Model.** The artist works on the glass surface with any light-colored object: traditional brushes, their fingers, a rag for smudging, a palette knife. The system sees where and how hard the tool presses based on the size and intensity of the contact point. Unlike a graphics tablet, there is no stylus — the artist's actual brushwork is captured directly. Line width, opacity, and texture vary naturally with tool pressure, angle, and speed, exactly as in traditional painting. The artist sees the result accumulating on a monitor as they work on the glass. This creates a unique feedback loop: the physical sensation of brush-on-glass corresponds directly to marks appearing on screen. The paper describes combinations of visual effects 'previously restricted to either traditional media or computer graphics.' * **Technical Implementation.** The system uses a transparent prism with a video camera positioned underneath, viewing the drawing surface at an angle that exploits frustrated total internal reflection. Light-colored objects in optical contact with the surface appear as bright spots against a dark background. A real-time digitizer processes the camera signal and writes to a frame buffer. The SIGGRAPH paper details the optical geometry, the choice of camera (RCA TC 2000 series), and suggestions for improving resolution. Greene notes that Robert E. Mueller was awarded U.S. Patent #3,846,826 in 1974 for a similar FTIR-based direct drawing system using a flying-spot scanner and photomultiplier instead of a camera — an independent prior invention using the same optical principles. * **Legacy.** The Drawing Prism anticipated FTIR-based multi-touch screens by roughly 20 years — the same optical principle underlies many modern multi-touch tables and interactive surfaces. The idea of painting directly into a computer with real brushes predates digital painting tablets (Wacom) and multi-touch drawing apps by decades. A live performance using the Drawing Prism, 'Technological Feets' by Javril, Tannenbaum, Greene, and Schier, was presented at the SIGGRAPH '84 Electronic Theater. Ed Tannenbaum also used the technology in a permanent exhibit at the Exploratorium in San Francisco (1982). The work bridges HCI, computer graphics, and fine art in a way that few devices from any era do. ### Team * **Richard Greene.** Inventor and author of the SIGGRAPH 1985 paper * **Ed Tannenbaum.** Artist who used the Drawing Prism technology in Exploratorium exhibit and SIGGRAPH '84 performance * **Robert E. Mueller.** Awarded U.S. Patent #3,846,826 (1974) for a prior FTIR-based direct drawing system using different hardware ### Media ![SIGGRAPH 1985 paper title slide for The Drawing Prism](../assets/wiki/drawing-prism-1.jpg) *The Drawing Prism paper title from SIGGRAPH 1985 Technical Papers. From ACM SIGGRAPH History Archives.* ### Sources 1. ACM Digital Library: Greene, 'The Drawing Prism: A Versatile Graphic Input Device', SIGGRAPH 1985 — https://doi.org/10.1145/325334.325202 2. SIGGRAPH History Archive: The Drawing Prism paper entry with abstract and references — https://history.siggraph.org/learning/the-drawing-prism-a-versatile-graphic-input-device-by-greene/ 3. U.S. Patent #3,846,826: Mueller, 'Direct Television Drawing and Image Manipulating System' (1974) — prior FTIR art — https://patents.google.com/patent/US3846826A/ 4. SIGGRAPH '84 Electronic Theater: 'Technological Feets' by Javril, Tannenbaum, Greene, Schier (live FTIR performance) — https://history.siggraph.org/experience/technological-feets-by-javril-et-al/ --- ## MBX Expansion System (1983) **By:** Milton Bradley (Mike Langieri, lead designer) **Tags:** `HCI` `Input` `Voice` `Gaming` `Speech` ### Overview The MBX Expansion System was a gaming peripheral for the TI-99/4A home computer, released by Milton Bradley in late 1983 and discontinued within months due to the 1984 video game crash. It combined three distinct interaction modalities into one package: a voice-recognition headset that trained on the user's voice to understand spoken game commands; a 360-degree analog joystick with proportional control and a twist knob for object rotation; and a 64-key membrane action keypad with swappable game overlays. The system also included a built-in speech synthesizer superior to Texas Instruments' own. On startup, users trained the voice system by speaking displayed words; thereafter, spoken English commands like 'Fire!', 'Climb!', or 'Dive!' controlled the game. The MBX was originally designed as a standalone Milton Bradley game console to compete with the Atari 2600, but was repurposed as a TI-99/4A peripheral after MB's president killed the console project. Only about 10 game cartridges were ever produced, and fewer than a dozen titles supported its unique features. ### Deep dive * **Origins.** The MBX began life in 1982 as Milton Bradley's answer to the Atari 2600 and Mattel Intellivision — a standalone game console built around voice recognition. MB planned to differentiate with voice input, speech synthesis, and a unique controller. The project was led by Mike Langieri. When ColecoVision entered the market, MB president Jim Shea decided the market could not support four consoles and killed the project. Langieri was then tasked with finding a use for the developed technology. The system was retooled as an add-on for the TI-99/4A, a computer for which MB had already developed games and whose graphics chip (TMS9918) MB had some connection to. The MBX was demoed at the January 1983 CES to lines of waiting attendees. Atari was so impressed they entered an agreement for MB to produce an equivalent system called the Voice Commander for the Atari 2600 and 5200, though this deal eventually fell apart. * **Interaction Model.** The MBX offered three simultaneous interaction modes. Voice: A headset with adjustable boom microphone fed speech into a recognition system. Before each game, the user trained the system by speaking displayed words; the system created a voice model and then recognized spoken commands during play. Different games used different vocabulary. The joystick: A pistol-grip controller with 360-degree analog directional control (not limited to 8 positions), proportional speed (faster stick movement = faster on-screen action), a twist knob on top for continuous object rotation, and four buttons (three on the back plus a trigger under the lever). The keypad: A 64-button membrane surface with swappable plastic overlays specific to each game, providing labeled one-touch commands. None of the cartridges used ALL the MBX facilities, and the joystick was never fully utilized by software. * **Hardware.** The MBX unit was effectively a second computer that used the TI-99/4A for game storage and video display. It contained a 6809 CPU running at 6 MHz and a General Instrument SP1000 (GI8335) speech synthesis chip. It connected to the TI-99/4A via the joystick port and cassette port, using a custom serial protocol. It had its own 9V DC power supply. The headset featured padded ear rests (not headphones — they were purely for comfort) and a boom microphone that could be positioned 1–2 inches from the mouth. The joystick used analog sensing for position and speed. The system was manufactured from approximately September to November 1983 (control numbers MB8309–MB8311). * **Legacy.** The MBX's joystick design lived on: a simplified version (without the twist knob or analog control) became the Atari Space Age Joystick and was also marketed by MB as the HD2000 Joystick. The voice-training paradigm — speak displayed words to calibrate the system — presaged modern voice assistant setup routines by decades. Barry Boone later produced assembly code allowing Extended Basic programmers to access the MBX's facilities. About 10 cartridge titles were released, including Championship Baseball (the flagship), Space Bandits, Bigfoot, Sewermania, and Terry Turtle's Adventure. The system remains a cult object among TI-99/4A collectors and an extraordinary what-if in gaming history: a voice-controlled game console killed by market timing. ### Team * **Mike Langieri.** Lead designer, creator of the MBX concept, designer of the MBX joystick and several game titles * **Dave Winzler.** Co-developer, worked with Langieri on Championship Baseball * **Tim Scully.** Programmer of Honey Hunt * **Milton Bradley Company.** Toy/game manufacturer, developed the system at their electronics division * **Barry Boone.** TI-99/4A community developer who created Extended Basic CALL LINKs for the MBX ### Media ![1983 MBX promotional flyer showing the complete system with headset and joystick](../assets/wiki/mbx-expansion-system-1.jpg) *1983 Milton Bradley MBX promotional flyer (side 2), showing the system unit, headset, joystick, and game screenshots. Scan by Benj Edwards, Vintage Computing and Gaming.* ![1983 MBX promotional flyer showing the MBX and TI-99/4A setup](../assets/wiki/mbx-expansion-system-2.jpg) *1983 Milton Bradley MBX promotional flyer (side 1), showing the complete system in use with the TI-99/4A. Scan by Benj Edwards, Vintage Computing and Gaming.* ### Sources 1. TI-99/4A Videogame House: MBX History (extensive history from creator Mike Langieri) — https://www.videogamehouse.net/mbx.html 2. Ninerpedia: MBX technical details and cartridge list — https://ninerpedia.org/wiki/MBX 3. Vintage Computing and Gaming: Retro Scan of MBX flyer by Benj Edwards — https://www.vintagecomputing.com/index.php/archives/1337/retro-scan-milton-bradley-mbx-for-ti-994a 4. Rob Patton's MBX Page (screenshots, reviews, cartridge images) — http://www.robpatton.com/ti_mbx.htm 5. AtariHQ: Milton Bradley's Voice Commander and Atari lawsuit — http://www.atarihq.com/2678/3party/mbradley.html --- ## Pencept PenPad (1982) **By:** Pencept, Inc. (Waltham, Massachusetts) **Tags:** `Pen Computing` `Handwriting Recognition` `Gesture` `Input` `Terminal` ### Overview The Pencept PenPad was a keyboardless computer terminal introduced in 1982 that replaced the keyboard with a digitizing tablet and electronic pen. Unlike simple drawing tablets, the PenPad performed real-time, user-independent handwriting recognition and interpreted pen gestures as editing commands. It was built on a proprietary "functional attribute model" of character recognition developed at MIT by Barry Blesser, Robert Shillman, and Ted Kuklinski—an approach that described characters by their perceptually meaningful visual features rather than template matching. The PenPad 200 (1982) operated as a direct VT-100 terminal replacement, connecting via RS-232 to host minicomputers and mainframes. The PenPad 320 (1984, $1,495) targeted IBM PC/DOS users, emulating keyboard, mouse, and digitizing tablet simultaneously so existing applications like Lotus 1-2-3 and WordStar could be operated by pen. Both models pioneered gesture commands that are familiar today: circle to select, scribble to delete, caret to insert. Pencept demonstrated the PenPad at CHI '83 and CHI '85, where the technical video "Software Control at the Stroke of a Pen" showed real-time handwriting and gesture recognition. Despite the technical achievement, the company could not build a large enough market. It merged with Numonics Corporation in 1987 and the technology faded into obscurity—a full decade before pen computing would be reborn with the PalmPilot and Apple Newton. ### Deep dive * **Origins.** Pencept, Inc. was founded in 1980 in Waltham, Massachusetts, building on research from MIT's character recognition group. Barry Blesser, an MIT professor, had developed the "functional attribute model" of character recognition with PhD student Robert J. Shillman and researcher Ted Kuklinski. Their 1976 paper "Empirical Tests for Feature Selection Based on a Psychological Theory of Character Recognition" (Pattern Recognition, Vol. 8) established that characters could be classified by perceptually meaningful structural features—how humans read characters rather than how they write them. This made the recognition user-independent: no per-user training was needed. Blesser held fundamental patents including US 4,375,081 for multistage digital filtering of tablet input. * **How It Worked.** The PenPad used an electromagnetic digitizing tablet that captured pen-tip X,Y coordinates at a periodic rate. Pre-processing removed noise and retrace artifacts (US Patent 4,608,658 by Jean Renard Ward). The recognition engine extracted dynamic features including stroke direction, order, and functional relationships between elements, then matched them against a skeletal model of character structure. Unlike template-matching approaches used by competitors, the functional attribute model separated "embellishments" from the base stroke structure, making it robust across handwriting styles. Gesture recognition interpreted specific pen movements as commands: circling text to select it, scribbling over text to delete it, drawing arrows to indicate movement, and drawing carets to mark insertion points. The PenPad 320 could transparently emulate keyboard input for unmodified DOS applications via US Patent 4,562,304. * **Commercial Fate.** The PenPad 320 was priced at $1,495 (about $4,300 in 2024 dollars). It was marketed to CAD/CAM users, data entry operators, and spreadsheet users who could benefit from direct pen interaction. Despite favorable coverage and demonstration at CHI and Comdex, the market for pen computing was too small. The installed base of keyboard-and-mouse PCs was growing explosively, and handwriting recognition was not solving a pressing need for most users. Pencept lacked the resources to develop a custom operating system (unlike GO Corp's later PenPoint) and could only overlay existing keyboard-driven applications. The company merged with Numonics Corporation on May 14, 1987, and its technology was absorbed and eventually discontinued. * **Impact.** The PenPad pioneered several interaction concepts now taken for granted: gesture commands for text editing, user-independent handwriting recognition, and mixed-mode pen input (simultaneous pointing, writing, and gesturing). While Pencept failed commercially, the ideas resurfaced in the GRiDPad (1989), GO Corp.'s PenPoint OS, Microsoft Windows for Pen Computing, the Apple Newton (1993), and the PalmPilot (1997). The gesture vocabulary—circle to select, scribble to delete—directly anticipated the gestural interfaces of iOS and Android two decades later. The PenPad stands as evidence that the core ideas of pen computing were technically viable a full decade before the market was ready to receive them. ### Team * **Barry Blesser.** MIT professor; developed the functional attribute model of character recognition; held foundational Pencept patents * **Robert J. Shillman.** MIT PhD (1974); his thesis on phenomenological character attributes provided the theoretical basis; later founded Cognex Corporation * **Ted Kuklinski.** MIT researcher; co-author of the 1976 Pattern Recognition paper with Blesser and Shillman * **Andrew Nilsson.** Director of Marketing at Pencept; demonstrated PenPad at CHI '85 * **Jean Renard Ward.** Engineer at Pencept; co-inventor on retrace artifact removal and keyboard emulation patents; later maintained the comprehensive pen computing bibliography at ruetersward.com ### Media ![Pencept PenPad 200 terminal with digitizing tablet and stylus](../assets/wiki/pencept-penpad-1.jpg) *The PenPad 200, a keyboardless terminal replacement with handwriting recognition (1982). Source: Wikipedia / Jean Renard Ward* ### Sources 1. Wikipedia: Pencept — https://en.wikipedia.org/wiki/Pencept 2. Jean Renard Ward: History of Pen Computing — http://users.erols.com/rwservices/pens/penhist.html 3. Jean Renard Ward: Annotated Bibliography of Pen Computing — http://users.erols.com/rwservices/pens/biblio83.html 4. CHI '85 Video: Software Control at the Stroke of a Pen — https://web.archive.org/web/20070607011443/http://open-video.org/details.php?videoid=8023 5. Blesser, Shillman, Kuklinski 1976: Empirical Tests for Feature Selection — https://doi.org/10.1016/0031-3203(76)90036-4 6. US Patent 4,562,304: Keyboard Emulation for Handwriting Terminal — https://www.freepatentsonline.com/4562304.html 7. US Patent 4,375,081: Multistage Digital Filtering (Blesser) — https://www.freepatentsonline.com/4375081.html --- ## Synapse Relax Stress Reduction System (1984) **By:** Synapse Software (Richmond, California) **Tags:** `Biofeedback` `Physiological Computing` `Wearable` `Health` `EMG` ### Overview The Relax Stress Reduction System was a multi-component biofeedback package for home computers, released in 1984 by Synapse Software—a company better known for arcade-style action games like Blue Max, Shamus, and Alley Cat. The system included an elastic EMG (electromyography) headband with three sensors that pressed against the forehead's frontalis muscle, a control unit that amplified and conditioned the microvolt-level muscle signals, and software on floppy disk or cassette for the Atari 8-bit, Commodore 64, Apple II, and IBM PC platforms. The software offered three modes: a real-time scrolling tension graph, a kaleidoscopic biofeedback display that shifted from soothing blue-green patterns to jagged red-orange shapes as tension increased, and a balloon-flying game where relaxing made the balloon float higher and tensing made it descend—subtle changes earned more points, training users to recognize fine gradations of stress. A 25-minute guided relaxation audiocassette and a workbook by clinical psychologist Dr. Martha Davis completed the package. The entire system received FDA 510(k) clearance (K841128) as a Class II neurological biofeedback device in July 1984—an extraordinary achievement for a consumer software company. Yet Synapse Software was collapsing financially due to a disastrous Atari inventory dispute and was acquired by Broderbund later that same year. Relax became one of the rarest computer peripherals ever produced, with very few complete boxed copies known to survive. ### Deep dive * **Origins.** Synapse Software was founded in 1981 by Ihor Wolosenko and Ken Grant in Richmond, California. The company built a reputation for technically polished, visually striking Atari 8-bit action games. By 1984, Synapse was diversifying into productivity software (SynCalc, SynFile+) and looking for new markets. Relax represented the company's audacious bet that home computers could be wellness devices—a product category that would not truly arrive for another 25 years. The project brought together three unlikely collaborators: Kelly Jones (programmer of the Atari game Drelbs), Bill Williams (the legendary designer of Necromancer and Alley Cat, who later created groundbreaking Amiga titles like Mind Walker), and Dr. Martha Davis, a clinical psychologist at Kaiser Permanente who wrote the workbook and helped design the stress-profiling methodology. * **How It Worked.** The EMG headband positioned three sensors against the user's forehead to detect electrical activity in the frontalis muscle—a reliable indicator of general tension. When muscles contract, they generate microvolt-level electrical potentials. The control unit amplified and conditioned these signals, then fed them into the computer through the joystick port (on Atari/C64) or game controller adapter (on IBM PC). The software interpreted the analog signal strength as a continuous 'tension level.' A variable sample rate allowed both momentary stress-spike detection and long-term baseline monitoring. The balloon game's scoring deliberately rewarded subtle tension changes over dramatic ones, training users to perceive fine bodily cues. The headband could also substitute for paddle controllers in other Synapse games like Chicken. * **Commercial Fate.** Relax launched at $139.95 (about $420 today) at the worst possible moment. Atari Inc., under new owner Jack Tramiel, refused to pay Synapse for approximately 40,000 already-shipped software units, plunging the company into financial crisis. Synapse was acquired by Broderbund in late 1984, and the label was retired within a year. Relax became a Rarity 9 item on AtariMania—fewer than a handful of complete boxed copies are known. One is preserved at The Strong National Museum of Play in Rochester, New York, donated by Broderbund co-founder Doug Carlston. A complete unit with headband hardware remains one of the great white whales of retro computing collecting. * **Impact.** Relax was simultaneously ahead of its time and a product of its era. It anticipated the consumer biofeedback wearables that would explode in the 2010s (Muse, NeuroSky, Fitbit's stress tracking), yet it was built for 8-bit home computers with joystick-port interfaces. The FDA clearance—an extraordinary regulatory achievement for a game company—validated the concept of the home computer as a therapeutic platform. Bill Williams, who co-created it, would go on to make some of the most visually and mechanically inventive Amiga games before leaving the industry, attending seminary, and dying of cystic fibrosis at age 37. His involvement gives Relax a human story as compelling as its technical ambition. ### Team * **Kelly Jones.** Atari 8-bit programmer at Synapse; created Drelbs (1983); co-designed Relax as programming lead * **Bill Williams.** Legendary game designer (Necromancer, Alley Cat, Mind Walker); co-designed Relax; later left industry for seminary; died of cystic fibrosis at 37 in 1998 * **Dr. Martha Davis.** Clinical psychologist at Kaiser Permanente; wrote Relax workbook and guided relaxation audio; co-author of The Relaxation and Stress Reduction Workbook * **Synapse Software.** Publisher founded 1981 by Ihor Wolosenko and Ken Grant; known for Atari 8-bit action games; acquired by Broderbund 1984 ### Media ![Relax Stress Reduction System box cover showing the EMG headband and software](../assets/wiki/relax-stress-reduction-1.png) *The Relax box cover, showing the EMG headband and software. Source: Wikipedia* ![Relax balloon game screenshot on Atari 8-bit](../assets/wiki/relax-stress-reduction-2.gif) *The balloon game: relax to float higher, tense up to descend. Source: AtariMania* ![Synapse Relax Stress Reduction System](../assets/wiki/relax-stress-reduction-3.gif) *Synapse Relax Stress Reduction System archival image.* ### Sources 1. Wikipedia: Relax (software) — https://en.wikipedia.org/wiki/Relax_(software) 2. COMPUTE! Magazine Issue 60 (May 1985) Review — https://www.atarimagazines.com/compute/issue60/185_1_REVIEWS_Relax_Stress_Reduction_System.php 3. FDA 510(k) K841128 Clearance — https://fda.innolitics.com/device/K841128 4. AtariMania: Relax entry with manual, screenshots, audio — https://www.atarimania.com/game-atari-400-800-xl-xe-relax_4336.html 5. Google Arts & Culture: The Strong Museum artifact — https://artsandculture.google.com/asset/computer-software-atari-400-800-and-commodore-64-relax-the-stress-reduction-system/jAHGLomqi-qOAw 6. Bill Williams biography (The Digital Antiquarian) — http://www.filfre.net/2016/01/bill-williams-the-story-of-a-life/ 7. COMPUTE! Issue 50 (July 1984) Product Announcement — https://www.atarimagazines.com/compute/issue50/293_1_NEWS_PRODUCTS_Stress_Reduction_Software.php --- ## Exciting Boxing Controller (1987) **By:** Konami (developed by Human Entertainment) **Tags:** `Game Controller` `Full-Body Input` `Motion Gaming` `Pressure Sensor` `Famicom` ### Overview The Exciting Boxing Controller was an inflatable humanoid punching bag peripheral for the Nintendo Famicom, released by Konami in December 1987. Bundled with the game cartridge *Exciting Boxing* (RC250), this was a dedicated single-game controller: a life-sized vinyl boxer you inflated with an included foot pump, weighted with two liters of water in the base, and then physically punched to control the on-screen fighter. Inside the bag were 11 pressure sensors—five on the left side, five on the right, and one at the top—that registered punch location. The controller connected to the Famicom via its 15-pin expansion port through a control box at the base. A green plastic mat extended from the base for the player to stand or kneel on, anchoring the unit against the force of punches. The included knitted gloves completed the ensemble. The game itself was structured as a boxing RPG: players trained to build stats, then fought through seven opponents across weight classes, using a password system to save progress. Konami's marketing called it a "sweat-body Famicom" (汗体ファミコン), explicitly positioning gaming as a physical, embodied activity. The peripheral was Japan-only, priced at ¥7,980, and sold in an enormous 60cm-wide box that was impractical for both retail shelving and Japanese home storage. It was a commercial failure and is extremely rare today—complete-in-box examples are believed to number in single digits. ### Deep dive * **The Interaction Model.** Using the Exciting Boxing Controller meant transforming your living room into a boxing gym. You first had to inflate the bag with the foot pump, pour two liters of water into the base to prevent it from flying across the room, don the knitted gloves, and stand on the mat. Then you punched. The 11 internal pressure sensors detected punch location—left jab triggered a left jab on screen, right hook triggered a right hook—but there was no movement control. The bag only read punches; you couldn't make your fighter dodge or move. In practice, the sensors were notoriously unreliable: a 2019 hands-on review reported hits registering only "sometimes." The bag itself fell over frequently, especially from hard hooks, interrupting gameplay while you set it upright again. The setup process alone—inflation, water, mat positioning—was so involved that a full play session required substantial commitment before the first punch was thrown. * **Origins.** The game was developed by Human Entertainment (株式会社ヒューマン), a Japanese studio founded in 1983 that would later become famous for the Fire Pro Wrestling series. Human's wrestling and boxing expertise made them a natural fit for this project. Konami published it as part of their "Exciting" sports series, which included Exciting Soccer and Exciting Basket. Intriguingly, Konami also produced Top Rider (1988), an inflatable motorcycle peripheral for the Famicom, suggesting a brief corporate flirtation with inflatable game controllers during Japan's bubble economy—a period when consumer electronics companies could afford to take wild risks on strange hardware. Exciting Boxing was developed exclusively for the Famicom, not as an arcade port, which was unusual for Konami at the time. * **Technical Architecture.** The controller communicated state as two nibbles (4 bits each) read through the Famicom's standard controller port protocol. The cartridge PCB used Konami's VRC-1 mapper chip (iNES Mapper 75) with 128KB of PRG ROM and 128KB of CHR ROM. First production run date codes indicate November 1987 manufacturing. The MAME emulator team added preliminary support in 2021 (PR #8817), though the device is flagged as having 'imperfect' emulation due to incomplete understanding of the sensor logic. The sensors appear to be binary contact/pressure switches rather than analog force sensors—they detected WHERE you hit, not HOW hard. The game handled opponent dodging and evading contextually, animated based on missed punches or timing rather than player input. * **Why It Failed.** The Exciting Boxing Controller failed for reasons that read like a checklist of early HCI challenges: the enormous box was a retail nightmare; setup was laborious and required physical effort before any gameplay; the sensors were unreliable; the bag fell over; the ¥7,980 price was high for a single-game peripheral; storage was impractical; the player looked ridiculous; and the physical exertion limited session length. These are essentially the same problems that would face full-body gaming systems decades later—Kinect's reliability issues, Wii Fit Board's setup friction, VR's social awkwardness. Konami was trying to solve problems of embodied interaction in 1987 that the industry still hasn't fully solved. ### Team * **Human Entertainment.** Developer of the Exciting Boxing game software; founded 1983, later famous for the Fire Pro Wrestling series * **Konami Corporation.** Publisher and hardware manufacturer; at its 1987 creative peak with Castlevania, Metal Gear, and Contra ### Media ![Exciting Boxing Controller box contents: inflatable bag, game cartridge, gloves, foot pump, mat](../assets/wiki/exciting-boxing-1.jpg) *Full contents of the Exciting Boxing set, including the deflated bag, cartridge, knitted gloves, foot pump, and green mat. Source: NintendoSegaJapan (2019)* ![Person physically punching the inflatable Exciting Boxing Controller](../assets/wiki/exciting-boxing-2.jpg) *A player demonstrates the full-body punching interaction—the bag's 11 pressure sensors translate punch location into on-screen boxing moves. Source: NintendoSegaJapan (2019)* ![Exciting Boxing Controller](../assets/wiki/exciting-boxing-3.jpg) *Exciting Boxing Controller archival image.* ### Sources 1. FamicomWorld: Exciting Boxing Controller review and photos — https://famicomworld.com/system/controllers/exciting-boxing/ 2. NintendoSegaJapan: Complete hands-on with the working hardware (2019) — https://nintendosegajapan.com/2019/12/09/exciting-boxing-with-inflatable-controller/ 3. FamicomDo (Japanese): History and gameplay analysis — https://famicomdo.com/2021/08/08/exciting-boxing/ 4. MAME PR #8817: Emulation support with sensor documentation — https://github.com/mamedev/mame/pull/8817 5. NesCartDB: PCB, ROM, and date code data — https://nescartdb.com/profile/view/4601/exciting-boxing 6. GAMEX (Japanese): Retrospective review and score — https://gamex.jp/famicom-title/3009 7. NesDev Wiki: Exciting Boxing Punching Bag technical reference — https://www.nesdev.org/wiki/Exciting_Boxing_Punching_Bag --- ## Interactive Brainwave Visual Analyzer (IBVA) (1991) **By:** Psychic Lab Inc. (Masahiro Kahata) **Tags:** `BCI` `EEG` `Wearable` `Brainwave` `MIDI` `Macintosh` ### Overview The Interactive Brainwave Visual Analyzer (IBVA)—also branded as "amuwa"—was a commercially sold, wireless EEG-based brain-computer interface that first shipped in April 1991. Developed by Masahiro Kahata through his company Psychic Lab Inc. in New York, the IBVA was among the earliest consumer BCI products ever brought to market, predating the modern neurotech industry by nearly two decades. The hardware consisted of a fabric headband with three dry-contact electrodes placed on the forehead (no conductive gel required), connected to a battery-powered amplifier and radio transmitter worn on the body. A receiver box connected to the Macintosh serial port, giving the user roughly 30 feet of wireless mobility. The Mac software performed real-time Fast Fourier Transform (FFT) analysis on two EEG channels—left and right prefrontal cortex—decomposing brainwave activity into Delta, Theta, Alpha, Beta, and Gamma frequency bands. These brainwave metrics could be output as MIDI notes (left/right brain power mapped to note and velocity), serial ASCII data for external device control, QuickTime movie control, or visualizations including 3D waterfall spectral displays. An AppleScript interface and MAX/MSP external made the IBVA accessible to artists and musicians building custom interactive experiences. The system also included a camcorder audio-track recording feature, allowing synchronized brainwave recording alongside video for field research—which Kahata famously used to record EEG inside crop circles in the UK. ### Deep dive * **Origins.** Masahiro Kahata (born 1951, Muroran, Hokkaido, Japan) began building brainwave interface systems in 1973, using analog and early digital electronics. By 1978–1980 he was visualizing brainwaves on Apple II and Rockwell computers. In 1984, he publicly demonstrated brainwave-controlled mouse drawing at Sapporo City Education Culture Hall using a Mac 128K, Apple II, and Rockwell computer—nineteen participants drew images using only brainwave switching. He spent 1985–1987 as Chief Researcher at ASCII Laboratories (a division of ASCII Corporation, Japan's leading computer publisher), then incorporated Psychic Lab in Sapporo in 1988. Development of IBVA as a commercial product began with Tokyo-based hardware partner Random Electronics Design. Kahata moved to New York in 1989, working with American Biotech on Mac-based biofeedback systems before incorporating Psychic Lab Inc. in March 1991 and shipping IBVA V1.0.1 the following month. * **How Brainwaves Became Computer Control.** The sensor headband captured microvolt-level EEG signals from the prefrontal cortex. A low-noise DC-coupled differential amplifier boosted the signal for radio transmission. On the Mac, the IBVA software performed FFT analysis (up to 8192-point, 0.015 Hz resolution) to decompose the continuous EEG into frequency bands. Multiple output modes were available: Brain Peak MIDI mapped left/right brainwave power peaks to MIDI note and velocity; Brain Rhythm MIDI sent continuous rhythmic EEG data; Brain Switches allowed users to set 8 configurable thresholds per channel (left, right, and coherence), enabling up to 128 discrete brain-triggered events. A competitive game mode called BrainFighter pitted two users' brainwaves against each other or against recorded sessions. The system's default bandwidth of 0.16–40 Hz at 120 Hz sampling captured all major EEG bands, while the programmable hardware could run at up to 1920 Hz sampling covering 0–900 Hz. * **Artists, Musicians, and the Venice Biennale.** The IBVA found its most visible use in the art world. Japanese artist Mariko Mori collaborated with Kahata to create *waveUFO* (2003–2011), an interactive brainwave installation where three participants entered a UFO-shaped pod and their synchronized brainwaves controlled real-time 3D animations. The work toured globally, appearing at the Venice Biennale (2005), Public Art Fund New York, and museums in Brazil, Denmark, and Austria. Other artists included Neam Cathode (Jean Décarie), who created *Cyber Mondrian* (2001) using brainwave-controlled Mondrian-like visuals and synthesized sound at Montréal's Oboro Gallery; Paras Kaul ("Brain Wave Chick"), who composed brainwave music at George Mason University; and UK artist Luciana Haill, who became the official EU/UK IBVA distributor and used the system in dreamachine EEG installations and augmented reality works. On the commercial side, HBO used the IBVA in 1993 to measure audience engagement with TV programming—finding, as New Scientist reported, that gritty documentaries triggered high brain response while a Michael Jackson concert generated almost none. * **Thirty Years and Counting.** The IBVA is extraordinary not just for when it started but for how long it lasted. The product evolved continuously from Mac System 6 through Mac OS 9, Mac OS X, Intel, and Apple Silicon—over thirty years of ongoing development. It added Bluetooth (2006), Quartz Composer visual plugins, GarageBand Audio Unit brainwave filters, an iPhone app (BrainDJVJ, 2009), and eventually open-source extensions including the brain-duino project (2014) and MAX/MSP externals. It won Best of Show at MacWorld New York in 1998 and was covered by Mondo 2000, Electronic Gaming Monthly, Popular Mechanics, New Scientist, and The Guardian. In 2000–2001, Sony America commissioned Psychic Lab to develop a brainwave gaming interface, though the project was cancelled after September 11, 2001. ### Team * **Masahiro Kahata.** Founder of Psychic Lab; developed brainwave interfaces continuously from 1973; former Chief Researcher at ASCII Laboratories Japan; incorporated Psychic Lab Inc. in New York (1991) * **Random Electronics Design.** Tokyo-based hardware design partner for the original IBVA hardware (1988–2002) * **Luciana Haill.** UK artist and official IBVA EU/UK distributor (2009–present); visiting research fellow at Centre for Computational Neuroscience and Robotics, Sussex University ### Media ![Person wearing the IBVA EEG headband with three forehead electrodes](../assets/wiki/ibva-1.jpg) *The wireless EEG headband with three dry-contact forehead electrodes—no conductive gel needed. Source: ibva.com (2003)* ![IBVA software interface showing real-time brainwave spectral analysis on Macintosh](../assets/wiki/ibva-2.jpg) *The IBVA Mac software displaying 3D waterfall spectral analysis of left and right hemisphere EEG data, with MIDI mapping controls. Source: psychiclab.net* ![Interactive Brainwave Visual Analyzer (IBVA)](../assets/wiki/ibva-3.jpg) *Interactive Brainwave Visual Analyzer (IBVA) archival image.* ### Sources 1. Psychic Lab: Original IBVA system (1991) — http://www.psychiclab.net/IBVA/OriginalIBVA.html 2. Psychic Lab: Masahiro Kahata profile and development history — http://www.psychiclab.net/IBVA/development1983.html 3. Psychic Lab: IBVA technical specifications — http://www.psychiclab.net/IBVA/Specifications.html 4. New Scientist (March 6, 1993): Brain waves show that Michael Jackson is no thriller — https://www.newscientist.com/article/mg13718633-800-technology-brain-waves-show-that-michael-jackson-is-no-thriller/ 5. eContact! 14.2: Andrew Brouse on forty years of brainwave music — http://www.econtact.ca/14_2/brouse_brainwavemusic.html 6. BCI Wiki: IBVA Interactive Brainwave Visual Analyser — https://bciwiki.org/index.php?title=IBVA:_Interactive_Brainwave_Visual_Analyser 7. IBVA UK / BrainMachine: Luciana Haill distribution and documentation — https://ibvabrainmachine.wordpress.com/about-2/measuring-eeg/hardware/ --- ## CAVE Automatic Virtual Environment (1992) **By:** Carolina Cruz-Neira, Daniel J. Sandin, Thomas A. DeFanti — Electronic Visualization Laboratory (EVL), University of Illinois at Chicago **Tags:** `HCI` `VR` `Display` `Immersive` `Room-Scale` ### Overview The CAVE Automatic Virtual Environment was the first room-scale, projection-based immersive VR system, developed at the Electronic Visualization Laboratory (EVL) at the University of Illinois at Chicago and first demonstrated at SIGGRAPH 1992. It was the PhD dissertation of Carolina Cruz-Neira. The name is a recursive acronym and a reference to Plato's allegory of the cave — an explicit meditation on perception, illusion, and reality. The CAVE was a 10 ft × 10 ft × 9 ft cube. Three walls used rear-projection and the floor used front-projection, with high-resolution CRT projectors casting stereoscopic images onto each surface. The user wore active stereo LCD shutter glasses synchronized with the projectors, and a Polhemus electromagnetic tracker followed head position so the computer could render the scene from the correct perspective in real time. A wand with 3 buttons and a pressure-sensitive joystick provided navigation and manipulation input. Unlike head-mounted VR systems of the era, the CAVE let users walk naturally within the room, see their own hands and bodies, and collaborate with 3–4 other people who could see one another's facial expressions and gestures. The system ran on four Silicon Graphics workstations networked together. The demonstration at SIGGRAPH 1992 showed a real-time molecular dynamics visualization and an architectural walkthrough. The CAVE spawned hundreds of installations worldwide and established a paradigm of immersive display that remains influential today. ### Deep dive * **Origins.** The CAVE was Carolina Cruz-Neira's PhD dissertation at the University of Illinois at Chicago, under advisors Thomas DeFanti and Dan Sandin. DeFanti and Sandin had co-founded EVL in the 1970s as a pioneering computer graphics and video art lab. Cruz-Neira's insight was that head-mounted displays — the dominant VR paradigm of the late 1980s — were isolating, uncomfortable, and limited in field of view. She proposed turning the room itself into the display. * **Interaction Model.** The CAVE's defining interaction paradigm was 'bring your own body.' Users walked into the cube unencumbered — no HMD, no cables dragging from their head. The tracked viewpoint rendered correct perspective from wherever they stood, supporting natural proprioceptive walking within the 10-foot volume. A hand-held wand provided 3-button interaction. Multiple users could share the space simultaneously, seeing each other's real bodies inside the virtual environment — a form of co-located collaboration that HMD systems could not match. This was neither desktop computing nor head-mounted VR; it was a third category: room as interface. * **Technical Architecture.** The original CAVE used four Electrohome Marquee 8000 CRT projectors (one per surface), active stereo LCD shutter glasses, and Polhemus electromagnetic tracking. Four Silicon Graphics VGX workstations — one master and three rendering slaves — were synchronized via Ethernet networking and hardware genlock. The software framework was written in C with OpenGL and later formalized as the CAVELib API. The frame was built from non-magnetic wood to avoid interference with the electromagnetic tracker. The whole system cost roughly a million dollars. * **Legacy.** The CAVE design became a standard in VR labs worldwide. Hundreds of CAVE and CAVE-like installations were built at universities, engineering companies, and museums throughout the 1990s and 2000s. It spawned derivative systems: the ImmersaDesk (single-screen drafting table format), the Infinity Wall (large conference-room display), and eventually CAVE2 (2012, a 320-degree cylindrical LCD-panel system also from EVL). Carolina Cruz-Neira received the IEEE VGTC Virtual Reality Technical Achievement Award in 2007 and was elected to the National Academy of Engineering in 2018. ### Team * **Carolina Cruz-Neira.** Lead inventor. The CAVE was her PhD dissertation. Now at University of Central Florida. National Academy of Engineering (2018). * **Daniel J. Sandin.** Co-inventor, video artist and physicist. Co-founded EVL. Designed projection geometry and image processing. * **Thomas A. DeFanti.** Co-inventor, PhD advisor to Cruz-Neira. Co-founded EVL. Computer graphics pioneer (created GRASS language). * **Robert V. Kenyon.** Co-author on original CACM 1992 paper. Contributed psychophysics and human factors expertise. * **John C. Hart.** Co-author on original CACM 1992 paper. Contributed rendering algorithms. ### Media ![User inside the CAVE with a colorful virtual environment projected on three walls and floor](../assets/wiki/cave-1.jpg) *A user inside the CAVE at EVL, surrounded by a virtual environment called 'Crayoland.' The image shows three rear-projected walls and a front-projected floor creating a fully immersive space. Source: Wikimedia Commons (public domain).* ![CAVE installation at Ars Electronica Center showing the projection cube](../assets/wiki/cave-2.jpg) *A CAVE installation at the Ars Electronica Center (1996), showing the projection cube and a user interacting with the virtual environment. Source: Wikimedia Commons.* ### Sources 1. Cruz-Neira et al., 'The CAVE: Audio Visual Experience Automatic Virtual Environment,' Communications of the ACM, June 1992 — https://doi.org/10.1145/129888.129892 2. Wikipedia: CAVE Automatic Virtual Environment — https://en.wikipedia.org/wiki/Cave_automatic_virtual_environment 3. Wikipedia: Carolina Cruz-Neira — https://en.wikipedia.org/wiki/Carolina_Cruz-Neira 4. EVL Publications Archive (1992–1993) — https://www.evl.uic.edu/pubs/year/1992/ 5. DeFanti, Sandin, Cruz-Neira, 'A Room with a View,' IEEE Spectrum, October 1993 — https://doi.org/10.1109/6.237582 6. Johnson et al., 'Electronic Visualization Laboratory's 50th Anniversary Retrospective,' PRESENCE, 2024 — https://doi.org/10.1162/pres_a_00421 --- ## Virtual Fixtures (1992) **By:** Louis Rosenberg — USAF Armstrong Labs, Wright-Patterson Air Force Base (with Stanford Center for Design Research and NASA Ames) **Tags:** `HCI` `Augmented Reality` `Haptic` `Exoskeleton` `Teleoperation` ### Overview Virtual Fixtures was the first functional, immersive augmented reality system ever built. Developed in 1992 at Wright-Patterson Air Force Base by Louis Rosenberg, it overlaid virtual 3D objects onto a user's real-world environment and provided force feedback through a full upper-body exoskeleton — proving for the first time that computer-generated perceptual overlays could dramatically enhance human performance in dexterous manual tasks. The core concept was elegantly physical: just as a ruler guides a pencil to draw a straight line, a 'virtual fixture' — a computer-generated surface or cone registered in 3D space — could guide a user's real hand movements with greater speed and accuracy than freehand work. Users wore an exoskeleton covered in sensors and motors, gripped a metal peg, and looked through binocular magnifiers suspended from the ceiling. In their view, virtual cones, barriers, and guide surfaces were overlaid on the real workspace. When their hand contacted a virtual surface, motors in the exoskeleton physically resisted — the sensation of bumping into a solid object that did not exist. The project was pitched by Rosenberg to the Human Sensory Feedback Group of Armstrong Laboratory in 1991 while he was a Stanford doctoral candidate. The system filled half a room and used nearly $1 million worth of 1992-vintage hardware. Because computer graphics of the era were too slow to render photorealistic AR, Rosenberg devised an ingenious workaround: two real physical robots were controlled by the exoskeleton, and their live camera feeds were merged to create the spatially registered mixed-reality view. This was augmented reality before the term existed — Rosenberg called them 'perceptual overlays' added to a user's 'ambient reality.' ### Deep dive * **Origins.** Louis Rosenberg was a doctoral student at Stanford's Center for Design Research in 1991 when he pitched the Virtual Fixtures concept to the USAF Armstrong Labs. The military motivation was teleoperation — controlling robots at a distance for hazardous tasks. But Rosenberg's insight was that virtual guides overlaid on the real workspace could make humans better at precision work than either humans alone or robots alone. He worked simultaneously across three institutions: Armstrong Labs (where the full system was assembled), NASA Ames (depth perception and vision research), and Stanford (VR gloves, immersive vision, 3D audio). * **The Exoskeleton and Haptics.** The upper-body exoskeleton was a mechanical framework covered in sensors, motors, gears, and bearings. It provided full 6-DOF tracking of the user's arms and hands, plus kinesthetic force feedback: motors physically pushed back when the user's hand contacted a virtual surface. Virtual fixtures rendered included rigid surfaces (preventing overshoot), guiding cones (funneling pegs into target holes), 'magnetically attractive' surfaces (peg snaps to alignment), textured surfaces with corresponding sounds, and viscous resistance — simulating pushing through 'virtual honey.' This was computational haptics combined with augmented vision years before either term was in common use. * **The Vision System.** Because 3D computer graphics in 1992 were far too primitive to produce photorealistic AR overlays, Rosenberg devised a workaround. The system used two physical robots controlled by the exoskeleton, with video cameras feeding a pair of binocular magnifiers. The optics were configured so the remote robot arms appeared registered at the exact location of the user's real arms. Virtual overlays were then merged into this pass-through video feed, creating the convincing illusion of virtual objects occupying real space. The cameras themselves were salvaged from a failed parachute test rig — six destroyed in a crash, and Rosenberg pieced together two working units from the wreckage. * **Legacy.** The Fitts's Law peg-insertion tests produced the first empirical proof that AR could enhance real-world task performance — over 100% improvement in speed and dexterity. Rosenberg's 1992 technical report (AL-TR-0089) and 1993 IEEE VR paper established the conceptual framework for virtual guides and constraints still used today in robot-assisted surgery systems (da Vinci), satellite repair telerobotics, and hazardous-environment teleoperation. In 1993, Rosenberg founded Immersion Corporation to commercialize haptic feedback; Immersion's technology is now in most smartphones and gaming controllers. He holds over 300 patents and the Virtual Fixtures work is widely recognized as the origin point for both the modern AR industry and the consumer haptics industry. ### Team * **Louis Barry Rosenberg.** Sole researcher and inventor. PhD candidate at Stanford during the project. Later founded Immersion Corp (1993), MicroScribe 3D (1996), Unanimous AI (2014). 300+ patents. * **Larry John Leifer.** Rosenberg's PhD advisor at Stanford Center for Design Research. * **USAF Armstrong Labs.** Human Sensory Feedback Group provided funding and facilities at Wright-Patterson AFB. * **NASA Ames Research Center.** Advanced Displays and Spatial Perception Lab — Rosenberg conducted depth perception research here. ### Media ![Louis Rosenberg in the Virtual Fixtures exoskeleton, 1992, peering into binocular vision system](../assets/wiki/virtual-fixtures-1.jpg) *Louis Rosenberg testing the Virtual Fixtures system at Wright-Patterson AFB in 1992. He wears the upper-body exoskeleton and looks through the binocular magnifier vision system suspended from the ceiling. Source: Louis Rosenberg / Wikimedia Commons (CC-BY-SA 4.0).* ![Virtual fixtures overlaid on a Fitts's Law pegboard showing virtual cones and guide surfaces](../assets/wiki/virtual-fixtures-2.jpg) *The Virtual Fixtures workspace: virtual cones and guide surfaces registered to a real pegboard for the Fitts's Law dexterity tests. This photograph shows the actual 1992 test setup. Source: Louis Rosenberg / Wikimedia Commons (CC-BY-SA 4.0).* ![1991 concept drawing showing Virtual Fixtures applied to augmented surgery](../assets/wiki/virtual-fixtures-3.jpg) *Original 1991 concept art by Rosenberg showing Virtual Fixtures applied to surgical augmentation — a virtual medical fixture guiding a real scalpel. Source: Louis Rosenberg / Wikimedia Commons (CC-BY-SA 4.0).* ### Sources 1. Rosenberg, 'The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments,' USAF AL-TR-0089, 1992 — https://apps.dtic.mil/dtic/tr/fulltext/u2/a292450.pdf 2. Rosenberg, 'Virtual Fixtures: Perceptual Tools for Telerobotic Manipulation,' IEEE VR 1993 — https://doi.org/10.1109/VRAIS.1993.380795 3. Louis Rosenberg, 'How a Parachute Accident Helped Jump-start Augmented Reality,' IEEE Spectrum, 2022 — https://spectrum.ieee.org/history-of-augmented-reality 4. Wikipedia: Virtual Fixture — https://en.wikipedia.org/wiki/Virtual_fixture 5. Wikipedia: Louis B. Rosenberg — https://en.wikipedia.org/wiki/Louis_B._Rosenberg 6. Louis Rosenberg personal site: Virtual Fixtures (1991–1994) — https://sites.google.com/view/louisrosenberg/virtual-fixtures-1991-1994 --- ## Vectrex 3D Imager (1983) **By:** John Ross / Smith Engineering / General Consumer Electronics (GCE) / Milton Bradley **Tags:** `HCI` `3D Display` `Gaming` `Electromechanical` `Stereoscopic` `Consumer Hardware` ### Overview The Vectrex 3D Imager was a stereoscopic 3D headset peripheral for the GCE/Milton Bradley Vectrex home console — the first commercially released 3D gaming peripheral in history. Rather than using LCD shutters or electronics in the headset, it used a DC motor spinning a translucent disk directly in front of the wearer's eyes. Half the disk was opaque black; the other half was divided into 60-degree transparent red, green, and blue wedges. The Vectrex 6809 CPU synchronized the disk rotation to its vector-drawing frame rate using PWM motor control, drawing six alternating sub-frames (left-eye RGB, right-eye RGB) per rotation. Each eye saw a slightly different perspective, and the brain fused them into a color stereoscopic 3D image — all from a monochrome vector CRT. Invented by John Ross at Smith Engineering/Western Technologies (who also conceived the Vectrex itself), the 3D Imager was demonstrated at the June 1983 CES and released in limited quantities in early 1984 for $50 — just as the Vectrex was being discontinued after Milton Bradley lost $31.6 million on the console during the 1983 video game crash. Only about 2,000-3,000 units were produced, and just three games were released: 3D Mine Storm (bundled), 3D Narrow Escape, and 3D Crazy Coaster. Sega later had to retract advertisements for their SegaScope 3D (1987) that claimed to be the world's first 3D gaming system — the Vectrex 3D Imager had beaten them by four years. ### Deep dive * **Origins.** John Ross, a hardware designer at Western Technologies / Smith Engineering, conceived the 3D Imager after designing the original Vectrex concept in 1980 from a surplus 1-inch CRT. Jay Smith (founder of Smith Engineering, previously designer of the Mattel Microvision in 1979) headed the project. The prototype housing was reportedly built from recycled View-Master casework. Gerry Karr designed the Vectrex's computer and vector generator; John Hall wrote the built-in game Mine Storm; Tom Sloper coined the 'Vectrex' name. * **How it works.** The 3D Imager plugs into the second controller port. A small DC motor spins the filter disk at roughly 1,800-2,200 RPM. The disk is divided into a 180° opaque black half and a 180° half segmented into 60° red, green, and blue transparent wedges. As the disk spins, only one eye at a time sees the screen, and each eye sees through a different color filter in sequence. The Vectrex compares its software frame rate to an once-per-revolution index signal from the Imager, dynamically adjusting motor power via PWM to keep the disk phase-locked. For stereo depth, each object is drawn at least twice from slightly different angles — the angular displacement determining perceived depth in front of or behind the screen plane. The system produces 15-18 full stereo frames per second per eye. * **Patent.** US Patent 4,630,767, assigned to Ross/Smith Engineering, covers the spinning filter disk and synchronization mechanism. The approach is field-sequential color stereoscopy — the same principle as the CBS field-sequential color television system of the 1940s, miniaturized into a gaming peripheral. * **Reception and failure.** John C. Dvorak reported from CES 1983: "You put on some weird spinning glasses, and when you look at the screen, you see a full-color, 3-D image." But by the time it shipped in early 1984, the Vectrex was already dead — destroyed by the 1983 crash, $31.6M in losses, and a price slashed from $199 to $100. Users complained the spinning disk created a gyroscopic effect resisting head movement, causing nausea. Only three games were produced. Today boxed units sell for $500-900+ among collectors. * **Legacy.** Sega was forced to pull its 'world's first 3D gaming' advertising for SegaScope 3D (1987) after the Imager's prior existence was pointed out. Modern active-shutter 3D glasses use the same alternating-eye principle. A homebrew community (madtronix, Fury Unlimited) built replacement imagers and new games in the 2000s. ### Team * **John Ross** — Hardware designer. Invented the Vectrex 3D Imager (and the Vectrex itself). Designed optics, motor drive, and sync electronics. * **Jay Smith** — Founder of Smith Engineering / Western Technologies. Previously designed the Mattel Microvision (1979). Project lead. * **Gerry Karr** — Vectrex computer and vector generator design, system ROM (RUM). * **John Hall** — Early system ROM, wrote built-in game Mine Storm. * **Tom Sloper** — Named the Vectrex; game designer, created the Spike mascot. * **Walter Nakano and Colin Vowles** — Industrial design and model building. * **Bill Hawkins** — Programmed key Vectrex games (Bedlam, Star Castle, Cosmic Chasm). * **Duncan Muirhead** — Trigonometry routines for the RUM system ROM. * **Manufacturer** — General Consumer Electronics (GCE) / Milton Bradley Company. ### Media ![Vectrex 3D Imager headset, showing the spinning filter disk housing](../assets/wiki/vectrex-3d-imager.jpg) *The Vectrex 3D Imager headset, showing the motorized spinning filter disk housing. Source: Wikimedia Commons (CC BY-SA 3.0).* ![Vectrex console set with controller, showing the monochrome vector CRT](../assets/wiki/vectrex-console-set.jpg) *The Vectrex console with controller, showing the monochrome vector CRT the 3D Imager transformed into full color. Source: Wikimedia Commons.* ### Sources 1. Wikipedia: Vectrex (3D Imager section) — https://en.wikipedia.org/wiki/Vectrex#3-D_Imager 2. Vectrex Museum — 3D Imager page — http://vectrexmuseum.com/vectrex-3D-imager.html 3. Vectrex Museum — History (full team credits) — http://vectrexmuseum.com/vectrexhistory.html 4. Gamasutra — A History of Gaming Platforms: The Vectrex (Barton & Loguidice, 2007) — https://www.gamedeveloper.com/design/a-history-of-gaming-platforms-the-vectrex 5. Popular Science, November 1983 — "What's New in Electronics" (p. 116) — https://books.google.com/books?id=EpSrYt9lFLMC&pg=PA116 6. InfoWorld, July 4, 1983 — John C. Dvorak CES report — https://books.google.com/books?id=yy8EAAAAMBAJ&pg=PA33 7. Patent US 4,630,767 — Ross/Smith Engineering 3D display system — https://patents.google.com/patent/US4630767A/ 8. Electronic Games, September 1984 — "Farewell To Vectrex" (Joyce Worley) — https://archive.org/details/electronic-games-magazine-1984-09/ --- ## Soundbeam **By:** Edward Williams / Robin Wood / EMS (Electronic Music Studios) **Tags:** `HCI` `Sonar` `Music` `MIDI` `Gestural` `Accessibility` `Embodied` ### Overview Soundbeam is a touch-free MIDI controller that uses ultrasonic sonar to translate body movement into music. A performer moves within an invisible cone of 50 kHz sound projected into a space; the system measures distance, speed, and direction of movement and converts these into MIDI messages driving any synthesizer, sampler, or DAW. No wearables, no controllers, no physical contact required. Conceived by British composer Edward Williams (1921-2013) as a Theremin descendant enabling dancers to generate their own accompaniment, the prototype was built in 1984 and the first commercial units shipped in 1989. The hardware was designed and manufactured by Robin Wood and the engineering team at EMS (Electronic Music Studios) in Cornwall — the same legendary company that created the VCS3 "Putney" synthesizer used by Pink Floyd, Brian Eno, and Jean-Michel Jarre. Soundbeam found its most profound impact not on the dance floor but in special education and music therapy, where the extreme sensitivity of the ultrasonic beam meant even children with profound and multiple learning disabilities (PMLD) could play music through minimal movements — a facial twitch, a finger raised, a wheelchair nudged. More than 1,500 systems were in use worldwide by 2001, and the product remains in active production as Soundbeam 6 in 2025. ### Deep dive * **Origins.** Edward Williams (1921-2013) was a British composer and electronic music pioneer who scored two Oscar-winning documentary shorts and composed the groundbreaking electronic/orchestral score for David Attenborough's 'Life on Earth' (1979) using three EMS VCS3 synthesizers. According to the official Soundbeam history, Williams spent 18 years searching for a device that would enable dancers to create and shape their accompanying music through body movement, inspired by Léon Theremin's 1920 Thereminvox. Unlike the Theremin's capacitive sensing, Williams conceived of using sonar to create an "invisible expanding keyboard in space." * **The EMS connection.** By the 1980s, main synthesizer production at EMS had wound down and the company had relocated to Ladock, Cornwall. Williams, already a VCS3 power user, brought the Soundbeam concept to EMS. Engineer Robin Wood and the team — who had built one of the most influential synthesizers in music history — designed the commercial Soundbeam hardware. The company that made the synth on 'Dark Side of the Moon' ended up building ultrasonic controllers for children with cerebral palsy. * **How it works.** Each sensor fires a continuous stream of directional 50 kHz ultrasonic tone-bursts into a conical beam (range 0.56m to 6m) and simultaneously listens for echoes. As objects enter the beam, they reflect ultrasound back to the sensor. The controller calculates distance, speed, and direction, translating these into MIDI note, velocity, and continuous controller data. Each beam can trigger up to 64 individual note pitches over its length, divided into equal "divisions" with programmable pitch sequences (pentatonic, harmonic minor, chromatic, or custom). Up to 4 sensors can operate simultaneously, complemented by 8 switch inputs. * **From dance to disability.** Designed for avant-garde dance performance, Soundbeam's critical adoption came in special education. Because the beam requires no physical contact, no fine motor control, and no strength to operate, users with PMLD, cerebral palsy, Rett Syndrome, or locked-in conditions could create music independently. Sound on Sound noted in 2001 it was "literally possible to play a MIDI instrument just by facial activity." The device was adopted by Great Ormond Street Hospital, Nordoff Robbins music therapy, Drake Music, RNIB, and dozens of UK special schools and NHS trusts. Dr. Nicholas Bannan at the University of Reading coined the term "elektrokinaesthetic instruments" to describe Soundbeam-like devices. * **Artistic use.** Saxophonist David Jackson (Van der Graaf Generator) adopted Soundbeam in 1992 for his 'Tonewall' project, performing with it on the 1997 'Union Chapel Concert' album. Composer Martin Kiszko, a Williams protégé, advocated for Soundbeam in educational and multi-media performance contexts. Led Zeppelin's John Paul Jones later provided a testimonial for Soundbeam 6. * **Legacy.** Soundbeam is one of the longest-lived products in electronic music history, now in its sixth generation (Soundbeam 6, 2017-present) with a full touchscreen, built-in sound library, on-board sampler, HDMI film projection, and wireless switches. Its influence extends through Roland's D-Beam, the NIME (New Interfaces for Musical Expression) research community, Drake Music's DMLab accessible instrument network, and conceptually through to Microsoft's Kinect. That a device designed for dancers gave a voice to children who had never been able to make music before is one of the most moving stories in HCI history. ### Team * **Edward Williams (1921-2013)** — Originator and composer. Conceived Soundbeam as an 18-year quest for a dancer-controlled musical instrument. * **Judy Williams** — Co-founder of The Soundbeam Project, business operations. * **Robin Wood** — EMS engineer, designed the Soundbeam 1 and 2 hardware. * **EMS (Electronic Music Studios)** — Cornwall-based manufacturing partner. Legendary creators of the VCS3 synthesizer. * **David Jackson** — Saxophonist (Van der Graaf Generator), early adopter with 'Tonewall' project from 1992. * **Martin Kiszko** — Composer, Williams protégé, education advocate. * **Dr. Nicholas Bannan** — University of Reading. Coined the term "elektrokinaesthetic instruments." ### Media ![Edward Williams in 1999, composer and originator of Soundbeam](../assets/wiki/soundbeam-edward-williams.jpg) *Edward Williams (1921-2013), composer and originator of Soundbeam, photographed in 1999. Source: Wikimedia Commons.* ![Soundbeam 2 system with two ultrasonic sensors, controller, switchbox, and footswitches](../assets/wiki/soundbeam-system.jpg) *Soundbeam 2 system: two ultrasonic sensors on boom stands, the controller unit, an 8-input switchbox, and footswitches. Source: Sound on Sound magazine, October 2001.* ### Sources 1. Wikipedia: Soundbeam — https://en.wikipedia.org/wiki/Soundbeam 2. Wikipedia: Edward Williams (composer) — https://en.wikipedia.org/wiki/Edward_Williams_(composer) 3. Soundbeam official history — https://www.soundbeam.co.uk/history 4. Soundbeam: What is Soundbeam? — https://www.soundbeam.co.uk/what-is-soundbeam-1 5. Sound on Sound: Soundbeam 2 review (October 2001) — https://www.soundonsound.com/reviews/soundbeam-2 6. The Guardian: Edward Williams obituary (December 2013) — https://www.theguardian.com/music/2013/dec/19/edward-williams-obituary 7. Drake Music: Technology hub — https://www.drakemusic.org/technology/ 8. Wikipedia: Electronic Music Studios (EMS) — https://en.wikipedia.org/wiki/Electronic_Music_Studios --- ## Hard Drivin' / Race Drivin' (1989) **By:** Atari Games (Rick Moncrief, Max Behensky, Jed Margolin, Doug Milliken) **Tags:** `HCI` `Force Feedback` `Haptics` `Gaming` `Arcade` `Simulation` `Consumer Hardware` ### Overview Hard Drivin' was a 1989 arcade driving simulation that represented a triple convergence of HCI firsts: the first commercially released arcade game with continuous force-feedback steering, the first consumer-facing application of real automotive vehicle dynamics equations, and one of the earliest arcade games rendered in filled 3D polygons. The player sat in an adjustable bucket seat with a full manual transmission — ignition key, H-pattern 4-speed shifter, clutch/brake/gas pedals, and a steering wheel powered by a brushed 60-90V DC motor that actively fought the driver based on simulated road forces, cornering, and collisions. The car physics model was developed by Doug Milliken, son of William F. Milliken Jr. — the Cornell Aeronautical Laboratory engineer who converted aircraft equations of motion into automobile dynamics equations in the 1950s and literally wrote the canonical textbook *Race Car Vehicle Dynamics*. Atari was so protective of this secret that they listed Milliken in the game's credits as a mere "test driver." 3,318 cabinets were manufactured across cockpit and upright variants, selling for $7,995. The sequel Race Drivin' (1990) upgraded to a proper four-wheel physics model using an AT&T DSP32C. Every modern force-feedback racing peripheral — from the Microsoft SideWinder Force Feedback Pro to today's direct-drive sim racing wheels — traces its commercial lineage to this cabinet. ### Deep dive * **Origins.** Development began in the mid-1980s when Atari Games was still owned by Namco. The two companies collaborated on a 3D arcade hardware prototype, then split to develop separate forks. Project leader Rick Moncrief oversaw a team including hardware designer Jed Margolin, physics programmer Max Behensky, and game programmer Stephanie Mott. The project was nearly cancelled when an Atari VP claimed nobody would buy a $10,000 arcade cabinet, but weeks of market research proved the price acceptable. * **The physics secret.** Atari hired Doug Milliken as a consultant to develop the car model using real vehicle dynamics. Doug and his father William had literally written the book on car dynamics. Atari hid Doug's true role by listing him in the credits as a "test driver." Jed Margolin later explained: "Atari didn't want anyone to know we were doing real car modeling." The model described engine, transmission, springs, shock absorbers, and tires — how they react to each other, to the road, and crucially, the forces transmitted back through the steering wheel. A key limitation: the TMS34010 processor running the physics had no floating-point unit, so Behensky could only model two wheels, dynamically switching modes depending on speed. * **Force feedback hardware.** The force-feedback motor was a brushed DC motor by Ohio Electric Motors (60-90 VDC) with an opto-isolated motor amp. Safety features included a thermal protector and redundant 12-bit/8-bit ADCs monitoring motor position. A remarkable detail: the adjustable seat position sensor scaled force-feedback strength — seat forward (shorter/younger player) meant less force; seat back (taller/adult) meant more. Unlike earlier arcade cabinets that merely vibrated on collision (TX-1, 1983), Hard Drivin' provided continuous variable resistance based on simulated physics. * **Computing architecture.** The cabinet ran six processors: main CPU (Motorola 68010, 8 MHz) for game logic; two TI TMS34010 processors for graphics and physics (Model Signal Processor, ~6 MHz); an ADSP-2100 math co-processor; and separate 68000/TMS32010 for audio. Jed Margolin pulled a memory trick: by pairing 32 VRAMs into 16 banks of 64Kx8 and telling the TMS34010 there was only 1 bit per pixel, the system could fill 16 pixels per operation. He called the custom gate array (designed by Don Paauw) the "34012" — a fake TI part number to mislead hardware pirates. * **Reception and legacy.** 3,318 cabinets were manufactured (1,868 cockpits). Commodore User wrote: "Atari can be proud of themselves for producing a coin-op which really does put you in the driving seat — undeniably a major first." Home ports stripped the force feedback entirely, making the arcade hardware the only authentic experience. Jed Margolin later donated his personal Race Drivin' cabinet to The Strong Museum of Play. The project yielded three US patents (moving dashboard, driver training, multi-player competition) and spawned the San Francisco Rush series, establishing a lineage from 1989 arcade physics to modern sim racing — Gran Turismo, iRacing, and every force-feedback wheel used today. ### Team * **Rick Moncrief** — Project leader, game designer, sound system, mechanical design, force shifter, analog hardware. * **Max Behensky** — Software design, car physics model in C, force-feedback steering implementation. * **Stephanie Mott** — Game programming, display software, championship lap. * **Jed Margolin** — Hardware design, self-test, instant replay, integer 3D rendering, video memory architecture. * **Doug Milliken** — Vehicle dynamics consultant (credited as "test driver" to conceal real vehicle modeling). * **Erik Durfey** — Technician, mechanical designer, sound recording, dashboard gauge implementation. * **Don Paauw** — Custom gate array design (the fake "34012" chip). * **Jim Morris** — Display math software. * **Publisher** — Atari Games (NA), Namco (Japan). 3,318 units manufactured. ### Media ![Hard Drivin' arcade flyer showing the cockpit cabinet with force-feedback steering wheel](../assets/wiki/hard-drivin-flyer.jpg) *The Hard Drivin' arcade flyer, showing the cockpit cabinet with force-feedback steering wheel, H-pattern shifter, and three pedals (clutch, brake, gas). Source: Wikimedia.* ![Hard Drivin' in-game screenshot showing early filled-3D-polygon graphics](../assets/wiki/hard-drivin-screenshot.png) *Hard Drivin' gameplay, one of the earliest filled-3D-polygon arcade games, showing the first-person driving view. Source: Wikimedia.* ### Sources 1. Wikipedia: Hard Drivin' — https://en.wikipedia.org/wiki/Hard_Drivin%27 2. Wikipedia: Race Drivin' — https://en.wikipedia.org/wiki/Race_Drivin%27 3. Jed Margolin: Schematics & Engineering History — http://jmargolin.com/schem/schems.htm 4. KLOV / Museum of the Game: Hard Drivin' — https://www.arcade-museum.com/game_detail.php?game_id=8072 5. Arcade-History: Hard Drivin' — https://www.arcade-history.com/?n=hard-drivin%27&page=detail&id=1083 6. Arcade-History: Race Drivin' Cockpit — https://www.arcade-history.com/?n=race-drivin-cockpit-model&page=detail&id=2148 7. Atari Production Numbers Memo (archived) — https://web.archive.org/web/20130120084806/http://www.atarigames.com/index.php?option=com_content&view=article&id=47:atari-production-numbers-memo 8. Karl Ludvigsen: Bill Milliken biography — http://www.bentleypublishers.com/ludvigsen/aq-milliken-biography.htm --- ## Cauzin Softstrip Reader (1985) **By:** Cauzin Systems Inc. (Waterbury, Connecticut). Founded by Dr. Jack Goldman (former founder/director of Xerox PARC) and Robert L. Brass. **Tags:** `HCI` `Input` `Scanning` `Paper Data Storage` `2D Barcode` `Optical Reader` `Physical-Digital Bridge` `Magazine Distribution` `Ephemeral Media` ### Overview The Cauzin Softstrip system, introduced in 1985 by Cauzin Systems of Waterbury, Connecticut, was the world's first commercial two-dimensional barcode format. It consisted of an optical scanning peripheral (the 'Softstrip System Reader') that read densely printed 2D bar codes from paper, and companion encoding software nicknamed the 'Stripper.' A Softstrip was a narrow strip approximately 5/8 inch (16 mm) wide and up to 10 inches (254 mm) long, printed along the edge of a magazine page or book. A single strip could encode up to 5,500 bytes of data — program source code, executable binaries, text, or graphics. The reader retailed for approximately $200 USD, and supported the Apple II, Macintosh, and IBM PC platforms. Softstrips appeared in computer magazines including Byte, Family Computing, II Computing, and InCider; they were sold in retail stores as 'StripWare' booklets; and they appeared in at least one book, Animated Algorithms (Barnett & Barnett, McGraw-Hill, 1986). The product won MacUser magazine's 'Most Innovative Concept of 1986' award but failed commercially within a few years. The format lived on, re-named Datastrip code, used in identification cards and biometric data encoding into the 2000s. The Cauzin Softstrip anticipated later 2D codes like QR by over a decade, but fell victim to a classic chicken-and-egg adoption dilemma and was outrun by the plummeting cost of floppy disks. ### Deep dive * **Origins: Xerox PARC Meets Paperback Computing.** The Softstrip was co-founded by two figures from opposite ends of computing. Dr. Jack Goldman was the founder and first director of Xerox PARC — the legendary laboratory that birthed the laser printer, Ethernet, the GUI, object-oriented programming, and the personal computer. After leaving Xerox, Goldman co-founded Cauzin Systems. Bob Brass was a hands-on engineer who tackled the mechanical precision problem with a clever analog solution: a spiral gear driving a phonograph-like tracking arm that could achieve sub-degree positional accuracy without requiring mechanically impossible gear precision. The company was based in Waterbury, Connecticut and later changed its name to Softstrip, Inc. The development team included John Glaberson, Richard W. Mason, Scott Santulli, G. Thomas Roth, and others, all named as inventors on the core US patents (US 4,692,603, US 4,782,221, US 4,728,783). * **The Scanning Experience: A 30-Second Ritual.** The interaction was pure embodied ritual. The user obtained a magazine containing a Softstrip-encoded program, positioned the reader over the strip on the page using two alignment marks (a circle and a rectangle), initiated the scan, and waited approximately 30 seconds while the reader's motor drew the strip past an LED-illuminated linear photodiode array. An audible beep confirmed success or signaled an error (smeared ink, misalignment). The data transferred to the host computer, appearing as a file the user could save to disk or run. For multiple-strip publications, the user repeated the entire process, re-aligning for each strip. This was designed as a replacement for the era's dominant software distribution method: typing in BASIC listings character-by-character from magazine pages — an activity notorious for introducing transcription errors. The reader could even be used to transfer data between otherwise-incompatible platforms (Apple II to Mac to PC), since the strip format was platform-agnostic. * **How the Data Was Encoded: The Dibit Format.** The fundamental encoding unit was the dibit — a pair of adjacent squares. A black-then-white dibit encoded a 0; white-then-black encoded a 1; black/black and white/white were invalid. This self-clocking scheme ensured every valid dibit contained a transition, providing inherent timing recovery and error detection. Each strip included a horizontal synchronization section (encoding nibbles per row and paper-ink contrast calibration), a vertical synchronization section (encoding dibit height with redundancy), and a data section with dual inline parity and a strip-level checksum. The encoding software ('Stripper,' under $30) calculated optimal strip layout accounting for an 'ink spread index' — an empirical measurement of how much printing ink bleeds on specific paper stock. For magazine-quality reproduction, strips were printed oversize on a dot matrix printer and photographically reduced at 8:1 ratios to achieve final dimensions. A complete digital decoder using convolutional neural networks was published by Michael Reimsbach and John Aycock in 2021, achieving over 91% decode rates across a corpus of 1,229 strips. * **Commercial Arc: Award-Winning, Doomed by Timing.** The reader cost $200 — roughly equivalent to a floppy disk drive, which offered vastly more capacity and faster access. Softstrips appeared in magazines from roughly 1985 to 1988, then publications stopped printing them. The product suffered from a classic chicken-and-egg problem (magazines wouldn't dedicate page space without an installed base; consumers wouldn't buy without a steady supply of strips), limited capacity (5.5 KB was fine for short BASIC listings but inadequate as programs grew), physical durability issues (magazine ink smearing, paper curl), and brutal timing: by 1987–88, modems and BBS systems offered a faster and more capacious alternative. Nevertheless, the format won the MacUser Editors' Choice Award for 'Most Innovative Concept of 1986' and was reborn as Datastrip code for ID cards and biometric data. ### Team * **Dr. Jack Goldman.** Co-founder. Founder and first director of Xerox PARC. Provided vision and credibility to the venture. * **Robert L. 'Bob' Brass.** Co-founder and lead inventor on all core patents. Solved the mechanical precision problem with a spiral-gear tracking arm. * **John Glaberson.** Co-inventor on reader, data strip, and encoding patents. Later co-inventor of Datastrip card reader (US 4,886,957). * **Richard W. Mason.** Co-inventor on core Softstrip patents. * **Scott Santulli.** Co-inventor on core Softstrip patents; later co-inventor of Datastrip card reader. * **G. Thomas Roth.** Co-inventor on core Softstrip patents. * **Peter D'Amato.** Manager of OEM and VAR Support (1984–1988). ### Media ![Cauzin Softstrip Reader — a beige flat rectangular peripheral](../assets/wiki/cauzin-softstrip-1.jpeg) *The Cauzin Softstrip System Reader, a flat peripheral with a top-loading strip guide mechanism. The connected cable interfaces to Apple II, Macintosh, or IBM PC computers. Photo by Shelby Jueden, CC BY-SA 4.0, via Wikimedia Commons.* ![Magnified view of a Cauzin Softstrip data pattern](../assets/wiki/cauzin-softstrip-2.jpg) *An example Cauzin Softstrip showing the header (left: horizontal and vertical synchronization sections) and data rows (right). Each small black-or-white square encodes part of a dibit pair. From Reimsbach & Aycock (2021), CC BY 4.0.* ![Softstrip positioned in the reader mechanism](../assets/wiki/cauzin-softstrip-3.jpg) *A Softstrip positioned in the reader mechanism, showing the scanning head and paper alignment. The circular and rectangular positioning marks ensure proper alignment. From Reimsbach & Aycock (2021), CC BY 4.0.* ![Dibit encoding diagram for the Cauzin Softstrip](../assets/wiki/cauzin-softstrip-4.jpg) *Cauzin Softstrip dibit encoding scheme: black-then-white = 0, white-then-black = 1. Every valid dibit contains a transition, providing self-clocking and error detection. From Reimsbach & Aycock (2021), CC BY 4.0.* ### Sources 1. Reimsbach, Michael & Aycock, John. 'Decoding the Cauzin Softstrip: a case study in extracting information from old media.' Archival Science, 2021. PMC 8591774. — https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8591774/ 2. Sandberg-Diment, Erik. 'Supermarket Bar Codes Are Applied to Software.' The New York Times, October 15, 1985. — https://www.nytimes.com/1985/10/15/science/personal-computers-supermarket-bar-codes-are-applied-to-software.html 3. Wikipedia: Cauzin Softstrip — https://en.wikipedia.org/wiki/Cauzin_Softstrip 4. US Patent 4,692,603: Optical reader for printed bit-encoded data (Brass, Glaberson, Mason, et al., 1987) — https://patents.google.com/patent/US4692603 5. ANTIC Interview 115 — Bob Brass and Peter D'Amato, Cauzin Softstrip (2016) — https://ataripodcast.libsyn.com/antic-interview-115-bob-brass-and-peter-damato-cauzin-softstrip 6. Tebbutt, David. 'Cauzin's Softstrip.' Personal Computer World, January 1987. — https://www.worldradiohistory.com/UK/Personal-Computer-World/80s/PCW-1987-01-S-OCR.pdf 7. Cauzin Softstrip Archive — Internet Archive (promotional photos, packaging) — https://archive.org/details/CauzinSoftstrip 8. Sowerbutts, Will. 'Solving the CauzCoin Retro BattleStations Challenge' (2016) — http://sowerbutts.com/cauzcoin/ 9. Reimsbach, Michael. 'Reverse Engineering the Cauzin Softstrip.' Master's thesis, htw saar, 2018. — https://stl.htwsaar.de/tr/STL-TR-2018-03.pdf --- ## Reading Electropalatography (EPG) System (1978) **By:** W.J. (Bill) Hardcastle, Peter Roach, and Wilf Jones at the University of Reading Speech Research Laboratory (UK) **Tags:** `HCI` `Biofeedback` `Speech Therapy` `Accessibility` `Body-as-Interface` `Electropalatography` `Real-Time Display` `Custom Prosthetic` `Phonetics` ### Overview The Reading Electropalatography (EPG) System is a pioneering human-computer interface that captures tongue-to-palate contact in real time and displays it as visual biofeedback for articulation training and speech therapy. Developed at the University of Reading (UK) between 1974 and 1978 and refined through the 1980s, the system consists of a custom-molded acrylic artificial palate embedded with 62 gold electrodes, connected via a multiplexer to a computer that renders illuminated contact patterns on a CRT display. The user — often a patient with a speech disorder — wears the palate like a dental retainer and watches the screen as dots illuminate wherever their tongue touches. A target pattern is overlaid, transforming the invisible interior of the mouth into a visible, game-like spatial targeting task. A small AC signal (<50 µA) passes through the user's body via a reference electrode worn on the neck or wrist. When the tongue touches a palatal electrode, it completes a low-impedance circuit. The 62 electrodes are scanned sequentially at 10 kHz each, yielding binary on/off contact data at 100–200 frames per second. The original system was built around a DEC PDP-8 minicomputer with software written by Peter Roach in machine code; later versions ran on Commodore and IBM-compatible PCs. The system became the dominant EPG platform in Europe, established clinical protocols still used today, and spawned a commercial lineage through Articulate Instruments' EPG3 and WinEPG (discontinued 2013) and icSpeech's LinguaGraph. It was used for cleft palate therapy, hearing-impaired speech training, dysarthria rehabilitation, second-language pronunciation, and fundamental phonetic research. The LinguaGraph system was even used aboard the International Space Station in 2025 (Axiom Mission 4's Voice in Space programme). ### Deep dive * **Origins: From Charcoal to Electrodes.** Before electropalatography, phoneticians studied tongue-palate contact by painting a speaker's tongue with charcoal, having them produce a sound, and photographing the resulting marks on the palate. This static palatography could only capture a single moment. W.J. (Bill) Hardcastle (1943–2015), a phonetician at the University of Reading's Department of Linguistic Science, needed to capture the real-time *dynamics* of tongue-palate contact — the fleeting closures, releases, and constrictions that distinguish one speech sound from another. Working with electronics engineer Wilf Jones and programmer/linguist Peter Roach, he developed the Reading EPG system. The first paper describing the computer-based system was published by Roach and Hardcastle in 1976 ('A computer system for the processing of electropalatographic and other data,' *Proceedings of the Vth Phonetics Symposium*, University of Essex). The system was fully operational and photographed by July 1978. Hardcastle went on to become Professor of Speech Science and founding Director of the Speech Science Research Centre at Queen Margaret University, Edinburgh. * **The Hardware: A Computer You Wear.** The Reading EPG palate is a horseshoe-shaped custom-molded acrylic baseplate (~1–1.5 mm thick) fabricated from a dental alginate impression of the user's upper palate and teeth. It clips to the upper teeth like an orthodontic retainer. The palate carries 62 gold-plated electrodes arranged in an 8-row grid approximating the anatomy of the human hard palate: Row 1 (alveolar ridge) has 6 electrodes, rows 2–7 have 8 each, and row 8 (velar region) has 8 arranged with the posterolateral corners omitted to fit the dental arch. Electrode diameter is approximately 1.5 mm with center-to-center spacing of 4.5–5 mm. The signal chain begins with a small AC signal (<50 µA) passed through the user's body via a neck/wrist reference electrode. When the tongue touches a palatal electrode, it completes a low-impedance circuit. A 64-channel FET multiplexer scans all 62 electrodes at 10 kHz per electrode, with a full-palate scan taking approximately 6 ms, providing an effective frame rate of 100–200 Hz. Contact data passes via a parallel interface to the host computer. The original system used a DEC PDP-8 minicomputer running RT-11; by the early 1980s it was reprogrammed for Commodore and later IBM-compatible PCs. * **The Interaction: See Your Tongue, Change Your Speech.** A therapy session with the Reading EPG followed a tight biofeedback loop. The user inserted the custom palate. The CRT displayed a static 8-row palate schematic — as if looking up into the mouth from below. The speech therapist selected a target contact pattern (e.g., complete front-row closure for /t/, a central groove with lateral contact for /s/, or full rear-row closure for /k/) displayed as an overlaid template. The user attempted the target sound. In real time — within approximately 10 ms — any tongue-palate contact illuminated the corresponding dot on the screen. The user saw their actual contact pattern superimposed on the target template and made micro-adjustments to tongue posture, place, or groove shape. The display updated continuously at up to 100 frames/second. Early CRTs had phosphor persistence, giving contacts a brief 'trail' that helped users perceive dynamic gestures such as closures and releases. The therapist cuing articulatory goals ('raise the sides,' 'make a groove in the middle') while watching both user and screen. All frames were logged to disk for offline analysis. * **Clinical and Research Impact.** The Reading EPG system was used with several populations: children and adults with cleft palate (identifying compensatory articulations invisible to auditory assessment), hearing-impaired individuals (using the visual channel to learn correct articulation when auditory feedback was absent or degraded), people with dysarthria and apraxia from stroke or cerebral palsy, children with persistent speech sound disorders unresponsive to conventional therapy, and second-language learners. Fiona Gibbon, a key clinical researcher, established EPG as an assessment and therapy tool, identifying 'undifferentiated lingual gestures' — tongue movements that sound correct to the ear but are biomechanically abnormal. The system was commercialized by Articulate Instruments Ltd. (founded by engineer Alan Wrench), which released the portable EPG3 around 1990 and WinEPG in 2000. Although Articulate Instruments ceased EPG production in 2013, the technology lineage continues through icSpeech's LinguaGraph (Rose Medical Solutions Ltd., Canterbury), which uses the identical Reading 62-electrode palate design and sells to over 30 countries including Great Ormond Street Hospital and Oxford University Hospitals. ### Team * **W.J. (Bill) Hardcastle (1943–2015).** Principal investigator; Professor of Speech Science at University of Reading. Intellectual architect of the Reading EPG. Later founding Director of Speech Science Research Centre at Queen Margaret University, Edinburgh. * **Peter Roach.** Hardware/software designer; programmed the PDP-8 interface in machine code. Later Professor of Phonetics at Reading and Leeds. Uploaded the 1978 palate photographs to Wikimedia Commons. * **Wilf Jones.** Electronics engineer; designed the original EPG hardware, multiplexer, and interface card. * **Fiona Gibbon.** Clinical researcher; established EPG as a clinical tool for children with speech disorders, cleft palate, and hearing impairment. Identified 'undifferentiated lingual gestures.' * **Alan Wrench.** Engineer; designed EPG3 hardware and WinEPG software. Founded Articulate Instruments Ltd. to commercialize the Reading EPG technology. * **Katerina Nicolaidis.** Phonetic researcher; cross-linguistic EPG studies providing crucial normative data on Greek and English coarticulation. ### Media ![Custom-molded acrylic artificial palate with 62 gold electrodes, Reading EPG system, 1978](../assets/wiki/reading-epg-1.jpg) *The Reading electropalate — an artificial palate embedded with 62 gold electrodes in an 8-row grid. Each user required a custom-molded palate from a dental impression. Photo dated 28 July 1978 by Peter Roach, CC BY-SA 4.0, Wikimedia Commons.* ![EPG contact-pattern printout for the word 'catkin,' Reading EPG system, 1978](../assets/wiki/reading-epg-2.jpg) *A printout from the Reading EPG system showing successive frames of tongue-palate contact for the utterance 'catkin.' 'O' indicates contact; '.' indicates no contact. Frame 344 shows complete alveolar /t/ closure; frame 350 shows velar /k/ closure. Photo by Peter Roach, CC BY-SA 4.0.* ![Modern 62-electrode Reading EPG palate on plaster cast](../assets/wiki/reading-epg-3.jpg) *Contemporary Reading EPG palate (LinguaGraph), based on the identical 62-electrode design. The palate clips to the upper teeth; wires exit at the posterior margin. Supported by more than 50 years of published research. (icSpeech)* ![EPG contact pattern for alveolar stop /t/, /d/, /n/](../assets/wiki/reading-epg-4.jpg) *EPG display showing complete alveolar contact (front-row electrodes lit) for /t/, /d/, /n/ — the classic 'target template' pattern that therapy patients would try to match. (icSpeech)* ### Sources 1. Hardcastle, W.J. (1972). 'The use of electropalatography in phonetic research.' Phonetica, 25(4), 197–215. — https://doi.org/10.1159/000259342 2. Roach, P.J. and Hardcastle, W.J. (1976). 'A computer system for the processing of electropalatographic and other data.' Proc. Vth Phonetics Symposium, University of Essex, pp. 127–142. — 3. Hardcastle, W.J., Jones, W., Knight, C., Trudgeon, A., and Calder, G. (1989). 'New developments in electropalatography: A state-of-the-art report.' Clinical Linguistics & Phonetics, 3(1), 1–38. — https://doi.org/10.3109/02699208908985268 4. Wikipedia: Electropalatography — https://en.wikipedia.org/wiki/Electropalatography 5. Articulate Instruments: A History of EPG — https://articulateinstruments.com/epg-discontinued/ 6. icSpeech: LinguaGraph Electropalatography System (current commercial descendant) — https://icspeech.com/electropalatography.html 7. icSpeech: Tongue Palate Contact animations (EPG displays for each consonant) — https://icspeech.com/tongue-palate-contact.html 8. Hardcastle, W.J. and Marchal, A. (Eds.) (1989). Speech Production and Speech Modelling, NATO ASI Series. Kluwer Academic Publishers. — --- ## SynthAxe (1985) **By:** Bill Aitken, Mike Dixon, and Tony Sedivy / Synthaxe Limited (UK), with Virgin Group funding **Tags:** `Music` `MIDI` `Gesture` `Input Device` ### Overview The **SynthAxe** was a fretted MIDI guitar controller developed in England and launched commercially in 1985–86. Funded as a joint venture by Richard Branson's Virgin Group, it was built by Synthaxe Limited and co-invented by Bill Aitken, Mike Dixon, and Tony Sedivy (US Patent 4,658,690, filed January 1985). It carried no internal sound source; it was a pure MIDI controller that required external synthesizers. The instrument's defining innovation was the complete decoupling of pitch selection from note triggering. Six pitch strings ran over a 24-fret neck where each fret was divided into 11 conductive sections, continuously scanned by a microprocessor — pressing a string onto a fret closed an electrical switch, just like a keyboard scanning matrix. Six separate trigger strings on the body detected velocity via Hall effect sensors when plucked. The two string sets were mounted at an angle to each other, giving the instrument its distinctive sci-fi silhouette. String bends were detected by sensor coils embedded in the fingerboard; touch was sensed by an AC waveform superimposed on a DC potential, enabling hammer-ons, pull-offs, and an auto-trigger mode. Nine velocity-sensitive trigger keys with polyphonic aftertouch offered an alternative to picking. The result was six independent MIDI channels — each with per-string pitch bend and aftertouch — capable of crashing most 1980s sequencers. Priced at £10,000 (approximately US $13,000) in 1986, fewer than 100 units were built from aerospace and military-grade components: a cast metal chassis inside a fibreglass shell with a steel neck. Transporting one required four flight cases. Virgin dropped the product around 1987–88, and Synthaxe Limited entered liquidation. Allan Holdsworth, its most famous user, called it "the only guitar synthesizer that was ever built that really works for me." ### Deep dive * **The latency problem it solved.** Every competing MIDI guitar system of the mid-1980s — the Roland GR-series, the IVL Pitchrider — worked by analyzing audio waveforms. A string was plucked, the system sampled it, computed its pitch from the waveform, then generated a MIDI note. This took time — typically 10–30 milliseconds, perceptible to a trained musician. The SynthAxe eliminated latency entirely by refusing to do pitch analysis. Its fretboard was an electrical switch matrix: press a string to a fret, and you close a circuit. The note pitch is known instantly, before any note is triggered. The trigger strings (or keys) then initiate the MIDI event with zero computational delay. This architectural decision — decoupling pitch from trigger — was the SynthAxe's single most important HCI insight. * **Interaction subsystems.** The SynthAxe had four distinct interaction subsystems. (1) Fretboard scanning: 24 frets, each divided into 11 conductive sections (6 under each string plus 5 inter-string pins), continuously scanned by multiplexing. Non-standard spacing allowed a two-octave range per string. All strings used the same gauge (0.13), giving uniform light action. (2) String bend detection: tiny electromagnetic sensor coils between frets detected lateral string movement by sensing changes in the field around current-carrying strings. (3) Touch sensing: an AC waveform imposed on a DC bias detected finger contact before the string reached the fret, enabling hammer-ons and pull-offs. (4) Triggering: Hall effect sensors on six trigger strings measured plucking velocity and timing; nine velocity-sensitive keys with polyphonic aftertouch provided an alternative; an auto-trigger mode fired notes on fret contact for tapping technique. A separate console/pedestal unit provided individual string tuning, transposition, electronic capo, and foot-pedal control of decay and sustain. * **The Virgin gamble.** Richard Branson's Virgin Group funded the SynthAxe as a joint venture, handling distribution through Virgin Games. The 1986 launch price of £10,000 placed it firmly in the professional studio market. Virgin's involvement aligned the SynthAxe with the company's broader push into entertainment technology in the mid-1980s. But when the product failed to find a market beyond a handful of virtuoso guitarists, Virgin pulled out after approximately two years, and Synthaxe Limited entered liquidation. The liquidation left SynthAxe owners without factory support or spare parts — Holdsworth later lamented that "there are maybe two or three guys on the whole planet that could probably fix a SynthAxe now." * **The Drumitar: a second life.** The SynthAxe's most unexpected legacy came from Future Man (Roy Wooten), percussionist for Béla Fleck and the Flecktones. Future Man bought Lee Ritenour's SynthAxe and completely rebuilt it into the Drumitar — a guitar-shaped MIDI drum controller. Where the original mapped MIDI data to synthesizers, the Drumitar mapped it to drum machines and samplers. The novel interface (two sets of strings, velocity-sensitive keys) turned out to be equally suited to percussion as to melody. The Drumitar became Future Man's signature instrument through multiple Grammys with the Flecktones, giving the SynthAxe's architecture a creative afterlife far beyond its original design intent. * **Notable users.** Allan Holdsworth used the SynthAxe on *Atavachron* (1986) and *Sand* (1987). Lee Ritenour featured it on the cover of *Earth Run* (1986). Christopher Currell used it to control a Synclavier on Michael Jackson's *Bad* tour. Chuck Hammer worked with Lou Reed and David Bowie using the SynthAxe. Gary Moore was briefly shown playing one in the "Out in the Fields" video. ### Team * **Bill Aitken (William A. Aitken).** Primary inventor; conceived the instrument in the early 1980s. * **Mike Dixon (Michael S. Dixon).** Co-inventor, engineering. * **Tony Sedivy (Anthony J. Sedivy).** Co-inventor, engineering. * **David Fowler.** Designed key toggles; trading as BJ Hopkins Injection and Toolmaking, Littleworth, Oxford. Deceased. * **Synthaxe Limited.** UK limited company, London area. Assignee of US patent. Joint venture with Virgin Group. * **Richard Branson / Virgin Group.** Joint venture funder; Virgin Games handled distribution. ### Media ![SynthAxe MIDI guitar controller on a stand](../assets/wiki/synthaxe-wikimedia.jpg) *The SynthAxe — two sets of strings at an angle, fibreglass body over a cast metal chassis. The upper strings select pitch electrically; the lower strings trigger notes via Hall-effect velocity sensing. Wikimedia Commons.* ![Patent drawing showing SynthAxe instrument architecture](../assets/wiki/synthaxe-patent-front.png) *Patent drawing showing the SynthAxe's dual string-angle architecture and internal construction. US Patent 4,658,690, filed 1985, issued 1987. Public domain.* ![Allan Holdsworth performing with the SynthAxe](../assets/wiki/synthaxe-holdsworth.jpg) *Allan Holdsworth, the SynthAxe's most famous advocate, performing live. Holdsworth used the instrument on Atavachron (1986) and Sand (1987). Photo from innerviews.org.* ### Sources 1. Wikipedia: SynthAxe — https://en.wikipedia.org/wiki/SynthAxe 2. US Patent 4,658,690: Electronic musical instrument (SynthAxe) — https://www.freepatentsonline.com/4658690.html 3. John Hollis: SynthAxe serial #0006 — first-hand owner's page — http://www.hollis.co.uk/john/synthaxe.html 4. Allan Holdsworth Innerviews interview (discusses SynthAxe) — https://www.innerviews.org/inner/holdsworth.html 5. MATRIXSYNTH: SynthAxe tag (aggregator with photos and videos) — https://www.matrixsynth.com/search/label/SynthAxe 6. SynthAxe factory demo video (YouTube) — https://www.youtube.com/watch?v=EZopVI9LTOU 7. Sound on Sound, March 1986: SynthAxe feature (archived at muzines.co.uk) — https://www.muzines.co.uk/articles/synth-axe/3012 --- ## CMU Sensor Frame (1985) **By:** Paul McAvinney, Carnegie Mellon University (with Roger B. Dannenberg, M.T. Thomas) **Tags:** `HCI` `Multi-Touch` `Gesture` `Input` `Research` ### Overview The Sensor Frame was the first multi-touch system to demonstrate gestural interaction with coordinated graphics. Built at Carnegie Mellon University in 1985 by Paul McAvinney, it was a rectangular metal frame surrounding a CRT monitor, using four corner-mounted sensors to detect finger shadows via optical occlusion. The sensors were off-the-shelf Micron IS32 OpticRAM DRAM memory chips — repurposed from stock because CCD cameras were effectively unavailable in 1985. Their ceramic packages had glass windows that made them naturally photosensitive, turning commodity memory into a crude 128x256-pixel camera array. The system could track up to three fingers simultaneously, detect the angle at which each finger approached the surface, and recognize a vocabulary of gestures including two-finger rotation, marquee selection, amplitude scaling, and — most notably — **pinch-to-zoom**, demonstrated with coordinated graphics in 1985. A later NASA-funded variant, the Sensor Cube, extended sensing into 3D, allowing each finger to function as a virtual joystick. ### Deep dive * **DRAM chips as cameras.** The Sensor Frame's most ingenious technical choice was using Micron IS32 OpticRAM 64K DRAM chips as image sensors. These were standard memory chips in ceramic DIP packages with glass windows — designed for UV-EPROM-style applications, not imaging. McAvinney realized their photosensitivity meant they could serve as crude 2D cameras. Each cell was written to '1', light exposure caused charged cells to leak to '0' at different rates depending on illumination, and the pattern was read back as a shadow image. Four such sensors in the frame's corners tracked finger silhouettes, with angle-side-angle trigonometry computing precise X,Y positions. * **The pinch-to-zoom origin.** Canonical pinch-to-zoom — two fingers moving apart to scale an object — was demonstrated on the Sensor Frame with coordinated graphics in 1985. Patent drawings show two fingers scaling the frequency of a displayed waveform (Figs 15a, 15b of US Patent 4,746,770). Other demonstrated gestures included two-finger knob rotation, marquee-style object selection, and amplitude scaling. The gestures were recognized in software running on a host computer at approximately 30Hz refresh rate. * **The Steve Jobs visit.** In October 1985, Steve Jobs visited CMU — months after being ousted from Apple, in the process of founding NeXT. According to CMU's The Link magazine (Summer 2017), Jobs signed a non-disclosure agreement before being allowed to tour the Sensor Frame lab and see the multi-touch technology in action. The visit is cited as evidence that Apple had direct, documented exposure to advanced multi-touch at CMU nearly 22 years before the iPhone's launch. * **The NASA Sensor Cube.** With NASA SBIR Phase II funding (contract NAS9-18686, circa 1991-92), McAvinney developed the Sensor Cube — a 3D volumetric variant that could detect finger approach angle in three dimensions. Each finger became a virtual joystick with 3D control at the point of contact. NASA was interested for spacecraft crew interfaces and telerobotics control where physical buttons were impractical. ### Team * **Paul McAvinney.** Lead inventor. Designed Sensor Frame hardware and software. Founded Sensor Frame Inc. Later gave TEDxGreenville talk (2014) * **Roger B. Dannenberg.** CMU faculty, computer music pioneer, co-creator of Audacity. Co-author on first Sensor Frame paper (ICMC 1984) * **M.T. Thomas.** Co-author on 1984 ICMC paper with Dannenberg and McAvinney * **Sharon R. Shepard.** Co-assignee on NASA-related patent work ### Media ![CMU Sensor Frame hardware](../assets/wiki/sensor-frame-hardware.jpg) *The Sensor Frame attached to a CRT monitor at CMU, from Bill Buxton's multi-touch overview. (Bill Buxton / Microsoft Research)* ![Patent drawing of pinch-to-scale gesture](../assets/wiki/sensor-frame-patent-pinch.jpg) *Patent drawing (Figs 15a-15b) showing two-finger pinch-to-scale gesture on a displayed waveform. (US Patent 4,746,770)* ### Sources 1. Bill Buxton — Multi-Touch Systems that I Have Known and Loved — https://www.billbuxton.com/multitouchOverview.html 2. US Patent 4,746,770 — Method and apparatus for isolating and manipulating graphic objects on computer video monitor — https://patents.google.com/patent/US4746770A/en 3. Dannenberg, McAvinney & Thomas — 'Carnegie-Mellon University Studio Report' (ICMC 1984) — https://quod.lib.umich.edu/i/icmc 4. O'Connell — 'The Untold History of MultiTouch,' The Link, CMU (Summer 2017) — https://www.cs.cmu.edu/sites/default/files/TheLink_Summer2017.pdf 5. McAvinney TEDxGreenville 2014 — 'Future of human/computer interface' — https://www.youtube.com/watch?v=UJ64qmQxDNk 6. NASA CR-185416 — Sensor Cube SBIR Phase II Final Report — https://ntrs.nasa.gov/citations/19940003261 7. Wikipedia — Multi-touch (history section) — https://en.wikipedia.org/wiki/Multi-touch --- ## Sega Hang-On (1985) **By:** Sega (Yu Suzuki / Sega R&D1) **Tags:** `HCI` `Arcade` `Motion` `Full-Body` `Gaming` ### Overview Hang-On was a 1985 arcade motorcycle racing game that pioneered the **full-body lean as primary control input**. Its deluxe cabinet was a full-size motorcycle body that the player straddled, steering by leaning the entire bike side-to-side. A twist-grip throttle controlled acceleration, and real motorcycle brake levers handled braking. The bike body was mounted on an axle with springs underneath, allowing controlled banking at various angles. The game was the first **taikan** (体感, 'body sensation') arcade title — a design philosophy created by director Yu Suzuki that moved arcade interaction from finger-operated controls to whole-body physical engagement. Hang-On sold approximately 20,000 arcade units worldwide, was the highest-grossing arcade game in the United States in 1985 and in both Japan and the United States in 1986, and launched Sega's decade of motion simulator dominance. Suzuki, a dedicated motorcyclist, built the game for '16-year-old males' who wanted to ride but couldn't get a license. The title references Freddie Spencer's 'hanging off' technique in Grand Prix racing. The iconic soundtrack was composed by Hiroshi Kawaguchi, marking the first Sega arcade game to use digitized drum samples. ### Deep dive * **The taikan philosophy.** Before Hang-On, every arcade game was played with fingers: buttons, joysticks, trackballs, spinners. Hang-On asked: what if the player's whole body was the controller? The deluxe cabinet put the player on a full-size motorcycle replica with a spring-loaded axle that translated body lean into steering angle. Tighter corners required further lean. The twist-grip throttle and brake levers were real motorcycle parts — so real they kept breaking under 12-hour arcade days. Suzuki originally wanted a gyroscope for acceleration tilt, a 50cc engine for authentic sound (rejected due to exhaust), and a fan linked to the throttle for wind. The taikan concept spawned Space Harrier, Out Run, After Burner, Power Drift, and the 360-degree rotating R360 cabinet. * **Development and team.** Directed by Yu Suzuki at Sega R&D1 (the nucleus of what became Sega AM2). A colleague brought Suzuki a torsion bar concept and asked him to design a game around it. Suzuki proposed the entire concept on a single densely-packed sheet of paper. Mechanical engineer Masaki Matsuno designed the motorcycle cabinet. Hiroshi Kawaguchi composed four rock tracks including the iconic main theme 'Theme of Love,' using PCM-sampled drums for the first time in a Sega arcade game. The arcade board used two Motorola 68000 CPUs with Sega's Super Scaler sprite-scaling technology. * **Commercial impact.** Hang-On was a phenomenon. Approximately 20,000 legitimate units sold worldwide by early 1991, plus an estimated 20,000-30,000 pirate units. Each deluxe cabinet cost approximately $6,700 USD. The game was the highest-grossing arcade video game of 1985 in the United States and the highest-grossing arcade game of 1986 in both Japan and the US. US machines earned so many coins that coin mechanisms had to be modified for higher-value coins. Sega's US arm could not keep up with demand. The game is credited by multiple sources with helping pull arcades out of the 1983 industry downturn. ### Team * **Yu Suzuki.** Director and lead programmer. Later headed Sega AM2, created Virtua Fighter, Shenmue. AIAS Hall of Fame (2003). * **Masaki Matsuno.** Mechanical engineer who designed the motorcycle cabinet and lean mechanism * **Hiroshi Kawaguchi.** Composer. Wrote Hang-On's iconic rock soundtrack, the first Sega arcade game to use PCM drum samples * **Yoji Ishii.** Designer. Created two of the game's courses and composed 'Goal' and 'Name Entry' tracks * **Hiroshi Hamagaki.** Chief artist ### Media ![Hang-On arcade cabinet](../assets/wiki/sega-hang-on-cabinet.jpg) *Sega Hang-On upright arcade cabinet. The deluxe ride-on version featured a full-size motorcycle body. (Wikimedia Commons)* ![Yu Suzuki at GDC 2011](../assets/wiki/yu-suzuki-gdc2011.jpg) *Yu Suzuki at the Game Developers Conference 2011. (Wikimedia Commons)* ### Sources 1. Wikipedia — Hang-On (GA-class article) — https://en.wikipedia.org/wiki/Hang-On 2. Sega Retro — Hang-On (production credits, cabinet photos, magazine coverage) — https://segaretro.org/Hang-On 3. Horowitz, The Sega Arcade Revolution (2018), pp. 92-97 — https://books.google.com/books?id=YKrHDwAAQBAJ 4. Phantom River Stone — Yu Suzuki SEGA Hard Historia Interview (March 2021) — https://www.phantomriverstone.com/2021/08/mar-2021-yu-suzuki-interview-sega-hard.html 5. Eurogamer — 'Out Ran: Meeting Yu Suzuki, Sega's original outsider' (2015) — https://www.eurogamer.net/out-ran-meeting-yu-suzuki-segas-original-outsider 6. Sega-16 — 'Sega Stars: Hiroshi Kawaguchi' by Ken Horowitz (2016) — https://www.sega-16.com/2016/02/sega-stars-hiroshi-kawaguchi/ --- ## UPIC (Unité Polyagogique Informatique CEMAMu) (1977) **By:** Iannis Xenakis / CEMAMu, Paris **Tags:** `HCI` `Music` `Drawing` `Tablet` `Synthesis` ### Overview The UPIC was a computerized music composition system that translated hand-drawn lines directly into synthesized sound, bypassing all traditional musical notation. Completed in 1977 at CEMAMu (Centre d'Études de Mathématique et Automatique Musicales) in Paris under the direction of composer-architect Iannis Xenakis, it consisted of a large electromagnetic drawing tablet connected to a Hewlett-Packard computer and a vector display. The fundamental interaction was elegantly simple: the X-axis represented time, the Y-axis represented pitch. A composer drew on the tablet (or on paper that was then digitized), and the computer synthesized the corresponding sound. Three stages: draw a waveform (timbre), draw an amplitude envelope (dynamics), compose on the time/pitch grid. Horizontal lines meant sustained pitches, diagonals meant glissandi, curves meant accelerating pitch changes. A child could use it. Xenakis called the system 'polyagogic' — his coinage from the Greek for 'many expressions' — because it put every musical parameter (pitch, timbre, dynamics, duration, glissandi, transformation) under the direct control of the hand. ### Deep dive * **From architecture to music.** Xenakis was a trained civil engineer who worked for Le Corbusier's architectural studio for 12 years. He designed the Philips Pavilion for Expo 58 entirely by himself — a sculptural structure of hyperbolic paraboloids. The same mathematical surfaces appeared in his music: the string glissandi in *Metastaseis* (1953-54) were drawn as straight lines on a time-versus-pitch grid, creating the same shapes as the Pavilion's concrete walls. Xenakis had been sketching music since the 1950s. The UPIC gave those sketches a voice. * **How it worked.** The UPIC workflow had three stages. Stage 1: draw a single-cycle waveform on the tablet — a sine wave, a sawtooth, a complex squiggle — defining the timbre. Stage 2: draw an amplitude envelope showing how loudness changes over time. Stage 3: on the main composition page (X=time, Y=pitch), draw pitch trajectories and assign saved waveforms/envelopes. The system rendered the sound. Real-time performance was also possible: moving the stylus across the tablet in real time. The entire original software was famously under one megabyte in size. * **Democratizing composition.** Xenakis designed UPIC to be usable by anyone, including children with no musical training. He wrote: 'Anybody, even myself or you, or children, can draw lines or graphics with an electromagnetic ballpoint, and they are transformed by computer directly into sound.' At KSYME, the Athens UPIC center founded in 1979, courses for up to 5,000 students aged 10-15 were announced in December 1986. * **Legacy and modern successors.** UPIC was the direct ancestor of graphical music creation tools. IanniX, an open-source graphical sequencer inspired by UPIC, is sponsored by the French Ministry of Culture. UPISketch, developed with the Centre Iannis Xenakis, runs on desktop and iOS. HighC continues the 'draw your music' tradition in education. The conceptual lineage extends to Max/MSP, MetaSynth, and image-to-sound software. Over 100 composers have created works with UPIC/UPIX, from Xenakis and Jean-Claude Risset to Aphex Twin. ### Team * **Iannis Xenakis.** Romanian-born Greek-French composer, architect, and engineer. Founded CEMAMu (1966). Designed UPIC. Composed *Mycènes Alpha* (1978), first UPIC piece * **CEMAMu.** Centre d'Études de Mathématique et Automatique Musicales, Paris. Founded by Xenakis with French Ministry of Culture support. Built the UPIC. Now Centre Iannis Xenakis at Université de Rouen * **KSYME.** Greek UPIC center founded 1979 in Athens by Xenakis, John G. Papaioannou, and Stefanos Vassiliadis. Acquired its own UPIC system in 1986 ### Media ![UPIC system at KSYME Athens](../assets/wiki/upic-system.jpg) *The UPIC system at KSYME, Athens, inaugurated in 1986 with Xenakis present. (Wikimedia Commons)* ![Iannis Xenakis in his Paris studio](../assets/wiki/xenakis-studio.jpg) *Iannis Xenakis in his Paris studio, c.1970. (Wikimedia Commons)* ### Sources 1. Wikipedia — UPIC — https://en.wikipedia.org/wiki/UPIC 2. Centre Iannis Xenakis — UPIC Presentation, Technology, Composers — https://www.centre-iannis-xenakis.org/cix_upic_presentation 3. Wikipedia — Iannis Xenakis — https://en.wikipedia.org/wiki/Iannis_Xenakis 4. ZKM — From Xenakis's UPIC to Graphic Notation Today (open access PDF) — https://zkm.de/en/from-xenakiss-upic-to-graphic-notation-today 5. Mode Records — Xenakis, UPIC, Continuum (2-CD compilation, mode 98/99) — https://moderecords.com/catalog/098_9ccmix.html 6. Aphex Twin interview — Future Music (July 2006), via Music Thing blog — http://musicthing.blogspot.com/2006/07/aphex-twin-interview-in-future-music.html 7. IanniX — Open-source graphical sequencer inspired by UPIC — https://www.iannix.org --- ## AtariLab (1983) **By:** Priscilla Laws (Dickinson College), David Egolf (software), Leslie Wolf (product manager) / Atari, Inc. Learning Systems **Tags:** `Education` `Sensors` `Physical Computing` `Input Device` `STEM` ### Overview AtariLab was an educational hardware/software system released by Atari, Inc. in late 1983 that transformed the Atari 8-bit home computer into a real-time scientific data acquisition instrument. The system consisted of a breakout box that plugged into the Atari's joystick port and accepted colour-coded RCA-jack sensor probes — a thermistor-based temperature probe (Starter Set, $89.95) and a photoresistor-based light probe (Light Module, $49.95). The Atari's POKEY chip, originally designed to measure paddle controller position by timing capacitor charging rates, was repurposed to digitize analog sensor readings. Students could measure real-world physical phenomena — a cooling curve of hot water, the friction of rubbing a surface, the temperature of their own skin — and see the results plotted as real-time strip charts, digital thermometers, and animated graphs on a CRT television. A 144-page manual provided over 100 experiments. The system was the brainchild of Dickinson College physics professor Priscilla Laws, who envisioned the home computer as an affordable laboratory instrument. The software was programmed by 15-year-old middle-school student David Egolf (who later earned a physics PhD from Duke). Atari product manager Leslie Wolf shepherded the project through Atari's Learning Systems division. A Commodore 64 version was completed, and an Apple II port was underway. AtariLab was killed in July 1984 when Warner Communications sold Atari to Jack Tramiel. Planned modules — Biofeedback (galvanic skin response, heart rate), Motion (ultrasonic sensor), pH, Mechanics, Crimelab, and Robotics — were cancelled. Only small numbers of the Temperature and Light modules shipped commercially. However, the concept survived: Laws later co-developed the Universal Laboratory Interface (ULI) for IBM PCs, manufactured by former Atari colleague Ron Budworth and sold through Vernier Software & Technology, which sold approximately 40,000 units and became the dominant force in science-education probeware. ### Deep dive * **The Joystick Port Hack.** At the hardware level, AtariLab was a brilliant repurposing of existing consumer electronics. The Atari 8-bit computer's POKEY chip included eight potentiometer (paddle) input lines. Each line worked by timing how long a capacitor took to charge through a variable resistor — in a game controller, this was a potentiometer attached to a paddle knob. AtariLab replaced the potentiometer with a thermistor or photoresistor: as temperature or light changed, the resistance changed, the capacitor charging time changed, and the POKEY chip reported a different value (0–228 in the POT registers). In Atari BASIC, accessing a sensor was as simple as reading `PADDLE(2)`. The colour-coded RCA jacks on the breakout box and matching probes made the system physically legible — no calibration needed, just match the colours and plug in. The interface box also provided joystick-trigger digital inputs and a tap from the computer's +5V power rail, with a red LED to show power status. It was, in essence, an Arduino sensor shield for a 1983 game console. * **Real-time Feedback and the Learning Loop.** The pedagogical insight behind AtariLab was temporal: traditional school labs required students to take manual measurements, graph them on paper, and analyze results long after the experiment ended — a 15–20 minute gap that broke the connection between action and understanding. AtariLab collapsed this to real-time. A student dipped the temperature probe in hot water and watched a cooling curve draw itself on screen. They could immediately ask 'what if I add ice?' and watch the curve change. Multiple experiments could be run in a single class period, enabling genuine hypothesis testing. This 'computer as laboratory partner' model was later formalized as microcomputer-based laboratories (MBL), a paradigm that now dominates science education worldwide. * **The 15-Year-Old Programmer.** The software for both shipped modules was written by David Egolf, a 15-year-old middle-school student in Carlisle, Pennsylvania — the same town as Dickinson College. Laws discovered Egolf's programming talent and recruited him. He coded the Temperature and Light module software, including the graphical displays, data logging, and experiment frameworks. The software won the 1984 Software of the Year Award from Classroom Computer Learning magazine. Egolf went on to earn a PhD in physics from Duke University and became an associate professor at Georgetown University. His story — a teenager writing production scientific software for a major corporation — captures the era's unusual openness and the proximity of amateur skill to professional opportunity in early microcomputing. * **Collapse and Resurrection.** On July 1, 1984, Warner Communications — hemorrhaging over $1 million per day from the video game crash — sold Atari to Jack Tramiel for $50 in cash and $240 million in promissory notes. The AtariLab team was laid off. Product manager Leslie Wolf recalled telling the manufacturing team: 'They don't know you're here. Keep working until you don't get a paycheck anymore.' A small number of Atari 8-bit and Commodore 64 units were pressed; the Apple II version was abandoned. But Priscilla Laws did not stop. She had seen what home-computer sensing could do for education. She partnered with Ron Thornton (Tufts University) and Robert Tinker (TERC) to develop Workshop Physics, a calculus-based curriculum with no lectures — entirely lab-based. Laws contacted former Atari colleague Ron Budworth, who designed a new analog interface called the Universal Laboratory Interface (ULI) for the IBM PC. Vernier Software & Technology handled sales. The ULI sold approximately 40,000 units and launched Vernier as the dominant probeware company in science education — a direct lineage from Atari's joystick port. * **The Modules That Never Shipped.** At least twelve additional modules were announced in contemporary press but cancelled when Atari collapsed: Biofeedback (galvanic skin response and heart rate), Motion (ultrasonic distance sensor — the only one under active development at the time of collapse), pH, Mechanics (multiple modules), Crimelab (with a lie detector program), Timekeeper, Advanced Temperature (disk-based, higher temperature range), Reaction Time, Nuclear Radiation, and Robotics (motor/servo output control). A doctor at the University of Pennsylvania planned to replace $1,300 of analytical lab equipment with a $140 AtariLab station for X-ray film analysis. The scope was extraordinary — a planned ecosystem of a dozen+ scientific modules for a consumer game console, killed by market forces that had nothing to do with its educational value. ### Team * **Dr. Priscilla Watson Laws (1940–2023).** Physics professor, Dickinson College. Conceived AtariLab, designed experiments, wrote the manual. Later won the Millikan Medal (1996) and pioneered Workshop Physics. * **David Egolf.** Software developer for Temperature and Light modules, age 15 at the time. Later PhD in physics from Duke, associate professor at Georgetown. * **Leslie Wolf.** Atari product manager for Atari Logo and AtariLab, 1981–1984. Shepherded the project through Atari's corporate turmoil. * **Mike Nalblah.** Atari internal champion who helped green-light the project. * **Ron Budworth.** Former Atari colleague who later designed the Universal Laboratory Interface (ULI) for IBM PC, sold through Vernier Software. * **Atari Learning Systems.** Division of Atari, Inc. that produced AtariLab, Atari Logo, and other educational products. * **Vernier Software & Technology.** Company that sold ~40,000 ULI units, becoming the dominant science-education probeware supplier — direct descendant of AtariLab. ### Media ![AtariLab temperature module in use with probe in glass of water](../assets/wiki/atarilab-temperature.jpeg) *AtariLab Starter Set in use: Atari 800 computer, interface box, temperature probe in a glass of water, and CRT display showing real-time data. Photo by Brian Jepson, CC BY-SA 2.5. Wikimedia Commons.* ![AtariLab hardware: interface box, probe, and cartridge](../assets/wiki/atarilab-hardware.jpg) *AtariLab hardware: interface box with colour-coded RCA jacks, temperature probe, and cartridge. From Antic Magazine, October 1984.* ![AtariLab screen display and classroom use](../assets/wiki/atarilab-display.jpg) *AtariLab screen display and classroom use. From Antic Magazine, October 1984.* ### Sources 1. Wikipedia — AtariLab — https://en.wikipedia.org/wiki/AtariLab 2. ANTIC Magazine: "Inside Atari: AtariLab" by Charles Jackson (October 1984) — https://www.atarimagazines.com/v3n6/atarilab.html 3. ANTIC Interview 86 — Dr. Priscilla Laws (podcast, 2015) — http://ataripodcast.libsyn.com/antic-interview-86-dr-priscilla-laws-atarilab 4. ANTIC Interview 87 — Leslie Wolf, Product Manager (podcast, 2015) — http://ataripodcast.libsyn.com/antic-interview-87-leslie-wolf-product-manager-for-atari-logo-and-atarilab 5. Atari Connection Vol. 4 No. 2: "Body Heat" biofeedback article (Summer 1984) — https://archive.org/stream/Atari_Connection_Volume_4_Number_2_1984-06_Atari_US 6. Priscilla Laws — Wikipedia — https://en.wikipedia.org/wiki/Priscilla_Laws 7. David Egolf bio and AtariLab history — http://site.physics.georgetown.edu/~egolf/bio.html 8. Dickinson College Digital Museum: AtariLab Temperature Module — https://web.archive.org/web/20230207182731/https://dh.dickinson.edu/digitalmuseum/exhibit-artifact/defining-the-computer/atarilab-temperature-module --- ## SGI Dial and Button Box (1986) **By:** Silicon Graphics, Inc. (SGI), Mountain View, California. OEM-manufactured by Danaher Controls (DLS80-1022) and a Japanese OEM (SN-921) **Tags:** `Input Device` `3D Interaction` `Professional Workstation` `Bimanual` `Physical Controls` ### Overview The SGI Dial and Button Box was a dedicated 3D input peripheral for Silicon Graphics IRIS workstations, shipping from approximately 1986 through the mid-1990s. It provided eight large continuous-rotation optical encoder dials and thirty-two momentary pushbuttons in a 4×8 grid, housed in a dark grey metal chassis approximately 12–14 inches wide with an angled upright stand. The dials had no detents and no end stops — they spun freely, each revolution generating 256–1,024 counts depending on driver scaling. The buttons featured removable transparent keycaps for paper labels. Connection was via a single DE-9 RS-232 serial port at 9600 baud (some models required a separate 5V DC power brick). The device reported 6-byte packets containing signed 16-bit dial deltas and button state. Two known production models exist: the DLS80-1022 (manufactured by Danaher Controls, USA) and the SN-921 (Japanese OEM, different chassis design). In professional 3D software — Alias PowerAnimator, Wavefront Advanced Visualizer, Softimage 3D — the dials were typically mapped to spatial navigation: three axes of rotation, one zoom, two pan, and two auxiliary parameters. The non-dominant hand (usually left) worked the dials for continuous spatial adjustments, while the dominant hand operated the mouse for discrete selection and menu interaction. This asymmetric bimanual workflow, studied by Bill Buxton's HCI group at the University of Toronto, mapped cleanly onto Guiard's Kinematic Chain Model of human bimanual action. The dial box was also rebadged for Sun Microsystems workstations. Driver support persisted in IRIX through the late 1990s, and third-party Linux/Xorg drivers were later developed by the open-source community. ### Deep dive * **The Instrument Philosophy of Interface Design.** The dial box represents a design philosophy that treats a computing workstation as an instrument, not an appliance. In this worldview, parameters deserve dedicated, physically present controls — each dial has a fixed meaning, and the user's body learns that meaning through proprioception and muscle memory. After weeks of use, an animator could reach for the 'zoom' dial without looking, the way a violinist finds a position on the fingerboard. This philosophy has deep roots: analog scientific instruments, the LINC computer's eight built-in knobs (1962), Evans & Sutherland's custom CAD control panels, and audio mixing consoles all embodied it. The dial box was one of its last mass-produced expressions before everything collapsed into the mouse-and-software-widget model. It asks a question that still hasn't been answered: why do audio engineers still mix on physical consoles, but 3D artists lost their knobs? * **Two-Handed Interaction Before It Was Studied.** The dial box shipped years before HCI researchers formalized asymmetric bimanual interaction. When Bill Buxton's group at the University of Toronto began studying two-handed input in the late 1980s, they used SGI dial boxes as their primary experimental platform. The device perfectly embodied what Yves Guiard (1987) described in his Kinematic Chain Model: the non-dominant (left) hand sets and adjusts the spatial frame of reference (coarse, continuous, low-frequency actions on the dials), while the dominant (right) hand performs precise operations within that frame (fine, discrete, high-frequency actions with the mouse). Animators didn't need a theory to tell them this worked — they discovered it through daily practice, developing a fluency with 8-axis simultaneous adjustment that no mouse could replicate. * **Muscle Memory as a Design Goal.** Modern UX design rarely treats muscle memory as an explicit design goal for parameter control. The dial box was built around it. Each dial was physically distinct by position — same size and feel, but the spatial layout was fixed and learnable. The 32 buttons had transparent keycaps for paper labels, allowing per-software customization. Professional animators working 8–12 hour sessions developed reflexive, unconscious access to parameters that, in a mouse-only workflow, would require repeated attention-shifting between the model and the toolbar. The dial box acknowledged something that software-only interfaces often forget: when your hands know where something is, your eyes can stay on the work. * **The Mapping That Survived.** The dial box died as a product, but its parameter layout became immortal. The standard mapping — three outer dials for X/Y/Z rotation, one for zoom/dolly, two for X/Y pan, and two for auxiliary functions — was adopted by virtually every 3D software package's navigation widget. Maya, Blender, Cinema 4D, Fusion 360: their orbit/zoom/pan tools all inherit the SGI dial box's axis assignments. Even the 3Dconnexion SpaceMouse (which replaced the dial box) offers the same degrees of freedom in a single puck. The physical knobs are gone, but their conceptual layout is burned into every 3D application you use today. * **The Modern Spiritual Successors.** In recent years, the dedicated-physical-control philosophy has seen a renaissance through programmable control surfaces: Elgato Stream Deck, Loupedeck, Monogram Creative Console, and MIDI controllers mapped to Blender or Maya. These devices attempt to restore what the dial box offered — dedicated, task-specific physical controls that the user's body can learn. They are not identical (most use buttons and sliders rather than infinite-rotation encoders), but they are direct descendants of the same idea: that creative professionals deserve instruments, not just toolbars. ### Team * **Silicon Graphics, Inc. (SGI).** Mountain View, CA. Founded by Jim Clark (1981). The dial box was an internal hardware tools-group project. * **Danaher Controls.** OEM manufacturer of the DLS80-1022 model. Industrial controls company (now part of Fortive). * **Bill Buxton.** HCI researcher at University of Toronto who used the SGI dial box as a platform for foundational bimanual input studies. ### Media ![SGI Dial and Button Box DLS80-1022 front view](../assets/wiki/sgi-dial-box-front.jpg) *SGI Dial and Button Box DLS80-1022 model: 8 large machined-aluminum dials and 32 programmable buttons. Manufactured by Danaher Controls. Photo by Tpikonen, CC BY-SA 3.0. Wikimedia Commons.* ![SGI Dial and Button Box DLS80-1022 rear view](../assets/wiki/sgi-dial-box-back.jpg) *Rear view showing the DE-9 serial connector and Danaher Controls label. Photo by Tpikonen, CC BY-SA 3.0. Wikimedia Commons.* ![SGI Dial and Button Box SN-921 front view](../assets/wiki/sgi-dial-box-sn921.jpg) *Alternate SN-921 model with Japanese OEM chassis and slightly smaller dials. Photo by Tpikonen, CC BY-SA 3.0. Wikimedia Commons.* ### Sources 1. Silicon Graphics — Wikipedia — https://en.wikipedia.org/wiki/Silicon_Graphics 2. Wikimedia Commons: Silicon Graphics dial box category — https://commons.wikimedia.org/wiki/Category:Silicon_Graphics_dial_box 3. Buxton, W. & Myers, B. "A Study in Two-Handed Input" (CHI 1986) — https://dl.acm.org/doi/10.1145/22627.22390 4. Guiard, Y. "Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model" (Journal of Motor Behavior, 1987) — https://www.tandfonline.com/doi/abs/10.1080/00222895.1987.10735426 5. Zhai, S. "Human Performance in Six Degree of Freedom Input Control" (PhD thesis, University of Toronto, 1995) — https://www.cs.toronto.edu/~zhai/thesis.html 6. Computer History Museum collections (SGI hardware) — https://www.computerhistory.org/collections/ --- ## Sega R360 (1990) **Motion-Based Arcade Cabinet** ### Overview The R360 is a motion-based arcade cabinet produced by Sega and released in Japan in November 1990. Short for "Rotate 360," the R360 is a gyroscopic motion simulator capable of rotating a full 360 degrees on two axes, physically orienting the player's body to match in-game vehicle attitude — including complete inversion. The player is strapped into a four-point safety harness inside an enclosed fiberglass cockpit suspended within a gimbal ring. Two 1.5 kW AC servo motors per axis provide motion up to 2Gs. The cabinet weighs 1,100 kg (2,200 lbs), stands 2.4 meters tall, and required a 4.5m × 4.5m installation area with a safety fence and dedicated attendant tower. Two games were officially released: *G-LOC: Air Battle* (1990) and *Wing War* (1994, requiring two linked cabinets). Players could select an "experience" mode that ran the demo while the cockpit moved — a ride, not a game. With an estimated 100–200 units produced at a cost of approximately $90,000 each (£70,000 in the UK), the R360 was a commercial failure that only the largest arcade operators could afford. ### Deep Dive **Origins.** The R360 was designed by Sega AM2, the legendary development studio led by Yu Suzuki that created *Hang-On*, *Space Harrier*, *Out Run*, *After Burner*, and *Virtua Fighter*. Mechanical engineers Masao Yoshimoto and Masaki Matsuno led the hardware design, with electrical engineering by Futoshi Ito. The R360 was part of Sega's broader strategy to create attraction-like "taikan" (body sensation) games for Japanese amusement centers — cabinets that were destinations in themselves. It was first tested in Sega's Tokyo arcades in early 1990 and exhibited internationally at the UK's Amusement Trades Exhibition International in 1991. **Safety as interaction design.** The R360's safety systems are an extraordinary case study in the collision between interface ambition and biological limits. The cabinet incorporated: a four-point safety harness; light sensors that would automatically stop the machine if a player extended an arm or leg outside the cockpit (which caused problems when the R360 sat in direct sunlight); two emergency stop buttons (one inside the cockpit, one on the attendant tower); a sensor grid that triggered an alarm if anyone approached the moving assembly; and a mandatory safety fence. Sega's official warnings barred use by anyone with heart conditions, high or low blood pressure, pregnancy, intoxication, or "mental or physical problems." British magazine *The One* noted the motion sickness but still called it "the greatest sensory overload you are ever likely to get without taking your trousers off." At London's Trocadero, a single ride cost £3 in 1991. **Kinesthetic HCI at the extreme.** The R360 represents the theoretical endpoint of mechanical whole-body kinesthetic output in a commercial interface. All in-game physics — pitch, roll, yaw — transposed directly onto the player's physical orientation through direct-drive servo motors. The cabinet did not simulate motion; it performed it. The player's body became payload, carried through the same physical trajectory as the on-screen vehicle. The machine's failure was inseparable from its ambition: it was too expensive to buy ($90,000), too complex to maintain (Sega did not include schematics, and the circuitry was prone to failure), and too physically demanding to play casually. It required a 3-phase industrial power supply and a trained attendant at all times. In HCI terms, the R360 demonstrates that perfect kinesthetic fidelity is not always desirable — the human body has limits, and exceeding them makes an interface unusable. **Legacy.** Retired within a few years, the R360 became a cult artifact. Retro Gamer magazine called it "the pinnacle of what could be achieved in videogames at the time" and said it "shows the dominance Sega had in the industry." A spiritual successor, the R360Z, was introduced by Sega in 2015 at Tokyo Joypolis for *Transformers: Human Alliance*, seating two passengers. The R360's core idea — direct mechanical transposition of game physics onto player orientation — remains unmatched in any consumer-grade device. ### Team - **Masao Yoshimoto**: Mechanical engineer, Sega AM2 - **Masaki Matsuno**: Mechanical engineer, Sega AM2 - **Futoshi Ito**: Electrical engineer - **Sega AM2**: Development studio; Yu Suzuki's division - **Sega Enterprises, Ltd.**: Manufacturer and publisher ### Media ![Sega R360 arcade cabinet showing the spherical cockpit within its gyroscopic gimbal ring](../assets/wiki/sega-r360-cabinet.jpg) *The R360 arcade cabinet. Sega Retro, CC-BY 4.0.* ![R360 logo](../assets/wiki/sega-r360-logo.png) *R360 product logo. Sega Retro.* ![Sega R360 machine with player visible inside the cockpit](../assets/wiki/sega-r360-machine.png) *R360 cabinet at an arcade exhibition. Wikipedia.* ### Sources 1. R360 — Wikipedia — https://en.wikipedia.org/wiki/R360 2. R360 — Sega Retro — https://segaretro.org/Sega_R360 3. Horowitz, Ken. *The Sega Arcade Revolution* (2018), pp. 177–184 4. Cook, John. "Arcades: R360" — *The One*, May 1991, pp. 74–75 — https://archive.org/details/theone-magazine-32/page/n123 5. *Cash Box*, "Sega's R360," 26 January 1991, p. 22 — https://archive.org/details/cashbox54unse_22/page/22 6. Time Extension: "Sega's vomit-inducing R360 is an endangered species" — https://www.timeextension.com/features/segas-vomit-inducing-r360-is-an-endangered-species-from-a-different-age 7. *Popular Mechanics*, "Tech Update: Coin-Op Simulation Dogfight," April 1991, p. 20 8. 4Gamer: Interview with Masao Yoshimoto and Masaki Matsuno (Japanese) — https://www.4gamer.net/games/999/G999905/20200704005/ --- ## Akai EWI 1000 (1987) **Electronic Wind Instrument / Capacitive Touch Controller** ### Overview The Akai EWI 1000 is the first commercially released electronic wind instrument controller, introduced in 1987. Invented by Nyle Steiner of Utah, the EWI (Electronic Wind Instrument) looks something like a soprano saxophone or clarinet — straight, held in front of the body with a neck strap, with a silicone mouthpiece at the top. But instead of mechanical keys, the EWI uses body-capacitance touch sensing on every playing surface. A finger touching a key changes a local capacitance field detected by an oscillator circuit, requiring zero physical travel. The mouthpiece contains a breath pressure sensor (controlling dynamics via MIDI Breath Control) and a bite pressure sensor (controlling vibrato or other modulation parameters). The left thumb selects octave by rolling between four rollers; the right thumb controls pitch bend via two touch plates. The EWI was sold as a two-part system: the handheld controller and a rackmount digitally-controlled analog synthesizer unit. It outputs MIDI, allowing it to control any external synthesizer. ### Deep Dive **Nyle Steiner and the genesis of capacitive wind control.** Nyle Steiner was a self-taught engineer and trumpet player from Utah who began experimenting with electronic wind instruments in the 1970s. His first design was the EVI (Electronic Valve Instrument), a brass-style fingering controller that used touch-sensitive metal pads instead of mechanical valves. After bringing the EVI to market through his company Steiner-Parker, he developed the EWI — a woodwind-style fingering system with a radically different design philosophy. Instead of closing or opening physical holes (as an acoustic instrument would), each EWI key acts as a pitch modifier that can change note values by plus or minus a half step or whole step. This means fingerings that are impossible on acoustic instruments become possible on the EWI. **Capacitive touch in 1987.** The EWI's capacitive sensing uses body capacitance — the natural electrical charge of a human finger — to detect contact. The keys are stationary metal plates connected to oscillator circuits. When a finger approaches or touches a key, it alters the local capacitance, changing the oscillator's frequency or amplitude. Because the keys don't move, there is no mechanical travel time, no key noise, no bounce, and no physical wear. This allows faster note onsets than any mechanical switch could achieve. The technology predates capacitive touchscreens in consumer electronics by approximately 20 years. The EWI also allowed "partial touch" — fingers hovering or lightly grazing a key could produce different results than firm contact — a dimension of expression absent from mechanical keyboards and buttons. **Three simultaneous continuous channels.** The EWI's interaction model combines three independent real-time continuous input channels: breath pressure (controlling volume and dynamics), bite pressure (controlling vibrato or pitch modulation), and capacitive finger position (controlling note pitch and articulation). A saxophone player produces sound through embouchure, breath control, and fingering — the EWI maps each analog dimension to an electronic sensor and transmits the combined signal as MIDI data. The left thumb rolls between octave rollers to shift range, an action analogous to a saxophone's octave key but implemented as a continuous rolling motion. The right thumb operates two pitch-bend plates, allowing smooth glides between notes. This created an instrument where a single human gesture — breathing harder while biting the mouthpiece and sliding a finger — could produce a compound musical expression impossible to achieve with separate knobs and sliders. **Commercial life and musical impact.** Akai Professional manufactured and distributed the EWI after licensing Steiner's design. The EWI 1000 (1987) was followed by the EWI 3000 and EWI 3020 (mid-1990s), EWI 4000s (2005), EWI 5000 (2014), and EWI SOLO (2020). The instrument found a dedicated following among jazz fusion musicians, particularly in Japan, where T-Square members Takeshi Itoh and Masato Honda used it extensively. Michael Brecker, Bob Mintzer, and other notable saxophonists adopted it. The EWI's unusual fingering system — where the same fingering produces the same note name in every octave — made it easier to learn than acoustic woodwinds, but the lack of mechanical feedback (no keys that "press down") disoriented some traditional players. ### Team - **Nyle Steiner**: Inventor of the EWI and EVI; self-taught engineer and trumpet player from Utah - **Akai Professional**: Manufacturer and distributor ### Media ![An Akai EWI 3020 electronic wind instrument on a white background](../assets/wiki/akai-ewi-3020.jpg) *Akai EWI 3020, a later model in the same lineage. Photo by Funkymac, CC-BY-SA 3.0 / GFDL. Wikimedia Commons.* ![Musician Chase Baird playing an Akai EWI1000 during a 2019 performance](../assets/wiki/akai-ewi-chase-baird.jpg) *Chase Baird playing an Akai EWI1000 at LantarenVenster, Rotterdam, 2019. Photo CC-BY 2.0. Wikimedia Commons.* ### Sources 1. Electronic Wind Instrument — Wikipedia — https://en.wikipedia.org/wiki/Electronic_wind_instrument 2. Nyle Steiner Homepage — Patchman Music — https://www.patchmanmusic.com/NyleSteinerHomepage.html 3. Walters, John. "The Search For Expression: A History of Wind Synthesizers" — *Sound on Sound*, September 1987 — https://www.muzines.co.uk/articles/the-search-for-expression/2505 4. Walters, John. "Wind Synthesizers" (EWI vs Yamaha WX7 comparison) — *Sound on Sound*, December 1987 — http://www.muzines.co.uk/articles/wind-synthesizers/2549 5. Pimentel, Bret. "Flexible EWI fingerings" — https://bretpimentel.com/flexible-ewi-fingerings/ 6. Swallow, Matthew J. "MIDI Electronic Wind Instrument: A Study of the Instrument and Selected Works" — DMA dissertation, West Virginia University, 2016 — https://doi.org/10.33915/etd.6750 --- ## Armatron (1984) **By:** Tomy (distributed in the US by Radio Shack) **Tags:** `HCI` `Robot` `Teleoperation` `Toy` `Mechanical` `Embodied` ### Overview The Armatron is a tabletop robotic arm toy made by Tomy and distributed by Radio Shack in the United States beginning in 1984. It consists of a crane-like arm with a two-fingered gripper that can pick up and manipulate small objects. The arm has six degrees of freedom: wrist rotation (unlimited), vertical wrist flexing, horizontal elbow bending, shoulder horizontal rotation (unlimited), shoulder elevation, and gripper open/close. The arm is almost purely mechanical. The only electrical components are a single DC motor, switch contacts in a countdown timer (disguised as an 'energy level' indicator), and the batteries. The dual joysticks selectively engage or disengage gears on a set of rotating gear drums — each joystick intuitively maps to specific axes of the arm. The result is direct, isomorphic kinesthetic control. There is no computer, no programming language, no digital interface whatsoever. The toy came with a module pack of plastic items: two stepped cones, two spheres, two cylinders, a flat base module, and a hinged-lidded box. The challenge was to use the arm to move the spheres and cones from the top of the box to the flat module, open the box lid, and extract the cylinders — all within the time limit set by the countdown timer. Models with alternate decals or coloring were marketed as the Super Armatron and Armatron II. A mobile version with a wired remote succeeded the original stationary version. ### Deep dive * **Inventor.** The lead inventor of the Armatron was Hiroyuki Watanabe, a toy designer who worked for Tomy in Tokyo, Japan for 49 years. According to Watanabe, the dual joystick controls were directly inspired by his hobby flying radio-controlled helicopters, where dual joysticks are used to control multiple axes simultaneously. The Armatron is essentially a simplified, ground-based version of the same kinesthetic control paradigm. Canadian patent #1237453 covers the mechanical design. Watanabe's story was featured in MIT Technology Review in April 2025, which called the Armatron a toy that 'inspired modern robotics.' * **Interaction Model.** The Armatron's interaction model is pure teleoperation: the user's hands are the master, the arm is the slave, and the mapping is direct and transparent. Each joystick axis corresponds intuitively to an arm axis — moving the left joystick forward/back might control shoulder elevation, while twisting it might rotate the shoulder. The right joystick might control elbow flex and wrist motion, with the trigger operating the gripper. There is no abstraction layer: the mechanical gear train IS the mapping function. The 'energy level' countdown timer adds a game-like constraint. The user sets an initial level from 1 to 10 units, and the arm shuts off when time runs out. This turns teleoperation into a timed dexterity challenge: can you rearrange all the geometric objects before the power cuts out? This stands in stark contrast to the digital programming interfaces of other contemporary robotic toys like Big Trak (keypad-programmed) or HERO 1 (computer-programmed). The Armatron eliminates programming entirely in favor of real-time manual control, embodying a philosophy closer to musical instrument design than computer science. * **HCI Significance.** The Armatron is significant for two reasons. First, it made teleoperation accessible to consumers at an unprecedented price point. Industrial robot arms of the early 1980s cost tens of thousands of dollars; the Armatron cost $40. It gave children — and curious adults — direct kinesthetic experience with a six-axis manipulator, demystifying the robotic arms they saw on factory floors and in science fiction. Second, the purely mechanical implementation is an elegant counterpoint to digital HCI. In an era when computers were rapidly digitizing every interface, the Armatron demonstrated that precision mechanical linkages could still provide satisfying, intuitive control without a single line of code. It is HCI without the C — human-machine interaction reduced to its physical essence. ### Team * **Hiroyuki Watanabe.** lead inventor at Tomy, Tokyo; 49-year Tomy veteran; inspired by his RC helicopter hobby * **Tomy (now Takara Tomy).** Japanese toy manufacturer; designed and manufactured the Armatron * **Radio Shack.** US distributor of the Armatron ### Media ![Tomy Armatron robotic arm with dual joystick controls, showing the arm structure, gripper, and control base](../assets/wiki/armatron-1.jpg) *Tomy Armatron with dual joystick controls and two-finger gripper. Source: Wikimedia Commons.* ### Sources 1. Armatron - Wikipedia — https://en.wikipedia.org/wiki/Armatron 2. Hawkins, William J. 'What's new in Electronics.' Popular Science, March 1984 — https://books.google.com/books?id=rAAAAAAAMBAJ&pg=PA114 3. Canadian Patent #1237453 (Armatron mechanism) — https://www.ic.gc.ca/opic-cipo/cpd/eng/patent/1237453/summary.html 4. 'How a 1980s toy robot arm inspired modern robotics.' MIT Technology Review, April 17, 2025 — https://www.technologyreview.com/2025/04/17/1114456/toy-armatron-modern-robotics-ai-nostalgia/ 5. Armatron color/model variants and internal component photos — http://www.theoldrobots.com/armatron2.html 6. Description of internal mechanical components — http://www.starborneworks.com/?p=22 --- ## Big Trak (1979) **By:** Milton Bradley Company **Tags:** `HCI` `Robot` `Programming` `Education` `Toy` `Embodied` ### Overview Big Trak is a programmable six-wheeled toy tank created by Milton Bradley in 1979. Resembling a futuristic sci-fi utility vehicle, it features a front-mounted blue 'photon beam' headlamp and a membrane keypad on top. The toy is powered by a Texas Instruments TMS1000 microcontroller and can remember up to 16 commands — forward/backward in body-lengths, left/right turns in 15-degree increments, pause, fire, and a primitive RPT (repeat) loop instruction — which it then executes in sequence. An optional cargo trailer accessory could be programmed to dump its payload. The interaction is entirely self-contained: there is no screen, no external computer, no compiler. The user builds a program by pressing keys on the toy itself, then presses GO to execute it in the physical world. The feedback is purely embodied — success or failure is measured in whether the tank navigates around furniture or collides with it. This made Big Trak one of the earliest consumer devices to introduce non-experts (children) to procedural/logical sequencing and turtle-graphics-style programming concepts. The original US version was moulded in gray plastic and labeled 'BIG TRAK', while the UK/European version was white and labeled 'bigtrak' with a different keypad layout. A Soviet clone was produced under the Elektronika IM-11 designation (named 'Lunokhod' after the Soviet Moon rover programme). A licensed replica was released by Zeon Ltd in 2010. ### Deep dive * **Origins.** Big Trak was conceived at Milton Bradley, the venerable board game and toy company. The story of its origin became the subject of a 2024 episode of This American Life (Episode 827, Act One), in which Peter Ocko recounts his father's role in the idea and the subsequent lawsuit the family filed against Milton Bradley. The toy launched in 1979, powered by the Texas Instruments TMS1000 — the same 4-bit microcontroller family that powered Speak & Spell — with separate battery supplies for the logic (9V) and motors (4× D cells) to prevent electrical noise from resetting the microcontroller. * **Interaction Model.** The programming interface is a membrane keypad on the vehicle's top surface. Commands include: Forward/Backward (in units of one body-length), Left/Right (in units of roughly 1/60th of a full rotation, or 6 degrees — though labelled as 'minutes' on the keypad), HOLD (pause in 1/10 second units), FIRE (activate the photon beam light), CLR (clear program), CLS (clear last step), RPT (repeat a number of steps — a primitive loop construct), TEST (run a short built-in test program), CK (check last instruction), and OUT (activate optional trailer dump). There were no LED displays or any way to review a stored program other than running it. The IN command was reserved for future expansion but was never fully implemented in production hardware. The programming model resembles turtle graphics from the Logo programming language — spatial commands that move an agent through the world — but with a crucial difference: Logo turtles live on a screen with instant visual feedback. Big Trak executes in physical space, where friction, carpet pile, battery charge, and furniture all affect the outcome. The gap between the abstract program and its embodied execution is the whole point. * **Computer Control and Hacking.** In February 1981, Steve Ciarcia published an article in BYTE magazine ('A Computer-Controlled Tank') detailing how to control Big Trak with a personal computer via a radio interface, effectively turning it into a home robot peripheral. In the 2000s and 2010s, hobbyists reverse-engineered the TMS1000 and developed Arduino and Raspberry Pi interfaces, preserving Big Trak as a platform for modern robotics experimentation. The 2010 Zeon replica uses surface-mount components and hall-effect motor sensors instead of the original optical detectors. * **Scientific Research Platform.** In the early 1980s, the psychology of science community led by David Klahr's laboratory at Carnegie Mellon University adopted Big Trak as a research vehicle for studying instructionless learning, scientific discovery, cognitive development, and dual space search. Participants were given a Big Trak with no manual and asked to figure out how it worked. The research was published in Klahr's 2000 book 'Exploring Science: The Cognition and Development of Discovery Processes' (MIT Press). Big Trak remains, to this day, one of the only consumer toys to be adopted as a formal instrument of cognitive science research. ### Team * **Milton Bradley Company.** manufacturer and publisher * **Peter Ocko (father).** claimed originator of the concept; family sued Milton Bradley * **Texas Instruments.** supplier of the TMS1000 microcontroller * **Steve Ciarcia.** published BYTE magazine article on computer-controlling Big Trak via radio (1981) * **David Klahr.** Carnegie Mellon University; used Big Trak for cognitive science research in the 1980s ### Media ![A white UK version of Big Trak on a white background, showing the six-wheeled tank form factor and top-mounted keypad](../assets/wiki/big-trak-1.jpg) *UK/European Bigtrak model (white, with different keypad layout from the US gray version). Source: Wikimedia Commons.* ### Sources 1. Big Trak - Wikipedia — https://en.wikipedia.org/wiki/Big_Trak 2. Ciarcia, Steve. 'A Computer-Controlled Tank.' BYTE, February 1981, p. 44 — https://archive.org/stream/byte-magazine-1981-02/1981_02_BYTE_06-02_The_Computer_and_Voice_Synthesis#page/n45/mode/2up 3. Robot Room: Inside the Bigtrak (reverse engineering, versions, IN/OUT commands) — http://www.robotroom.com/BigTrak.html 4. This American Life Episode 827, Act One: 'Toy R Us' (lawsuit story) — https://www.thisamericanlife.org/827/all-the-kings-horses/act-one-1 5. Klahr, D. (2000). Exploring Science: The Cognition and Development of Discovery Processes. Cambridge, MA: MIT Press — 6. Zeon Ltd Bigtrak 2010 replica — http://www.zeonltd.co.uk/ads/toy-world-big-trak ## Logitech ScanMan (1987) **By:** Logitech **Tags:** `HCI` `Input` `Scanner` `Handheld` `Embodied` ### Overview The Logitech ScanMan was introduced in 1987 as one of the first affordable handheld scanners for personal computers. About 4 inches wide, it connected to a PC via serial port and was physically dragged by the user across the surface of the document to be scanned. The original model (gray, 200 dpi, 1-bit monochrome) was followed by the ScanMan 32 (1990, 32-shade grayscale) and the ScanMan Color (1992, 24-bit color). A specimen of the ScanMan Color is preserved in the Musée Bolo in Lausanne, Switzerland. The interaction model was uniquely embodied: the user held the scanner like a fat highlighter pen and manually pulled it down the page at a constant speed. A small roller on the underside generated a clock signal for synchronization with the computer's sampling rate. An LED indicator would warn if the user moved too fast, which would cause horizontal compression in the resulting image. Each pass captured only a strip about 4 inches wide, so scanning a full letter-size page required multiple parallel passes that had to be software-stitched together. This made scanning quality a direct function of the user's manual dexterity, steadiness, and patience. Unlike a flatbed scanner — where a motorized carriage does the work — the ScanMan eliminated the motor and made the human arm the scanning actuator, trading automation for embodiment in exchange for a lower price point (typically $200-400 versus $1,000+ for early flatbeds). It was an intriguing case of technological 'simplification' that actually demanded more from the user, not less. ### Deep dive * **Interaction Model.** The ScanMan represents a deliberate choice in interaction design: remove the motor and make the human do the mechanical work. The user initiates a scan by pressing and holding a button, then drags the scanner manually across the document. The roller encoder provides a clock — each 'tick' triggers one line of image capture — which means the scanning speed is directly coupled to the speed of the user's hand. Too fast, and pixels are stretched horizontally. Too slow, and they're compressed. Uneven speed produces wavy distortion. For full-page documents, the user makes multiple parallel passes and uses accompanying stitching software to align and merge the strips. This introduces a second layer of embodied interaction: spatial judgment (did the passes overlap enough?) and alignment patience. The user learns, through trial and error, to modulate their arm movement to produce acceptable scans. This feedback loop — make a pass, inspect the result, adjust technique, try again — makes scanning an acquired skill rather than a button press. * **Market Context.** The ScanMan arrived in 1987, the same year Hewlett-Packard launched the first affordable flatbed scanner, the HP ScanJet. The ScanJet cost $1,990 and produced high-quality grayscale scans automatically. The ScanMan cost a fraction of that — typically $200-400 — but demanded the user's physical participation. This tradeoff created a fascinating market segment: users who needed occasional scanning but couldn't justify the expense of a flatbed. Handheld scanners remained a niche product throughout the 1990s, eventually rendered obsolete as flatbed scanner prices dropped below $300 by the end of the decade. * **Legacy.** The ScanMan is an early example of what might be called 'trickle-up interaction design': a cheaper, simpler device that paradoxically requires more skill from its user. The human body fills a gap that in more expensive products would be handled by motors and precision engineering. This pattern reappears periodically in HCI history — consider the difference between a Wacom Cintiq (built-in display, zero parallax) and early graphics tablets where the user learned to draw while looking at a separate screen. The ScanMan is a compact object lesson in the embodied costs of affordability. Today, the ScanMan Color is preserved as part of the collection of the Musée Bolo (École Polytechnique Fédérale de Lausanne), Switzerland's museum of computer history, where it represents the transitional era between purely analog document handling and the automated digital scanning we now take for granted. ### Team * **Logitech.** Swiss-American computer peripherals manufacturer; developed and marketed the ScanMan line * **Musée Bolo.** computer history museum in Lausanne, Switzerland; holds a ScanMan Color in its permanent collection ### Media ![Logitech ScanMan Color handheld scanner, white plastic body shaped like a fat pen, with roller and scan button visible](../assets/wiki/scanman-1.jpg) *Logitech ScanMan Color (1992), preserved at the Musée Bolo, Lausanne. Photo by Rama, CC BY-SA. Source: Wikimedia Commons.* ### Sources 1. Image scanner - Wikipedia (Handheld section, includes ScanMan) — https://en.wikipedia.org/wiki/Image_scanner#Handheld 2. Gruman, Galen. 'Hand Scanners: Low Cost Route to PC Imaging.' PC Magazine/InfoWorld, 1988 — 3. Musée Bolo - Logitech ScanMan Color in collection — https://commons.wikimedia.org/wiki/File:Logitech_ScanMan_Color-P4191193-white.jpg --- ## BAT Keyboard (1990) **By:** Infogrip, Inc. (Baton Rouge, Louisiana) with NASA Stennis Space Center **Tags:** `HCI` `Input` `Accessibility` `Chord Keyboard` `Wearable` ### Overview The BAT Personal Keyboard, introduced by Infogrip at COMDEX Las Vegas in fall 1990, is a 7-key one-handed chord keyboard. It uses four finger keys and three thumb keys — red, grey, and blue — in a piano-chord arrangement that produces all 101-key keyboard functions through 180+ chord combinations. The keyboard sits on the desk at a 25-degree tilt with an integrated wrist rest, designed for natural hand geometry. Keycaps are mounted backwards (180° rotated) for an ultra-low profile, and the pinky key is taller to compensate for shorter, weaker fingers. Three layers of 1/8-inch EVA foam under each keycap absorb shock. Cherry MX Black switches are modified with exceptionally light springs — lighter than any stock Cherry switch — for minimal actuation force. The BAT originated in Israeli Air Force human-factors research (reducing fighter-jet control sequences from 32 to 12 seconds via chording), was developed with NASA's Stennis Space Center for both spacecraft interaction and assistive technology, and was manufactured by Infogrip from 1990 into the 2000s. Users could learn key combinations in about 45 minutes and reach 45 words per minute after about 45 hours of practice. ### Deep dive * **Chord Scheme: Three Thumb Layers.** The BAT's chording system uses three thumb-key 'layers' to multiply its 4 finger keys into a full keyboard. Lowercase letters use finger keys plus the grey thumb key. Numbers and symbols are accessed through the red thumb layer. Modifier keys and navigation (Ctrl, Alt, arrows, Home, End, PgUp, PgDn) use the blue thumb layer with sticky-key behavior. This three-layer architecture means the user's hand never leaves the home position — every function is a chord. The keyboard also supported macro programming, with 32KB of battery-backed RAM for custom chord sequences. * **NASA Spinoff and Space Heritage.** NASA's Stennis Space Center partnered with Infogrip to develop chordic input technology, documented in the official NASA Spinoff 1993 publication (document ID 20020080924). NASA's dual interest was in faster human-computer interaction for spacecraft and a low-cost tactile training system for disabled users. The Spinoff entry notes: 'Using chordic technology, a data entry operator can finger key combinations for text or graphics input. Because only one hand is needed, a disabled person may use it. Strain and fatigue are less than when using a conventional keyboard; input is faster, and the system can be learned in about an hour.' * **InfoWear: The Wearable PC Concept.** In 1992, Infogrip prototyped the InfoWear Hip PC — a PC clone worn in a fanny pack with the miniBAT (a battery-powered chord keyboard companion) and a Reflection Technologies Private Eye head-mounted display. This was one of the earliest documented wearable computing concepts to reach the prototype stage, predating the mainstream wearable computing movement by several years. Infogrip also developed the 'Intelligent Chair' concept with a major office furniture maker, placing BAT wings at the armrest ends. ### Team * **Ward Bond.** President of Infogrip, Inc., led the BAT launch at COMDEX 1990 * **Israeli Air Force Human Factors Specialist (unnamed).** Originator of the chord design that reduced fighter-jet control sequences from 32 to 12 seconds * **NASA Stennis Space Center.** Development partner for spaceflight and accessibility applications * **Robert Ramey.** Later re-engineered BAT firmware as a one-chip PIC solution with USB HID ### Media ![BAT Keyboard at Computer History Museum](../assets/wiki/bat-keyboard-1.jpg) *BAT Keyboard in the Computer History Museum's Revolution exhibit. Photo by Mark Richards. Source: CHM.* ### Sources 1. Computer History Museum: BAT Keyboard catalog #102662183 — https://www.computerhistory.org/collections/catalog/102662183 2. CHM Revolution Exhibit: BAT Keyboard — https://www.computerhistory.org/revolution/input-output/14/355/1738 3. NASA Spinoff 1993: Chordic Input Technology — https://spinoff.nasa.gov/node/9947 4. TidBITS Oct 1990: Holy BATKeyboards! (COMDEX launch review) — https://tidbits.com/1990/10/29/holy-batkeyboards/ 5. Hackaday Aug 2020: Inputs of Interest — The Infogrip BAT Chording Keyboard (teardown) — https://hackaday.com/2020/08/18/inputs-of-interest-the-infogrip-bat-chording-keyboard/ 6. Keyboard Wiki: BAT Keyboard (detailed specs and image gallery) — https://wiki.themk.org/index.php/BAT_Keyboard 7. Wikipedia: BAT keyboard — https://en.wikipedia.org/wiki/BAT_keyboard --- ## NTT ClearBoard-1 (1991) **By:** Hiroshi Ishii and Minoru Kobayashi, NTT Human Interface Laboratories (Yokosuka, Japan) **Tags:** `HCI` `CSCW` `Video` `Drawing` `Optical` ### Overview ClearBoard-1 is a shared drawing medium created by Hiroshi Ishii and Minoru Kobayashi at NTT Human Interface Laboratories in 1991, published at CHI 1992. Unlike every other collaborative drawing system of its era, ClearBoard-1 required no computer for the drawing itself — users drew with physical marker pens on a large glass pane. The key innovation was a half-silvered mirror positioned at a 45-degree angle behind the glass, with a video camera behind it. This optical arrangement superimposed the remote collaborator's live video face onto the shared drawing surface, creating the illusion that you were drawing on the same piece of glass as your partner while looking at them through it. Critically, it maintained eye contact and 'gaze awareness' — you could see where your partner was looking on the shared workspace, a capability lost in standard video conferencing. Ishii described the metaphor as 'talking through and drawing on a transparent glass window.' The system used a 'Drafter-Mirror' architecture: two CCD cameras (one for face capture, one for the drawing surface), a video mixer, and the half-silvered mirror. ClearBoard-1 was succeeded by ClearBoard-2 (1994), which added computer-integrated drawing tools via the TeamPaint editor. The original ClearBoard-1 is held in the ICC (NTT InterCommunication Center) Tokyo permanent collection. ### Deep dive * **The Drafter-Mirror Architecture.** The optical heart of ClearBoard-1 was a half-silvered mirror at a 45-degree angle behind the glass drawing surface. One CCD camera captured the user's face (looking 'through' the mirror from behind), while another captured the drawing surface from above. A video mixer combined the two feeds, and the resulting image was transmitted to the remote site, where it was rear-projected onto the partner's glass board. The half-silvered mirror meant the user saw both their own markers on the glass AND the projected image of their partner's face AND their partner's markers. One quirk: images were mirror-reversed by the optics, requiring video correction to make text appear correctly oriented. The system also had to correct for the fact that one user always saw a mirrored image — an inherent consequence of the 'looking through the same glass' metaphor. * **Gaze Awareness: The Missing Dimension of CSCW.** Ishii and Kobayashi identified 'gaze awareness' as a critical missing feature in computer-supported cooperative work. Standard shared whiteboard systems let you see what your partner is drawing, but not where they are looking. Standard video conferencing lets you see your partner's face, but not what they're working on. ClearBoard integrated both: the partner's face appeared superimposed on the shared workspace, so looking at the drawing and looking at your partner were the same act. This was not a feature — it was a consequence of the optical design. The CHI 1992 paper argued that this integration of 'interpersonal space' and 'shared workspace' was essential for seamless remote collaboration. * **From NTT to MIT: Ishii's Trajectory.** ClearBoard was Hiroshi Ishii's breakthrough project at NTT Human Interface Laboratories. After its publication at CHI 1992 and CSCW 1992, Ishii joined the MIT Media Lab, where he founded the Tangible Media Group and developed the 'Tangible Bits' vision (published at CHI 1997). ClearBoard's philosophy — that the physical configuration of an interface shapes collaboration in ways no software feature can replicate — directly informed his later work on tangible user interfaces. ClearBoard-1 was exhibited at ICC Tokyo in 2000 as part of Ishii's 'Open Studio: Tangible Bits' exhibition, and ClearBoard-2 was shown at SIGGRAPH 1994. ### Team * **Hiroshi Ishii.** Lead researcher, NTT Human Interface Laboratories; later founded MIT Media Lab's Tangible Media Group * **Minoru Kobayashi.** Co-creator, NTT Human Interface Laboratories * **Jonathan Grudin.** Co-author on CSCW 1992 extended paper * **Kazuho Arita.** Co-author on ClearBoard iterative design paper (CACM 1994) ### Media ![NTT ClearBoard-1 at ICC Tokyo](../assets/wiki/ntt-clearboard-1.jpg) *ClearBoard-1 in the ICC Tokyo permanent collection. © NTT ICC. Source: ICC Tokyo.* ### Sources 1. CHI 1992: ClearBoard: A Seamless Media for Shared Drawing and Conversation with Eye-Contact — https://dl.acm.org/doi/10.1145/142750.142977 2. CSCW 1992: Integration of Inter-Personal Space and Shared Workspace — https://dl.acm.org/doi/10.1145/143457.143459 3. ICC Tokyo Collection: ClearBoard-1 — https://www.ntticc.or.jp/en/archive/works/clearboard-1/ 4. MIT Tangible Media Group: ClearBoard Project Page — https://tangible.media.mit.edu/project/clearboard/ 5. Hiroshi Ishii Classic Page: ClearBoard Overview — https://www.media.mit.edu/~ishii/CB.html 6. CACM 1994: Iterative Design of Seamless Collaboration Media (ClearBoard-1 and -2) — https://dl.acm.org/doi/10.1145/175276.175278 --- ## Xerox LiveBoard (1990) **By:** Xerox PARC Colab Team (Elrod, Bruce, Gold, Goldberg, Halasz, Janssen, Lee, McCall, Pedersen, Pier, Tang, Welch) **Tags:** `HCI` `Input` `Display` `CSCW` `Pen Computing` ### Overview The Xerox LiveBoard was a 67-inch rear-projection interactive display developed at Xerox PARC's Colab project between 1987 and 1990. Published at CHI 1992 with 12 co-authors, it represented the culmination of PARC's vision for computer-supported collaborative work. The LiveBoard used laser triangulation — with a rotating polygon mirror borrowed from Xerox copier technology — to track multiple cordless pens simultaneously on a wall-sized display. The system supported networked multi-user collaboration: up to 31 LiveBoards could be linked, with remote participants seeing and annotating the same shared workspace in real time. The board connected to a workstation running groupware like Cognoter and Boardnoter, and later Tivoli, a pen-gesture-driven electronic whiteboard application. Xerox spun off LiveWorks, Inc. in 1992 to commercialize the system; over 2,000 units were sold by 2000 at $49,500 each. The Computer History Museum holds a LiveBoard (model LB3, serial 3E1122X) in its permanent collection. ### Deep dive * **The Colab Room.** The LiveBoard was not a standalone product — it was the centerpiece of the Colab (Collaboration Laboratory), a custom-designed electronic meeting room at Xerox PARC completed in 1987. The room featured motorized desks, specially designed no-glare lighting, an 'electern' (electronic lectern with height-adjustable keyboard), and four networked Dorado workstations. The philosophy was total environmental design: every surface, every light, every piece of furniture was optimized for computer-supported group work. Mark Stefik wrote: 'We did not want to lose the emotional impact of a big whiteboard — something that you view from ten feet rather than ten inches.' * **Laser Position Detection.** The LiveBoard's position sensing was brilliantly pragmatic. A laser with a rotating polygon mirror — literally cannibalized from Xerox's copier imaging systems — was mounted in the upper right corner of the board. Mirrors and retro-reflectors on two edges of the board reflected the sweeping laser beam. When a finger or pen touched the surface, it interrupted the beam, and the system triangulated the interruption's position. This was a 'skunkworks' build by a Xerox engineering team in Webster, New York — using their own company's copier parts to build a collaborative computer display. An alternative ultrasonic pen position detection system was also developed and patented (US 4,974,173 and 4,814,552). * **From Prototype to Product.** The commercial LiveBoard launched May 18, 1993 at $49,500. It ran on an Intel 486 processor with Microsoft Windows, connected via Ethernet and telephone modems. Early adopters included Daimler-Benz, which used LiveBoards to share product designs between Pittsburgh and Ulm, Germany. By 2000, LiveWorks had sold over 2,000 units. The Tivoli software (Elin Rønby Pedersen, Kim McCall, Thomas P. Moran, Frank G. Halasz, 1993) brought pen gestures — scrubbing to erase, circling to select — to informal meeting whiteboarding, establishing interaction patterns that would influence tablet computing decades later. ### Team * **Mark Stefik.** Principal Investigator, Colab concept and patents * **Scott Elrod.** CHI 1992 lead author * **Rich Gold.** CHI 1992 co-author, PARC artist and interaction designer * **Frank Halasz.** CHI 1992 co-author, later Tivoli co-creator * **Elin Rønby Pedersen.** CHI 1992 co-author, Tivoli software co-creator * **John Tang.** CHI 1992 co-author, groupware researcher * **Daniel G. Bobrow.** Colab co-PI, software architecture * **Lucy Suchman.** Ethnographic studies of meetings at PARC * **Xerox Skunkworks (Webster, NY).** Built the first physical LiveBoard prototype using copier laser parts ### Media ![Xerox LiveBoard Skunkworks prototype](../assets/wiki/xerox-liveboard-1.jpg) *The Skunkworks prototype LiveBoard built in Webster, New York using copier-derived laser optics. Source: Mark Stefik.* ### Sources 1. CHI 1992: Liveboard: A Large Interactive Display Supporting Group Meetings, Presentations, and Remote Collaboration — https://dl.acm.org/doi/10.1145/142750.143052 2. Computer History Museum: LiveBoard catalog #102678840 — https://www.computerhistory.org/collections/catalog/102678840 3. CHM Revolution Exhibit: LiveBoard — https://www.computerhistory.org/revolution/input-output/14/349/1829 4. Mark Stefik: Colab Electronic Meeting Room (historical photos and narrative) — https://www.markstefik.com/?page_id=155 5. UPI: Xerox introduces LiveBoard (1993 launch coverage) — https://www.upi.com/Archives/1993/05/18/Xerox-introduces-LiveBoard/1596737697600/ 6. The Independent: Chip chalks up new success (1994 UK launch) — https://www.independent.co.uk/news/business/chip-chalks-up-new-success-1440458.html --- ## Butler in a Box (1983) **By:** Mastervoice (Gus Searcy & Franz Kavan) **Tags:** `HCI` `Voice Control` `Home Automation` `Speech Recognition` `Consumer Electronics` ### Overview The Butler in a Box was the world's first consumer voice-controlled home automation system, created by professional magician Gus Searcy and former IBM programmer Franz Kavan under their company Mastervoice. Introduced in 1983 and priced at $1,495, it used speaker-dependent speech recognition — each of up to 4 users trained the device to recognize their voice commands using an included cassette tape. The user spoke a wake word (typically a butler name like 'Godfrey' or 'Hobson') and the device responded 'Yes, boss,' then accepted voice commands to control lights (via X10 powerline modules), make and receive phone calls, set up to 16 timers, and function as a security alarm with door/window sensors. It could perform 256 functions, control 42 devices by voice, 42 by timer, and execute macros of up to 16 commands each. It also operated via a membrane keypad, timed schedules, and sensor triggers. The personality was customizable — it could sound like a snobby British butler, Betty Boop, or a seductress. An optional 'Lady' voice cartridge was sold separately. The device predated Amazon Alexa by 30 years, Google Home by 31, and even Ask Jeeves by 13. ### Deep dive * **Origin Story.** Gus Searcy was a professional magician from Yorba Linda, California. At a Super Bowl party, friends razzed him: 'If you can pull rabbits out of hats, why can't you magically turn the lights on?' The question stuck. Searcy partnered with Franz Kavan, a former IBM programmer from West Germany, and in 1983 they built the first prototype — initially called 'Sidney.' In 1984 they formed Mastervoice, and in 1985 they received $2.3 million in venture capital, establishing offices in Los Alamitos, California. Searcy described his vision: 'I wanted it to be like Thing on The Addams Family — it had to be everywhere, but nowhere.' * **Technical Architecture.** The Butler in a Box used a Rockwell R6501Q microprocessor (1 MHz, 6502-compatible) as its main CPU, with an Intel 8748 microcontroller handling telephone functions. Speech data was stored on EPROM chips — two 27256 EPROMs on the main board plus a 2764 EPROM inside a potted (epoxy-sealed) security module designed to prevent tampering. The data bus entering this module was intentionally scrambled (address-line swizzling) to frustrate reverse engineering. A 4-character alphanumeric PIN was required on first power-up; if lost, the unit was rendered inoperable. Speech output used CVSD (Continuously Variable Slope Delta modulation) processed by two custom chips (MV0014 codec and MV0015 filter), believed to be Harris-manufactured military-grade components. Memory was volatile RAM — if power was lost for more than about 3 hours, all settings and voice training were erased. An optional RAM Pack backup module was sold separately. A vacuum fluorescent display provided visual feedback. * **The Interaction Model.** Setup was intensive: approximately 25 minutes for a single device. Each user trained all key words ('light,' 'telephone,' etc.) individually using the included cassette tape. Up to 4 different users could each train their own butler name and command set. The device supported four interaction modes: voice command, touch (membrane keypad), time-based scheduling, and situation-based triggers (motion sensors, rain sensors for sprinklers). It incorporated if-then conditional logic — for example, 'turn lights off at 10 p.m. but not if we are having a party.' It knew the day of the week, month of the year, seasons, and holidays. The 134-page owner's manual spoke to the complexity. * **Commercial Fate and Recognition.** The Butler in a Box was not a commercial success. Priced at $1,495 in 1983 — approximately $4,100 in 2025 dollars — it was too expensive and too complex for mainstream adoption. Mastervoice later rebranded the product as the Mastervoice ECU (Environmental Control Unit), targeting the accessibility market, at $2,995 in 1996. The company claimed over 26,000 systems delivered over the product's lifetime and maintained a website until around 2008. Despite commercial failure, the device received significant recognition: it is held by the Smithsonian Institution's National Museum of American History (a prototype and production units), was displayed in the 'Future House' at Disney World's Epcot Center, and was installed at the Western Rehabilitation Institute to help patients transitioning to independent living. Notable customers included William Shatner. In March 2024, Gus Searcy — still alive — commented on a Popular Science YouTube video, offering to recreate lost PINs for owners who could prove ownership. ### Team * **Gus Searcy.** Professional magician turned inventor; conceived the Butler in a Box after friends challenged him to create a device that could 'magically' turn lights on by voice * **Franz Kavan.** Former IBM programmer from West Germany; technical co-founder who built the speech recognition system * **Mastervoice / Automated Voice Systems Inc..** Los Alamitos, California company; operated from 1984 to approximately 2008 ### Media ![Butler in a Box product unit with green vacuum fluorescent display](../assets/wiki/butler-in-a-box-1.jpg) *Butler in a Box by Mastervoice, showing the vacuum fluorescent display. Source: Gus Searcy / thecharm.info.* ![Gus Searcy with Smithsonian Institution curator presenting the Butler in a Box](../assets/wiki/butler-in-a-box-2.jpg) *Gus Searcy (left) with Smithsonian Institution curator, donating the Butler in a Box to the National Museum of American History. Source: Gus Searcy / thecharm.info.* ### Sources 1. Wikipedia — Butler in a Box — https://en.wikipedia.org/wiki/Butler_in_a_Box 2. Smithsonian Institution — Prototype Butler in a Box (NMAH 1346931) — https://americanhistory.si.edu/collections/object/nmah_1346931 3. Popular Science — 'The $15,000 A.I. From 1983' video article (March 2024) — https://www.popsci.com/technology/butler-in-a-box-video/ 4. Hackaday — 'Retrogadgets: Butler In A Box' by Al Williams (March 2024) — https://hackaday.com/2024/03/28/retrogadgets-butler-in-a-box/ 5. Deseret News, April 17, 1988 — 'Magician's Versatile Box Gives New Meaning to Butler Did It' — https://www.deseret.com/1988/4/17/18763718/magician-s-versatile-box-gives-new-meaning-to-butler-did-it/ 6. Seattle Times, April 7, 1996 — 'At Your Command, $3,000 Electronic Butler' — https://archive.seattletimes.com/archive/19960407/2322832/at-your-command-3000-electronic-butler 7. VCFed Forum — 'Secrets Within' teardown and reverse engineering of Butler in a Box — https://forum.vcfed.org/index.php?threads/secrets-within-the-brains-of-the-butler-in-a-box.1243744/ 8. Gus Searcy's personal site — https://thecharm.info/butler.shtml 9. Internet Archive — Mastervoice Butler in a Box manual scans — https://archive.org/details/mastervoice-butler-in-a-box-manual-pages 10. Popular Science, March 1987 (Google Books) — feature article — https://books.google.com/books?id=3AAAAAAAMBAJ&pg=RA1-PA62 11. Brady Carlson — 'The Butler in a Box was a smart speaker before there were smart speakers' — https://www.bradycarlson.com/the-butler-in-a-box-was-a-smart-speaker-before-there-were-smart-speakers-cool-weird-awesome-487/ --- ## Gibson Light Pen System (LPS II) (1981) **By:** Gibson Laboratories, Inc. (Steve Gibson) **Tags:** `HCI` `Input` `Light Pen` `Apple II` `Drawing` ### Overview The Gibson Light Pen System II (LPS II) was a professional-grade light pen for the Apple II, introduced in 1981 by Gibson Laboratories, Inc. of Laguna Hills, California. Created by Steve Gibson — who had been hired by the Stanford Artificial Intelligence Laboratory at age 15 and worked on the world's first laser printer interface — the LPS II consisted of a precision light pen, an interface card that plugged into Slot 7 of the Apple II motherboard, and bundled drawing software. The light pen detected the CRT's scanning electron beam with a photodetector in its tip, using timing relative to the video signal to calculate precise X,Y screen coordinates. This gave 1:1 absolute positioning — the user drew directly on the screen surface, and the cursor followed exactly at the point of contact. The bundled software provided freehand drawing, geometric shapes, fill patterns, mirror drawing across X and Y axes, animation tools, and a Pentrak driver that let Applesoft BASIC programs access the light pen. Reviewer John J. Anderson wrote in Creative Computing (December 1983) that 'nothing comes close to the Gibson package. You really feel as if you are drawing.' ### Deep dive * **The Creator: Steve Gibson.** Steve Gibson (born 1955) had an extraordinary early career. At age 15, he was employed by Stanford University's Artificial Intelligence Laboratory (1970–1972), working alongside post-graduate students on machine learning, speech recognition, and the PDP-10 to Xerox Graphics Printer interface — the world's first laser printer interconnection. After studying EECS at UC Berkeley with a 4.0 GPA, he designed copy protection at California Pacific Computer Company, then founded Gibson Laboratories in June 1981 at age 26 to build the LPS II. When the home computer market softened in late 1983, he sold Gibson Laboratories to Atari Corporation — then recovered all rights to his proprietary technologies after management changes at Atari. A successor product was manufactured under contract to Koala Technologies as the 'Gibson Light Pen by Koala.' Gibson then consulted for Apple, Atari, Microsoft, Amiga, and Sony before founding Gibson Research Corporation in 1985, creating the disk utility SpinRite (continuously updated for nearly 40 years), writing the 'TechTalk' column for InfoWorld (1986–1993), and co-hosting the Security Now! podcast (2005–present, 1,000+ episodes). * **Technical Design.** The LPS II's interface card plugged into Slot 7 of the Apple II, which provided access to video timing signals unavailable on other slots. A tethered light pen with a photodetector in the tip detected the CRT beam as it scanned past. Timing the detection against the video sync signal gave precise X,Y position at Apple II hi-res resolution (280×192 pixels). The software included a bootable drawing program with freehand drawing, geometric shapes, custom fill patterns, mirror drawing, and an animation utility. A Pentrak driver allowed Applesoft BASIC programs to read light pen coordinates. Later versions added a tip switch. The physical interaction was described as utterly natural: the eye and hand worked together at the same point on the screen, with no translation between a separate tablet and the display. * **Commercial Context and Fate.** Priced at $250 (approximately $800 in 2024 dollars), the LPS II occupied a middle ground between the KoalaPad ($125) and professional CAD digitizers like the Robographics CAD-1 ($1,095). Gibson Laboratories financed its growth entirely from profits. The company was sold to Atari Corporation around December 1983 when the home computer market softened. After Atari's management turnover, Gibson recovered his proprietary technologies and contracted with Koala Technologies to produce a successor. By the mid-1980s, light pens faded as mice, graphics tablets, and GUIs became dominant. Koala Technologies eventually folded. The LPS II remains notable as the finest light pen system produced for an 8-bit microcomputer — and as the launchpad for one of computing's most unusual careers. * **Lasting Technical Legacy.** Gibson's deep experience with Apple II graphics through the LPS II informed his later contributions to display technology. In 1998, he published detailed research on sub-pixel font rendering techniques used by Apple II programmers decades before Microsoft's ClearType — work he credited directly to his LPS II development years. He displayed old LPS II advertisements on his website as part of his argument about the history of sub-pixel rendering. ### Team * **Steve Gibson.** Founder and president of Gibson Laboratories; designed the LPS II hardware and software; later founded Gibson Research Corporation (SpinRite, Security Now!) * **Gibson Laboratories, Inc..** Laguna Hills, California company founded June 1981; sold to Atari Corporation December 1983 ### Media ![Original Gibson LPS II advertisement showing the light pen and Apple II](../assets/wiki/gibson-light-pen-1.jpg) *Original Gibson LPS II advertisement. Source: Steve Gibson / GRC.com.* ![Second Gibson LPS II advertisement with product details](../assets/wiki/gibson-light-pen-2.jpg) *Gibson LPS II advertisement with technical specifications. Source: Steve Gibson / GRC.com.* ### Sources 1. Computer History Museum — LPS II Manual and Artifact — https://www.computerhistory.org/collections/catalog/102638722 2. Computer History Museum — LPS II in Revolution Exhibit — https://www.computerhistory.org/revolution/input-output/14/352/1846 3. Computer History Museum — Gibson Light Pen by Koala — https://www.computerhistory.org/collections/catalog/102674112 4. Steve Gibson's Resume (GRC.com) — full career and LPS II history — https://www.grc.com/resume.htm 5. Creative Computing, Dec 1983 — 'Drawing Conclusions' review of LPS II by John J. Anderson — https://www.atarimagazines.com/creative/v9n12/32_Drawing_conclusions.php 6. Internet Archive — LPS II Preliminary Software and Manuals — https://archive.org/details/LPSIIPENPRELIM 7. GRC.com — 'The Origins of Sub-Pixel Font Rendering' (Gibson's technical history connecting LPS II to ClearType) — https://www.grc.com/ctwho.htm 8. Wikipedia — Steve Gibson (computer programmer) — https://en.wikipedia.org/wiki/Steve_Gibson_(computer_programmer) --- ## Versatron Footmouse (1985) **By:** Versatron Corporation **Tags:** `HCI` `Input` `Foot` `Accessibility` `Cursor Control` ### Overview The Versatron Footmouse (model FM-100) was the first commercially available foot-operated computer cursor controller, introduced in 1985 by Versatron Corporation of Healdsburg, California. Rather than functioning as a serial-port mouse, it was a keyboard-wedge device: it plugged inline between the keyboard and the PC and injected cursor-key scan codes when the user slid their foot across its surface. The base unit stayed stationary on the floor; the user moved the cursor by sliding their foot over the top in four cardinal directions — up, down, left, and right — with auto-repeat if the foot was held in position. It was designed as an assistive technology for users with disabilities or repetitive strain injuries, years before the Americans with Disabilities Act (1990). Despite its niche, the device was produced into the early 1990s and its design influenced academic research including the landmark CHI '86 paper "Of Moles and Men" by Pearson and Weiser. Versatron itself was primarily a defense contractor whose main products included actuators for the Stinger anti-aircraft missile and the precision guidance system for the Excalibur artillery shell — the footmouse was an unusual side-project from a weapons engineering firm. ### Deep dive * **Origins.** Versatron Corporation was founded in 1980 by Al Voigt and John Speicher, both formerly of General Dynamics Pomona. The company operated out of Healdsburg, California, and by 1985 employed approximately 75 people. Their primary business was defense contracting: actuators for the Stinger missile and, later, the Control Actuation System (CAS) for the Excalibur precision-guided artillery shell. The Footmouse emerged as a commercial side-project, applying the company's precision mechanical engineering expertise to a consumer computer peripheral. It was first covered in InfoWorld on September 23, 1985, in Cynthia Harriman's article "Alternatives for cursor control: footmouse, pad, or view system." * **Hardware and Interaction Model.** The FM-100 Footmouse was a sliding-pedal design rather than a tilting one. The base unit (approximately 4.75 × 4.5 × 2 inches, weighing about 1 pound) sat stationary on the floor. The user placed a foot on its top surface and slid it in the desired direction. The device used a keyboard-wedge architecture: it plugged between the computer's keyboard and the system unit, intercepting and injecting cursor-key scan codes without interfering with normal keyboard operation. This meant it worked with any software that responded to keyboard cursor keys — it did not require mouse drivers or a serial port. The four cardinal directions of movement were supported, with auto-repeat when the foot was held in a position. Unlike a modern mouse, it moved in discrete directional steps rather than providing relative X/Y positioning. * **Commercial Fate.** The Footmouse never achieved mainstream adoption. It was referenced by the IBM National Support Center for Persons with Disabilities circa 1991 as an assistive technology product, and by 1996 it was being resold on Usenet as 'weird old computer stuff' in a moving sale. Versatron Corporation continued its defense work, being acquired by Wescam Inc. in 1995 and then by General Dynamics in 2001, where its CAS technology went into production for the Excalibur program. The Footmouse remains a curious footnote: a consumer computer peripheral designed by missile guidance engineers, addressing an accessibility need decades before it was widely recognized. * **Academic Impact.** The Versatron Footmouse is referenced in the ACM CHI '86 paper "Of moles and men: the design of foot controls for workstations" by Glenn Pearson and Mark Weiser (who later pioneered ubiquitous computing at Xerox PARC). It also appears in the survey "The Feet in Human–Computer Interaction" published in ACM Computing Surveys, cementing its place as the starting point for foot-operated computer input research. ### Team * **Al Voigt.** Co-founder of Versatron Corporation, formerly of General Dynamics Pomona * **John Speicher.** Co-founder of Versatron Corporation * **Versatron Corporation.** Healdsburg, California defense contractor; primary business was missile actuators and artillery guidance systems ### Media ![Versatron Footmouse FM-100, top-down view showing the sliding pedal surface](../assets/wiki/versatron-footmouse-1.jpg) *Versatron Footmouse FM-100. Source: Preterhuman Vintage Wiki.* ![Versatron Footmouse, side angle view](../assets/wiki/versatron-footmouse-2.jpg) *Versatron Footmouse FM-100, side view showing the low-profile floor unit. Source: Preterhuman Vintage Wiki.* ### Sources 1. Computer History Museum — Catalog entry for Versatron Footmouse FM-100 — https://www.computerhistory.org/collections/catalog/X1081.91 2. Wikipedia — Footmouse article — https://en.wikipedia.org/wiki/Footmouse 3. Preterhuman Vintage Wiki — Versatron Foot Mouse (detailed images and description) — https://wiki.preterhuman.net/Versatron_Foot_Mouse 4. SBIR Success Story — Versatron Corp. (extensive company history) — https://www.sbir.gov/success/sbir-sttr-success-versatron-corp 5. InfoWorld, Sept 23, 1985 — 'Alternatives for cursor control: footmouse, pad, or view system' by Cynthia Harriman — https://books.google.com/books?id=tDcEAAAAMBAJ 6. IBM National Support Center — Footmouse description (Usenet misc.handicap, 1991) — https://groups.google.com/g/misc.handicap/c/UAuugaqje_4 7. Pearson & Weiser, 'Of moles and men: the design of foot controls for workstations', CHI 1986 — https://doi.org/10.1145/22627.22392