Minsky Sandpaper

The Sandpaper system modeled each virtual surface as a 2D height field h(x,y), typically a 32×32 to 128×128 array. At each servo cycle (~1 kHz), the system sampled the joystick position, interpolated the local gradient of the height field, and computed restoring forces: F_x = −k_x · ∂h/∂x and F_y = −k_y · ∂h/∂y. Different textures were produced by varying the spatial frequency content of h(x,y): fine sandpaper used high-frequency filtered noise, corduroy used oriented ridges, and rubber used low-frequency damping. An optional velocity-dependent damping term (F ← F − b·v) produced the characteristic 'catch-and-release' stick-slip sensation of coarse grit. Crucially, no normal-force (vertical) actuator was needed — the brain interpreted the lateral force variations as surface roughness, a remarkable perceptual illusion that validated the entire approach.

The joystick used two Pittman-series iron-core DC servo motors mounted at right angles, driving the handle through direct-drive linkages to minimize backlash and friction. Optical encoders on the motor shafts provided position sensing. The motors operated in current-drive mode — controlling motor current directly produced proportional torque, which translated to force at the handle. A custom ISA-bus interface card read encoder positions and commanded motor currents. All texture computation ran on the host CPU (a Sun workstation or early PC). Two generations of hardware were built: the original force-feedback joystick (1984–89) and a smaller 'pingpong joystick' interface for later experiments. The system required only 2 DOF (planar motion) to produce convincing sensations across a wide range of virtual materials.

Margaret Minsky, daughter of AI pioneer Marvin Minsky, earned her BS in Mathematics from MIT and her PhD in Media Arts and Sciences from the MIT Media Lab (1995), advised by Nicholas Negroponte. The Sandpaper work was conducted at the Media Lab during its foundational era. Concurrently, Margaret was a Visiting Scholar at UNC Chapel Hill's Computer Science Department, collaborating with Frederick P. Brooks Jr. — the Turing Award winner behind the IBM System/360 and UNC's pioneering VR/graphics research. Brooks and his student Ming Ouh-young had developed the GROPE haptic display for molecular docking; Minsky's texture work complemented this by adding surface feel to the haptic vocabulary. The 1990 SIGGRAPH paper's author list (Minsky, Ouh-young, Steele, Brooks, Behensky) is a who's-who of early haptics and VR research.

The Sandpaper system was first presented at the 1990 ACM SIGGRAPH Symposium on 3D Interactive Graphics. Minsky's 1995 PhD thesis, 'Computational Haptics: the Sandpaper System for Synthesizing Texture for a Force-Feedback Display,' remains widely cited. A 1996 follow-up paper with Susan Lederman, 'Simulated Haptic Textures: Roughness,' validated the psychophysical accuracy of the synthesized textures. Minsky later reflected on the field's trajectory in 'Will Haptics Research Parallel Computer Graphics Research?' (ICAT 1997), drawing explicit parallels between the early days of computer graphics and the nascent field of computational haptics. Her 'Home Haptics' technical report (MIT AI Lab, 1996) explored bringing texture feedback into consumer contexts — remarkably prescient given today's haptic-enabled phones, game controllers, and VR devices.