Practical Hardware and Algorithms for Creating Haptic Musical Instruments

Transcription

1 Practical Hardware and Algorithms for Creating Haptic Musical Instruments Edgar Berdahl and Collin Oldham CCRMA / Stanford University Hans-Christoph Steiner ITP/NYU Eighth International Conference on New Interfaces for Musical Expression Genoa, Italy June 5th-7th, 2008

2 Outline Introduction Actuators Devices Algorithms

3 Haptic Musical Instruments Actuator Musician Sensor Sound Signals Controller Gesture Signals

4 Outline Introduction Actuators Devices Algorithms

5 Actuators

6 Vibrating Motors $1-$20

7 Motorized Faders $30

8 Hard Disk Motors

9 Woofers $20

10 Servomotors $400 Surplus: about $7 each

11 Outline Introduction Actuators Devices Algorithms

12 Game Controllers $10 - $50

13 NovInt Falcon $200 Figure: Haptic Interface For Gaming

14 Robotic Arms Figure: Omni for $1000 from SensAble Technologies

15 Outline Introduction Actuators Devices Algorithms

16 Basic F spring = kx (1)

17 Basic F spring = kx (1) F wall = { kx ifx > 0 0 otherwise (2)

18 Basic F spring = kx (1) F wall = { kx ifx > 0 0 otherwise (2) F damping/friction = Rv (3)

19 Full Physical Modeling

20 Full Physical Modeling Bowing surface with piezo pickup z A + z N Shaker g HLP (z) Power amplifier z B H 2LP (z) Figure: Cellomobo Block Diagram

21 Event-Based Haptics Every time the system detects some event

22 Event-Based Haptics Every time the system detects some event send an appropriate reaction force to the user.

23 Event-Based Haptics Every time the system detects some event send an appropriate reaction force to the user. For example: Everytime the drumstick strikes the drum pad

24 Event-Based Haptics Every time the system detects some event send an appropriate reaction force to the user. For example: Everytime the drumstick strikes the drum pad force the drumstick upward.

25 Event-Based Haptics Every time the system detects some event send an appropriate reaction force to the user. For example: Everytime the drumstick strikes the drum pad force the drumstick upward.

26 CCRMA Physical Interaction Design Workshop July 7 - July 18

27 CCRMA Physical Interaction Design Workshop July 7 - July 18 Topics: 1. Physical Interaction Design

28 CCRMA Physical Interaction Design Workshop July 7 - July 18 Topics: 1. Physical Interaction Design 2. Sensing

29 CCRMA Physical Interaction Design Workshop July 7 - July 18 Topics: 1. Physical Interaction Design 2. Sensing 3. Musical instruments

30 CCRMA Physical Interaction Design Workshop July 7 - July 18 Topics: 1. Physical Interaction Design 2. Sensing 3. Musical instruments 4. Microcontroller programming

31 Thanks! DEMO: Saturday 12:30-14:30

32 Thanks! DEMO: Saturday 12:30-14:30 Sound examples are available on the websites eberdahl/projects/hapticdrum

33 Thanks! DEMO: Saturday 12:30-14:30 Sound examples are available on the websites eberdahl/projects/hapticdrum Special thanks to Bill Verplank, Julius O. Smith III, Günter Niemeyer, Chris Chafe, Sile O Modhrain, Brent Gillespie, and Charles Nichols.

34 Thanks! DEMO: Saturday 12:30-14:30 Sound examples are available on the websites eberdahl/projects/hapticdrum Special thanks to Bill Verplank, Julius O. Smith III, Günter Niemeyer, Chris Chafe, Sile O Modhrain, Brent Gillespie, and Charles Nichols. Questions?