Real World Object Tracking with Vive Trackers

Transcription

1 Real World Object Tracking with Vive Trackers

2 Overview What are Trackers? Why be Excited? Example Use Cases Vive Tracker Overview Setup Building Spraycan Prop Controlling Objects Controlling First Person Avatars Arduino Tracker interface

3 What is a Tracker? Device that Tracks Position & Rotation Can be attached to body or object

4 Why Be Excited? Opens up a new realm of interaction! Full Body Tracking Bring real objects into VR Easily prototype unique props Improved locomotion Mixed Reality

5 Example Use Cases Mixed Reality Camera Guns w/ Recoil and Other Haptics Baseball Bats, Racquets Non-VR Participant in VR Scene Pet Tracking Non-VR Games Spray Can Chairs, buckets, firehose, water nozzle

6 Vive Tracker Example Videos Vive Tracker Example Playlist

7 Vive Tracker Overview Vive Trackers released 6 months ago Only Works with Vive Need BaseStations (but not HMD) Unity Support (SteamVR Plugin) Easy to Integrate Tracker in Game 2 Types of Interface Pogopins USB Port

8 Accessories TrackStrap (~ $25/pair) DIY from webbing

9 Tennis & Pong Racquets

10 VR Tracker Gun $680 on Amazon

11 Examples- Tracked NerfGun

12 Examples- Tracked Spraycan Inspired by Master of Shapes Spraypaint Example

13 Spraycan Prop Building 3D Printing

14 Spraycan Prop Building Tracker Thumbwheel Attachment

15 Spraycan Prop Building Pogopin Wiring

16 Copper Foil Tape

17 Spraycan Prop Building Attaching to Tracker

18 Spraycan Prop Building Spraycan Prototype

19 Locomotion w/ Feet Trackers More realistic Can t cheat! Good exercise VRTK walk-in place component Modify to use feet trackers instead of controllers Locomotion based on Feet movement

20 VRTK Move-In Place Locomotion

21 High Level Vive Tracker Interface From HTC Vive Tracker Developer Guidelines

22 Vive Trackers - Pairing Trackers Need to pair trackers in specific order Trackers in order

23 Add Target Objects

24 Vive Trackers SteamVR Tracked Object Import SteamVR Asset Add Steam VR_Tracked Object Component Don t Need to Set Index

25 SteamVR Setup Details Place Tracker Under SteamVR [CameraRig] Attach SteamVR Tracked Object to SprayCan Tracker Set Model Offsets from Tracker Drag into SteamVR Controller Manager

26 Unity Tracker Communication private int trackerindex; private static SteamVR_Controller.Device device; void Start () { } void Update() { trackerindex = (int)getcomponent<steamvr_trackedobject>().index; device = SteamVR_Controller.Input(trackerIndex); grip = device.getpress(evrbuttonid.k_ebutton_grip); trigger = device.getpress(evrbuttonid.k_ebutton_steamvr_trigger); trackpadbutton = device.getpress(evrbuttonid.k_ebutton_steamvr_touchpad); menubutton = device.getpress(evrbuttonid.k_ebutton_applicationmenu); } // turn on pogopin output if (trigger) device.triggerhapticpulse(500);

27 Controlling Pogo Output Pin if (device.getpressup(evrbuttonid.k_ebutton_steamvr_trigger)) {device.triggerhapticpulse(500);

28

29 Vive Trackers to Control Avatars Use IK solution for solving joint positions Final IK Create targets w/ offsets 3 Trackers Hips & Feet

30 Platforms USB Interface PC Smartphone Microcontroller (Arduino) Advantages Enormous potential! Implement unlimited number of buttons Interface with sensors

31 Sensor Examples Huge range of sensors available air pressure skin resistance biofeedback GPS IMU IR sensor LIDAR Flex sensors

32 9DOF IMU gyro,accelerometer,magnetometer Razor IMU Example Mocap Product: Nansense

33 Lidar Optical distance measurement Sparkfun Link

34 Flex Sensors DIY Flex Sensor Gloves Video Manus $1200

35 Arduino Tracker Interface Micro USB to Micro USB cable

36 Arduino USB Interface Must be configured as a USB host USB HID interface Huge improvement over pogopins No longer limited to 4 digital inputs Pad x/y values ( to 32767) Trigger Raw Value (0 to 65535)

37 Arduino USB Interface Send 2 blocks of data (0xB3 & 0xB4)

38 Example Arduino Sketch USBHost usb; ViveTrackerController tracker(usb); void loop() { tracker.task(); if (tracker.isconnected()) { } } uint8_t buttons = VIVETRACKER_BUTTON_GRIP VIVETRACKER_BUTTON_MENU; int16_t padx = 1234; int16_t pady = -333; uint8_t trigger = 200; uint16_t batterylevel = 0; tracker.settrackerstatus(buttons, padx, pady, trigger, batterylevel);

39 Recommended Links Vive Tracker Guidelines v Vive Tracker Usage Examples Master of Shapes Spraypaint Prop Building VR Rifle Blueprints marc@solidearthvr.com