Understanding the Role of Haptic Feedback in a Teleoperated/Prosthetic Grasp and Lift Task

Size: px
Start display at page:

Download "Understanding the Role of Haptic Feedback in a Teleoperated/Prosthetic Grasp and Lift Task"

Transcription

1 Understanding the Role of Haptic in a Teleoperated/Prosthetic Grasp and Lift Task Jeremy D. Brown University of Michigan Andrew Paek University of Houston Mashaal Syed Drexel University Marcia K. O Malley Rice University Patricia A. Shewokis Drexel University Ann Arbor, MI USA Houston, TX USA Philadelphia, PA USA Houston, TX USA Philadelphia, PA USA Jose Luis Contreras-Vidal k Alicia J. Davis R. Brent Gillespie University of Houston University of Michigan University of Michigan Houston, TX USA Ann Arbor, MI USA Ann Arbor, MI USA ABSTRACT Achieving dexterous volitional control of an upper-limb prosthetic device will require multimodal sensory feedback that goes beyond vision. Haptic display is well-positioned to provide this additional sensory information. Haptic display, however, includes a diverse set of modalities that encode information differently. We have begun to make a comparison between two of these modalities, force feedback spanning the elbow, and amplitude-modulated vibrotactile feedback, based on performance in a functional grasp and lift task. In randomly ordered trials, we assessed the performance of N=11 participants (8 able-bodied, 3 amputee) attempting to grasp and lift an object using an EMG controlled gripper under three feedback conditions (no feedback, vibrotactile feedback, and force feedback), and two object weights that were undetectable by vision. Preliminary results indicate differences between able-bodied and amputee participants in coordination of grasp and lift forces. In addition, both force feedback and vibrotactile feedback contribute to significantly better task performance (fewer slips) and better adaptation following an unpredicted weight change. This suggests that the development and utilization of internal models for predictive control is more intuitive in the presence of haptic feedback. Keywords: human-machine interface, prosthetics, sensory substitution, grasp and lift 1 INTRODUCTION Given recent advances in actuator and sensor technology, upperlimb prosthetic development has seen an explosion in innovation, moving devices closer to the physiological form and function of the natural limbs they are replacing. Unfortunately, the ability to accurately and efficiently control the additional degrees of freedom lags significantly behind. In the intact limb, dexterous control relies on efferent pathways carrying user intent to the neuromuscular system and afferent pathways bringing feedback (both anticipated and unanticipated) to the central nervous system (CNS). This sensory information is presumed to be used by the CNS to develop and refine internal models of the limb and the environment it is operating within for dexterous control [7, 8]. jdelaine@umich.edu aypaek@uh.edu mms382@drexel.edu omalleym@rice.edu pas38@drexel.edu k jlcontr2@central.uh.edu aliciad@med.umich.edu brentg@umich.edu IEEE World Haptics Conference April, Daejeon, Korea /13/$ IEEE For upper-limb amputees, all efferent and afferent pathways abruptly end at the most distal point in the residual limb. Prosthetic limbs can therefore provide an artificial conduit through which these efferent and afferent signals can be restored. In terms of interpreting user intent, myoelectric sensors and force-sensing resistors provide alternatives. In addition, emerging technologies like targeted muscle reinnervation move closer to detecting user intent directly from the efferent command [13, 16]. Vision currently serves as the primary afferent signal. But alone, vision cannot provide the information needed for robust efficient volitional control. What lacks therefore, is adequate multimodal (vision, tactile, audition, and proprioceptive) afferent pathways capable of providing feedback regarding the device s interaction with the environment. Although there are several novel pursuits in the development of control and feedback technologies that can directly interface with the peripheral nerves of the residual limb, these technologies are still many years from being fully realized [1, 19]. What then can be done in the short term for amputees to improve the functionality and utility of current devices? Waiting to be developed are a suite of haptic feedback technologies that can be used to non-invasively provide sensory feedback to amputees wearing prosthetic devices. Indeed, work has already been conducted on a few of these haptic feedback modalities, including: vibrotactile feedback [4, 5], skin stretch feedback [12, 21], and force feedback [9, 17]. Since all of these technologies hold promise, a comparison should be made to determine which modality provides the most utility to the amputee. It could be that the ideal modality depends on the task for which it is being used. A good place to begin these comparisons would be with a functional task that has applications to an amputee s activities of daily living. Performing this task should rely heavily on multimodal sensory feedback, especially haptic feedback. The task should provide a rich data set from which comparisons could be made, both between modalities and with the preexisting literature. Ideally, benchmark comparisons could be made between amputees and able-bodied individuals performing the same task. In this paper, we attempt to explore whether the choice of haptic feedback modality has an effect on performance during a specific type of object manipulation task, a grasp and lift task. The choice of grasp and lift as the functional task allows for an in-depth look at the impact of sensory feedback on task performance. In healthy individuals, grasp and lift involves fine coordination of the grasp and lift forces. This careful coordination involves a parallel increase in the grip and load force prior to lifting. During the lifting phase, the object reaches its desired height in a critically damped fashion. These grip and load forces also scale with object weight. In addition, the grip force and load force rates are singlepeaked, bell shaped, and scale with the load force needed to lift the object. This behavior suggests that the movements involved in task completion are planned, and planning involves using internal representations of the object s weight and other properties [7, 8, 1]. 271

2 As a demonstration of this claim, when the weight of the object is experimentally manipulated to be lighter or heavier than expected, the resulting lifting phase occurs sooner than expected or not at all. The error arising from this mismatch between actual and predicted sensory information causes an increase or decrease in the fingertip forces, and an update of the internal representation of the object [7, 8, 1]. This updated representation is then used to ensure efficient coordination of grasp and lift forces on subsequent attempts. For subjects with impaired sensory feedback, the grip force and load force are less correlated, resulting in elevated grip forces prior to the onset of movement. This safety-factor behavior is similar to results seen in healthy subjects with temporarily anesthetized fingers [15]. Cutaneous afferents from the fingers play four important roles during manipulation: maintaining a background level in grip force, detecting incipient slip, modulating the grip/force ratio based on object friction, and updating internal representations of the object properties. These roles are superior to vision and proprioceptive afferents in terms of providing information about mechanical events at the fingertips [11]. The ideal prosthesis should, therefore, be able to substitute the information coming from the entire suite of tactile afferents (FA-I, FA-II, SA-I, SA-II) that innervate the inside of the hand, as well as provide proprioceptive information regarding the configuration of the limb. Given the complexity of such a task, it seems more fitting to start with two very important signals: slip-detection and grip force. Development of slip detection feedback systems is well underway [6, 2], and different haptic modalities have been used to provide grip force [4, 9, 14, 18]. In particular, when these tasks involve grasp and lift of a weighted object, performance with closed-loop control (providing haptic feedback) was better than performance with open-loop control (no haptic feedback) [14], especially in the presence of feedforward uncertainty [18]. In our previous work [2, 9], we found that force feedback spanning the elbow provides sufficient grip information to identify an object by its stiffness. We then demonstrated [3] through a simple haptic interface that the force and motion cues used to identify stiffness are best interpreted when the exploratory action and resulting force feedback are co-located at the same point of contact. We argue that only force feedback has the ability to co-locate force and action, and all other haptic modalities operate in a non co-located fashion. In prosthetics, the use of haptic feedback involves some form of sensory substitution, and real-life tasks are more complex than object identification. How then do these various haptic feedback modalities compare in a grasp and lift task, where sensory substitution is necessary for the development of internal models of the prosthetic limb and object being manipulated? We start with a comparison between two widely used haptic feedback modalities. Using an EMG controlled gripper, we will test both able-bodied and amputee participants with and without haptic feedback. Haptic feedback will either be force feedback or vibrotactile feedback. Visual and auditory feedback will be allowed in all conditions, making the no haptic feedback case similar to operation of current prosthetic devices. We will use different object weights, and will randomize the presentation of the weight and feedback to participants without notification. 1.1 Hypothesis We expect to see better coordination of grasp and lift forces with haptic feedback than without haptic feedback. In particular, we expect that there will be more failed attempts (object slips) without haptic feedback than with haptic feedback, especially when there is a weight change. In terms of a comparison between the two types of haptic feedback, we expect force feedback to perform better than vibrotactile feedback. 2 METHODS 2.1 Experimental Setup Our experimental apparatus consisted of a motorized elbow brace, a motorized gripper, an instrumented object, and a vibrotactile display. The motorized elbow brace is used to provide force feedback in the form of an extension moment spanning the elbow joint. It consisted of a right-handed Aircast Mayo Clinic Elbow Brace that has been customized with an attached motorized capstan drive. The DC motor used in the capstan drive is a Maxon RE 3 (6W) and was powered by a 24V power supply (TDK-Lambda ZWS15PAF) and H-Bridge amplifier (Advanced Motion Control 12A8). The motor was equipped with a rotary encoder on the motor shaft (Maxon 124 CPR) and brace shaft (US Digital, 25 CPR). The motorized brace was capable of delivering.15nm of torque. Participants arms were secured in the elbow brace through four velcro straps. For amputee participants, custom orthotic inserts were used in addition to the velcro straps. The width of the brace could also be adjusted. In operation, the motorized brace produced an extension moment about the elbow proportional to the measured grip force (Figure 1). Figure 1: Motorized elbow brace with right-handed Aircast Mayo Clinic elbow brace and motorized capstan drive. Brace produced an extension moment about the elbow proportional to the forces measures by the gripper. The motorized gripper was driven by a capstan drive powered by the same setup as the motorized brace. In addition, the gripper was equipped with a 5kg-capacity beam load cell (Transducer Techniques LSP-5). The gripper was capable of delivering 7.75N of force at the tip of the end-effector. The gripper was hand held about a foam grip for able-bodied participants, and mounted to the motorized elbow brace for amputee participants. In operation the gripper was position-controlled from EMG signals derived from the flexor carpi radialis muscle in the forearm (Figure 2). The vibrotactile display consisted of an Engineering Acoustics Inc. C2 tactor driven through a 12-17V 8.5A 11W power supply and H-Bridge amplifier (LOGOSOL DC Servo Amplifier LS-5Y- 12-DE). The tactor was held in place using an off-the-shelf mp3 player sports arm band. In operation, the tactor s vibration amplitude (T c ) was exponentially proportional to the measured grip force and driven according to Equation (1) with T camp =.1sec, Grip T c f req = 25Hz, and T cre f = Maximum Grip. T c =.5 e 2T c re f t sin(2pt c T f req t) (1) camp The instrumented object was a custom, ABS plastic, 3D printed device with a hinged side, removable drawer for inserting a weight, 272

3 Figure 2: Motorized gripper with powered capstan drive and load cell attached. Encoders on axis and motor shaft. Control signals were taken from two EMG surface electrodes placed on the flexor carpi radialis muscle with a reference electrode on the clavicle bone. A custom conditioning circuit provided full-wave rectification, low-pass filtering with a 3.4Hz cutoff frequency, and variable amplification of the raw signal. Although the electrodes had adhesive backing, a compression sleeve was used to keep the electrodes from coming loose during the experiment. The entire system was controlled by a Sensoray 626 PCI card installed in a Dell OptiPlex 71 series desktop running Microsoft Visual C++ 21 Express Edition. Brain imaging was also measured using 32 channel scalp electroencephalography (EEG) with a BrainAmps DC amplifier and acticap active electrodes (Brain Products GmBH) and a 16-channel fnir (fnir Imager 1) system (Figure 5). Brain imaging results will not be presented in this paper. Figure 3: C2 tactor inside mp3 sports band. and rubber grips for grasping. The hinged side was held in place by a magnet on a moving slide. The magnet and slide were adjustable to vary the gripping force required to break the object, by overcoming the magnetic force. The object had two infrared distance sensors (Sharp 2D12X) to measure vertical position, which were used in conjunction with a 1-lb capacity force plate (AMTI HE6X6-1) to measure the vertical load. A piece of white card stock was attached to the top of the force plate to allow for more accurate position readings from the encoders (Figure 4). (a) Able-Bodied Participant (b) Amputee Participant Figure 5: Testing setup for both able-bodied and amputee participants. Participants are wearing motorized elbow brace, motorized gripper, vibrotactile display, and brain imaging sensors. 2.2 Experimental Protocol We tested N=11 male participants, eight able-bodied (mean age 26.6) and three trans-radial amputees (mean age 53.3). The first participant withdrew from the study prior to testing, so results are only given for the remaining 1 participants. Prior to starting the study, each participant was consented according to the protocol approved by the University of Michigan s Institutional Review Board, then given an overview of the study. Participants were not compensated, and testing lasted two hours Training Due to the design of the brace, the right arm was used for experimentation. The vibrotactile display was placed on top of the biceps muscle of the right arm and secured with the velcro straps of the sports band. The motorized exoskeleton was placed around the upper and lower portions of the right arm with the elbow joint in line with the brace s axis of rotation. The brace was secured with velcro straps.the EMG gain was adjusted to ensure the participant s EMG signal was in the -5V range. This was checked using an oscilloscope. The EMG control gains and biases were adjusted so that the participant could open and close the gripper, as well as grasp and lift the instrumented object at the maximum weight three successive times. The force feedback and vibrotactile feedback gains were adjusted until they were independently recognized by the participant when grasping an object similar in size to the test object. The subject was then fitted with the fnir and EEG systems. Figure 4: Testing object with attached optical encoders and removable weight drawer atop force plate with white card stock on top for optical encoder readings Testing The test consisted of 144 trials broken into four blocks of 36 trials each. There were three conditions being tested: vibrotactile feedback, force feedback, and no feedback. Visual and auditory signals 273

4 were not blocked during any of the trials. The weight and condition were arranged based on a stratified randomization on two factors. There were two weights being used, 34g (drawer empty) and 59g (25g weight in drawer). During each block, there were 12 trials of each condition and 18 presentations of each weight placed randomly throughout. The magnet and slide were set at the maximum level to ensure the object didn t break under normal gripping conditions. Each trial lasted 1 seconds. During the trial, the participant was instructed to start from a rest position (holding the gripper in their hand), close and open the gripper, then reach, grasp, and lift the instrumented object, and place it back on the force plate. Subjects were instructed to grab the object at the rubber grips and lift it a few inches off the force plate before returning it. After the 1 seconds were up, the tester would remove the object from the force plate and change weights (if necessary) behind a cardboard curtain before replacing the object on the force plate for the next trial. This was also timed at 1 seconds (for participant two, 15 seconds was used). The participant was not aware of weight or condition changes prior to grasping and lifting the object. A timer with bell chimes kept track of timing. A break lasting a minimum of three minutes was taken after each block of 36 trials. Prior to starting each block, the control signals and feedback actuators were checked to ensure signal fidelity. There were a few notable changes to the protocol made for amputee participants. The first was that participants were not required to close the gripper at the beginning of each trial prior to grasping and lifting the object. Also, for amputee participants we only included the first two blocks. This was based on results from the able-bodied participants. The last change was that we tested one amputee participant with a flexion moment force feedback as opposed to an extension moment. 2.3 Metrics Our task performance metrics consisted of percent slip by condition overall and percent slip by condition after a weight transition. 2.4 Statistical Analysis Linear mixed models using a restricted maximum likelihood estimate for variance components was used for analyses. Within the model, subjects were a random effect while fixed effects included participant type (able-bodied or amputee), block, object weight, feedback condition, and protocol (accounting for the force feedback protocol change for the last amputee participant). Bonferroni adjustments were applied to estimated means to control for Type I errors and a significance criterion of.5 was used for all tests. To determine the effect of feedback with vibrotactile and force feedback as one condition while no haptic feedback was the other condition, a separate linear mixed model was calculated including the subject factor as a random effect. 3 RESULTS Some of our participants encountered issues with the EEG and fnir head gear. As a result, of our ten participants, only four completed all four blocks of the experiment. Five completed three blocks, and the remaining five only completed two blocks. This last group includes all amputee participants. Figure 6 shows the grip force, load force, and position traces for all no feedback trials in the first block. The traces in Figure 6a are from an able-bodied participant, while the traces in Figure 6b are from an amputee participant. These do not include trials where there was a weight transition, or trials where the object slipped. T= represents the time point at which the load force is 5% of its max. For the light to heavy transition (Figure 7), we analyzed how often the object slipped for the five participants who completed at least three blocks. For the first and second trial after the transition, there is no significant difference by condition on percent slip (Figure 7a,7b). For the third trial after the transition, there were significantly more slips in the no feedback condition (M=25%,SE=5.72%) that either the vibrotactile feedback (M=8%,SE=5.72%) or force feedback condition (M=8%,SE=5.72%) (p<.5) (Figure 7c). For the overall performance (Figure 8), we analyzed how often the object slipped for all participants in the first two blocks. We found that there were significantly more slips in the no feedback condition (M=43.22%, SE=4.6%) than either vibrotactile condition (M=34.24%, SE=4.6%) or the force feedback condition (M=33.55%, SE=4.6%) (p<.5). An additional analysis treating the vibrotactile and force feedback condition as one haptic feedback condition was performed. The results show that there were significantly more slips in the no feedback condition (M=43.22%, SE=3.5%) than in the combined haptic feedback condition (M=33.9%, SE=3.5%) (p<.1). The current results do not show any significant differences in percentage slip between block, participant type (able-bodied or amputee), or protocol. 4 DISCUSSION In this current study, we have set out to understand the utility of haptic feedback on a grasp and lift task with a prosthetic gripper. We have chosen the grasp and lift task because of its reliance on the use of sensory afferents to develop internal representations of the object being lifted and the surrounding environment. In healthy individuals, these representations are used for predictive control of the limb, allowing for grip and load forces to be controlled in a highly coordinated manner. In addition, these representations are used to compute errors between predicted and actual sensory afferents, which in turn update the representations themselves. In impaired individuals with reduced sensory afferents and efferents due to amputation or engineered through the use of a teleoperated/prosthetic gripper, the ability to form and update these representations seems limited. We believe that the addition of haptic feedback will provide greater assistance in this aim. t all haptic display modalities are created equal, and our ultimate aim is to determine which modality provides the most utility. We are interested in the coordination between grip and load forces, adaptation to changes in object weight, and overall performance in the manual grasp and lift task. Although we have only begun to tease out the results of the current experiment, our initial findings suggest that there may be differences between able-bodied and amputee participants in the coordination and timing of grip and load forces, and the use of haptic feedback produces significantly fewer slips during weight change adaptation, and significantly fewer slips overall. 4.1 Grasp and Lift Coordination In our time series analysis, we get a sense of how participants approached the manual grasp and lift task in terms of coordinating grasp and lift forces for objects with accurately predicted weight. For both the amputee and able-bodied participant, there was a parallel increase in the grip and load forces prior to object lift-off. This is consistent with results found in the natural limb [1]. In addition, the grip and load force traces separate visually by object weight. This is most evident in the load plots with few exceptions. There are no noticeable differences in the object position by weight. This result, although expected, confirms that the weight of the object did not inhibit the participant s ability to perform the task. Of more interest is the difference in grip force coordination between the able-bodied and amputee participant. For the able-bodied participant, the grip force began to increase just before the t = s time point. For both the heavy and light object, the grip force followed the same pattern, increasing to roughly the same level at t =.5s, then either increasing or staying the same if the object was heavy or light, respectively. In this manner, it seems as though 274

5 Grip (N) Load (N) 1 6 Load Grip (N) Load (N) 1 6 Position (cm) 4 Grip Time (s) Position (cm) 4 Time (s) (a) Able-Bodied Participant (b) Amputee Participant Figure 6: Sample time-domain plots: (a) Able-bodied (b) Amputee participant. All traces are for successful (no slip) trials not immediately following a weight transition in the no feedback condition. Dashed lines (- -) represent light objects, solid lines (-) represent heavy objects. T= represents the time point at which the load force was 5% of its max * (a) Light Heavy Transition (b) Light Heavy Transition + 1 (c) Light Heavy Transition + 2 Figure 7: (a) Average percent slip by condition for first trial following light to heavy weight transition for all subjects who completed 3 blocks. (b) Average percent slip by condition for second trial following light to heavy weight transition for all subjects who completed 3 blocks. (c) Average percent slip by condition for third trial following light to heavy weight transition for all subjects who completed 3 blocks * (a) Uncombined * Haptic (b) Combined Haptic Figure 8: Average percent slip by condition in blocks 1&2 (first 72 trials). (a) Uncombined refers to conditions no feedback, vibrotactile feedback, and force feedback. (b) Combined refers to conditions no feedback and vibrotactile+force feedback. the participant had a targeted checkpoint grip force level at liftoff from which further adjustments could be made, based on object weight. For the amputee participant, the grip force began to increase before the t =.5s time point. Once initiated, the grip force increased to a level at t = s higher than that observed in the ablebodied participant. At t = s, the grip force decreased to a level similar to that used by the able-bodied participant. This level was subsequently adjusted based on object weight. In this manner, the participant appeared to initially use a grip force that was at a safety factor level. This is similar to findings from impaired individuals and those with anesthetized digits [15]. Perhaps these trends provide insight into the generalizable manner in which able-bodied and amputee participants approach the task, or perhaps these differences are participant dependent. At present, they can only motivate further investigation. 4.2 Weight Transition Important in the transition from a light object to a heavy object is how quickly participants adapt to the new weight. We believe this adaptation involves a revision of the internal representation of the object to one heavier than the current representation predicts, and updating the necessary motor commands. The revision and update are based solely on the multimodal sensory feedback provided. In the absence of haptic feedback, the object weight, which is detected in hand holding the gripper or through the rigid brace, along with visual monitoring of object liftoff are all that are present. When grip force is provided via haptic feedback, there is additional information available that could be used to control grip and load force coordination. In addition, we acknowledge that there were possibly other cues available, such as the manner in which the presenter held the object, but these types of confounding factors are present in all three conditions. Therefore, we would expect to see a difference in grip and load force coordination with and without haptic feedback. In particular, if the haptic feedback is useful, there should be improvements in grip and load force coordination with each successive presentation of the object, after the transition occurs. A broader analysis of adaptation can be made by assessing how 275

6 successful the grasp and lift task is after the transition. How well the absence or addition of haptic feedback helps in adaptation to a change in weight should be reflected in how often the object slips during a grasp and lift attempt. Our results from five able-bodied participants in the first three blocks show that the addition of haptic feedback (vibrotactile or force) does significantly reduce how often slips occur by the second presentation of the heavy weight after the transition (transition + 2). This is compared to the transition and first presentation after the transition (transition + 1). This finding serves as evidence suggesting that the haptic feedback does provide better adaptation than no haptic feedback. It can be concluded then that sensory information is being used to update and maintain internal representations of the object used for volitional control. 4.3 Overall Performance The fact that there were more slips overall without haptic feedback alludes to the potential utility haptic feedback could provide to amputees wearing active prostheses. This finding is also supported by findings that grip force control is enhanced by haptic feedback for surface EMG controlled hands in targeted reinnervation amputees [12]. In addition, the promising results in the area of adaptation suggest that this sensory information is in some way being incorporated in the brain s motor schema and is being used for predictive control. This finding combined with the fact that there were no differences between able-bodied and amputee participants in terms of overall performance suggest how broad of an impact this could have on limb use and functionality. At this point, we acknowledge that we have not been able to differentiate between or compare the individual impact of force feedback versus vibrotactile feedback on a grasp and lift task. However, at the same time we understand that oftentimes these are differences that are more evident in cognitive processing than manual task performance. Fortunately, we have brain imaging data accompanying this current experiment that has yet to be fully analyzed. In addition, we acknowledge that we have only compared one type of force feedback, and one specific type of vibrotactile feedback. Yet, our current attempt has been to begin to unravel and understand the effects of haptics feedback in the use of a teleoperated/prosthetic gripper. For indeed if the trends presented in this brief analysis hold true for the larger amputee population, future prosthetic devices would benefit from the incorporation of some form of haptic feedback. ACKNOWLEDGEMENTS The authors wish to thank Bradley Costa, Jordan Barkus, Brian Thompson, Bruce Cousin, Brandon Johnson, Bo Yu, Daniel Ursu, and Dongwong Kim. This work was supported in part by the National Science Foundation, grants IIS-16527, IIS , IIS , and IIS REFERENCES [1] A. Abbott. Neuroprosthetics: in search of the sixth sense. Nature, 442(799): , July 26. [2] J. D. Brown and R. B. Gillespie. The effect of force/motion coupling on motor and cognitive performance. In 211 {IEEE} World Haptics Conference {(WHC)}, pages IEEE, June 211. [3] J. D. Brown, R. B. Gillespie, D. Gardner, and E. a. Gansallo. Co-location of force and action improves identification of forcedisplacement features. 212 IEEE Haptics Symposium (HAPTICS), pages , Mar [4] A. Chatterjee, P. Chaubey, J. Martin, and N. V. Thakor. Quantifying Prosthesis Control Improvements Using a Representation of Grip. In 28 {IEEE} Region 5 Conference, pages 1 5. IEEE, Apr. 28. [5] M. D Alonzo, C. Cipriani, and M. C. Carrozza. sensory substitution in multi-fingered hand prostheses: Evaluation studies. In 211 {IEEE} International Conference on Rehabilitation Robotics {(ICORR)}, pages 1 6. IEEE, July 211. [6] D. D. Damian, a. H. Arita, H. Martinez, and R. Pfeifer. Slip speed feedback for grip force control. IEEE transactions on bio-medical engineering, 59(8):22 1, Aug [7] J. R. Flanagan, M. C. Bowman, and R. S. Johansson. Control strategies in object manipulation tasks. Current opinion in neurobiology, 16(6):65 9, Dec. 26. [8] J. R. Flanagan and a. M. Wing. The role of internal models in motion planning and control: evidence from grip force adjustments during movements of hand-held loads. The Journal of neuroscience : the official journal of the Society for Neuroscience, 17(4): , Feb [9] R. B. Gillespie, J. L. Contreras-Vidal, P. A. Shewokis, M. K. O Malley, J. D. Brown, H. Agashe, R. Gentili, and A. Davis. Toward improved sensorimotor integration and learning using upperlimb prosthetic devices. In 21 Annual International Conference of the {IEEE} Engineering in Medicine and Biology Society {(EMBC)}, pages IEEE, Sept. 21. [1] R. Johansson and G. Westling. Coordinated isometric muscle commands adequately and erroneously programmed for the weight during lifting task with precision grip. Experimental Brain Research, pages 59 71, [11] R. S. Johansson and J. R. Flanagan. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nature reviews. Neuroscience, 1(5):345 59, May 29. [12] K. Kim and J. E. Colgate. Haptic feedback enhances grip force control of semg-controlled prosthetic hands in targeted reinnervation amputees. IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society, 2(6):798 85, v [13] T. a. Kuiken, G. Li, B. a. Lock, R. D. Lipschutz, L. a. Miller, K. a. Stubblefield, and K. B. Englehart. Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. JAMA : the journal of the American Medical Association, 31(6):619 28, Feb. 29. [14] S. G. Meek, S. C. Jacobsen, and P. P. Goulding. Extended physiologic taction: design and evaluation of a proportional force feedback system. Journal of rehabilitation research and development, 26(3):53 62, Jan [15] D. a. wak, S. Glasauer, and J. Hermsdorfer. How predictive is grip force control in the complete absence of somatosensory feedback? Brain : a journal of neurology, 127(Pt 1):182 92, Jan. 24. [16] K. Ohnishi, R. F. Weir, and T. a. Kuiken. Neural machine interfaces for controlling multifunctional powered upper-limb prostheses. Expert review of medical devices, 4(1):43 53, Jan. 27. [17] A. Panarese, B. B. Edin, F. Vecchi, M. C. Carrozza, and R. S. Johansson. Humans Can Integrate to Toes in Their Sensorimotor Control of a Robotic Hand. {IEEE} Transactions on Neural Systems and Rehabilitation Engineering, 17(6):56 567, Dec. 29. [18] I. Saunders and S. Vijayakumar. The role of feed-forward and feedback processes for closed-loop prosthesis control. Journal of neuroengineering and rehabilitation, 8(1):6, Jan [19] A. B. Schwartz, X. T. Cui, D. J. Weber, and D. W. Moran. Braincontrolled interfaces: movement restoration with neural prosthetics. Neuron, 52(1):25 22, Oct. 26. [2] R. J. Webster, T. E. Murphy, L. N. Verner, and A. M. Okamura. A novel two-dimensional tactile slip display: design, kinematics and perceptual experiments. ACM Transactions on Applied Perception, 2(2):15 165, Apr. 25. [21] J. Wheeler, K. Bark, J. Savall, and M. Cutkosky. Investigation of Rotational Skin Stretch for Proprioceptive With Application to Myoelectric Systems. {IEEE} Transactions on Neural Systems and Rehabilitation Engineering, 18(1):58 66, Feb

Tactile Feedback of Object Slip Improves Performance in a Grasp and Hold Task

Tactile Feedback of Object Slip Improves Performance in a Grasp and Hold Task Tactile Feedback of Object Slip Improves Performance in a Grasp and Hold Task Julie M. Walker Rice University Amy A. Blank Rice University Patricia A. Shewokis Drexel University Marcia K. O Malley Rice

More information

Shape Memory Alloy Actuator Controller Design for Tactile Displays

Shape Memory Alloy Actuator Controller Design for Tactile Displays 34th IEEE Conference on Decision and Control New Orleans, Dec. 3-5, 995 Shape Memory Alloy Actuator Controller Design for Tactile Displays Robert D. Howe, Dimitrios A. Kontarinis, and William J. Peine

More information

Proprioception & force sensing

Proprioception & force sensing Proprioception & force sensing Roope Raisamo Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Based on material by Jussi Rantala, Jukka

More information

Electro-tactile Feedback System for a Prosthetic Hand

Electro-tactile Feedback System for a Prosthetic Hand Electro-tactile Feedback System for a Prosthetic Hand Daniel Pamungkas and Koren Ward University of Wollongong, Australia daniel@uowmail.edu.au koren@uow.edu.au Abstract. Without the sense of touch, amputees

More information

Electro-tactile Feedback System for a Prosthetic Hand

Electro-tactile Feedback System for a Prosthetic Hand University of Wollongong Research Online Faculty of Engineering and Information Sciences - Papers: Part A Faculty of Engineering and Information Sciences 2015 Electro-tactile Feedback System for a Prosthetic

More information

Texture recognition using force sensitive resistors

Texture recognition using force sensitive resistors Texture recognition using force sensitive resistors SAYED, Muhammad, DIAZ GARCIA,, Jose Carlos and ALBOUL, Lyuba Available from Sheffield Hallam University Research

More information

Elements of Haptic Interfaces

Elements of Haptic Interfaces Elements of Haptic Interfaces Katherine J. Kuchenbecker Department of Mechanical Engineering and Applied Mechanics University of Pennsylvania kuchenbe@seas.upenn.edu Course Notes for MEAM 625, University

More information

This is a repository copy of A Wearable Skin Stretch Haptic Feedback Device: Towards Improving Balance Control in Lower Limb Amputees.

This is a repository copy of A Wearable Skin Stretch Haptic Feedback Device: Towards Improving Balance Control in Lower Limb Amputees. This is a repository copy of A Wearable Skin Stretch Haptic Feedback Device: Towards Improving Balance Control in Lower Limb Amputees. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/102338/

More information

Haptic Perception & Human Response to Vibrations

Haptic Perception & Human Response to Vibrations Sensing HAPTICS Manipulation Haptic Perception & Human Response to Vibrations Tactile Kinesthetic (position / force) Outline: 1. Neural Coding of Touch Primitives 2. Functions of Peripheral Receptors B

More information

Hand Movements I. THE ACTING AND PERCEIVING HAND GLOSSARY

Hand Movements I. THE ACTING AND PERCEIVING HAND GLOSSARY Hand Movements J. RANDALL FLANAGAN* and ROLAND S. JOHANSSON { *Queen s University, Canada and { Umeå University, Sweden I. The Acting and Perceiving Hand II. Sensorimotor Control of Hand Movements in Object

More information

I+ I. Eric Eisenstadt, Ph.D. DARPA Defense Sciences Office. Direct Brain-Machine Interface. Science and Technology Symposium April 2004

I+ I. Eric Eisenstadt, Ph.D. DARPA Defense Sciences Office. Direct Brain-Machine Interface. Science and Technology Symposium April 2004 ------~~--------------~---------------- Direct Brain-Machine Interface Eric Eisenstadt, Ph.D. DARPA Defense Sciences Office Science and Technology Symposium 21-22 April 2004 I+ I Defence Research and Recherche

More information

phri: specialization groups HS PRELIMINARY

phri: specialization groups HS PRELIMINARY phri: specialization groups HS 2019 - PRELIMINARY 1) VELOCITY ESTIMATION WITH HALL EFFECT SENSOR 2) VELOCITY MEASUREMENT: TACHOMETER VS HALL SENSOR 3) POSITION AND VELOCTIY ESTIMATION BASED ON KALMAN FILTER

More information

The Rice Haptic Rocker: skin stretch haptic feedback with the Pisa/IIT SoftHand

The Rice Haptic Rocker: skin stretch haptic feedback with the Pisa/IIT SoftHand The Rice Haptic Rocker: skin stretch haptic feedback with the Pisa/IIT SoftHand Edoardo Battaglia 1, Janelle P. Clark 2, Matteo Bianchi 1, Manuel G. Catalano 1,3, Antonio Bicchi 1,3 and Marcia K. O Malley

More information

Brain-Machine Interface for Neural Prosthesis:

Brain-Machine Interface for Neural Prosthesis: Brain-Machine Interface for Neural Prosthesis: Nitish V. Thakor, Ph.D. Professor, Biomedical Engineering Joint Appointments: Electrical & Computer Eng, Materials Science & Eng, Mechanical Eng Neuroengineering

More information

This is a postprint of. The influence of material cues on early grasping force. Bergmann Tiest, W.M., Kappers, A.M.L.

This is a postprint of. The influence of material cues on early grasping force. Bergmann Tiest, W.M., Kappers, A.M.L. This is a postprint of The influence of material cues on early grasping force Bergmann Tiest, W.M., Kappers, A.M.L. Lecture Notes in Computer Science, 8618, 393-399 Published version: http://dx.doi.org/1.17/978-3-662-44193-_49

More information

Wearable Haptic Device for Cutaneous Force and Slip Speed Display

Wearable Haptic Device for Cutaneous Force and Slip Speed Display 01 IEEE International Conference on Robotics and Automation RiverCentre, Saint Paul, Minnesota, USA May 1-18, 01 Wearable Haptic Device for Cutaneous Force and Slip Speed Display Dana D. Damian, Marvin

More information

NON INVASIVE TECHNIQUE BASED EVALUATION OF ELECTROMYOGRAM SIGNALS USING STATISTICAL ALGORITHM

NON INVASIVE TECHNIQUE BASED EVALUATION OF ELECTROMYOGRAM SIGNALS USING STATISTICAL ALGORITHM NON INVASIVE TECHNIQUE BASED EVALUATION OF ELECTROMYOGRAM SIGNALS USING STATISTICAL ALGORITHM Tanu Sharma 1, Karan Veer 2, Ravinder Agarwal 2 1 CSED Department, Global college of Engineering, Khanpur Kuhi

More information

Haptic Discrimination of Perturbing Fields and Object Boundaries

Haptic Discrimination of Perturbing Fields and Object Boundaries Haptic Discrimination of Perturbing Fields and Object Boundaries Vikram S. Chib Sensory Motor Performance Program, Laboratory for Intelligent Mechanical Systems, Biomedical Engineering, Northwestern Univ.

More information

MSMS Software for VR Simulations of Neural Prostheses and Patient Training and Rehabilitation

MSMS Software for VR Simulations of Neural Prostheses and Patient Training and Rehabilitation MSMS Software for VR Simulations of Neural Prostheses and Patient Training and Rehabilitation Rahman Davoodi and Gerald E. Loeb Department of Biomedical Engineering, University of Southern California Abstract.

More information

Laboratory Project 1B: Electromyogram Circuit

Laboratory Project 1B: Electromyogram Circuit 2240 Laboratory Project 1B: Electromyogram Circuit N. E. Cotter, D. Christensen, and K. Furse Electrical and Computer Engineering Department University of Utah Salt Lake City, UT 84112 Abstract-You will

More information

FINGER MOVEMENT DETECTION USING INFRARED SIGNALS

FINGER MOVEMENT DETECTION USING INFRARED SIGNALS FINGER MOVEMENT DETECTION USING INFRARED SIGNALS Dr. Jillella Venkateswara Rao. Professor, Department of ECE, Vignan Institute of Technology and Science, Hyderabad, (India) ABSTRACT It has been created

More information

Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery

Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery Claudio Pacchierotti Domenico Prattichizzo Katherine J. Kuchenbecker Motivation Despite its expected clinical

More information

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Jane Li Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Use an example to explain what is admittance control? You may refer to exoskeleton

More information

Expression of 2DOF Fingertip Traction with 1DOF Lateral Skin Stretch

Expression of 2DOF Fingertip Traction with 1DOF Lateral Skin Stretch Expression of 2DOF Fingertip Traction with 1DOF Lateral Skin Stretch Vibol Yem 1, Mai Shibahara 2, Katsunari Sato 2, Hiroyuki Kajimoto 1 1 The University of Electro-Communications, Tokyo, Japan 2 Nara

More information

Lecture 7: Human haptics

Lecture 7: Human haptics ME 327: Design and Control of Haptic Systems Winter 2018 Lecture 7: Human haptics Allison M. Okamura Stanford University types of haptic sensing kinesthesia/ proprioception/ force cutaneous/ tactile Related

More information

Thresholds for Dynamic Changes in a Rotary Switch

Thresholds for Dynamic Changes in a Rotary Switch Proceedings of EuroHaptics 2003, Dublin, Ireland, pp. 343-350, July 6-9, 2003. Thresholds for Dynamic Changes in a Rotary Switch Shuo Yang 1, Hong Z. Tan 1, Pietro Buttolo 2, Matthew Johnston 2, and Zygmunt

More information

Low-Frequency Transient Visual Oscillations in the Fly

Low-Frequency Transient Visual Oscillations in the Fly Kate Denning Biophysics Laboratory, UCSD Spring 2004 Low-Frequency Transient Visual Oscillations in the Fly ABSTRACT Low-frequency oscillations were observed near the H1 cell in the fly. Using coherence

More information

System Inputs, Physical Modeling, and Time & Frequency Domains

System Inputs, Physical Modeling, and Time & Frequency Domains System Inputs, Physical Modeling, and Time & Frequency Domains There are three topics that require more discussion at this point of our study. They are: Classification of System Inputs, Physical Modeling,

More information

Electromyography Low Pass Filtering Effects on the Classification of Hand Movements in Amputated Subjects

Electromyography Low Pass Filtering Effects on the Classification of Hand Movements in Amputated Subjects International Journal of Signal Processing Systems Vol., No., December 05 Electromyography Low Pass Filtering Effects on the Classification of Hand Movements in Amputated Subjects Manfredo Atzori and Henning

More information

Effects of Longitudinal Skin Stretch on the Perception of Friction

Effects of Longitudinal Skin Stretch on the Perception of Friction In the Proceedings of the 2 nd World Haptics Conference, to be held in Tsukuba, Japan March 22 24, 2007 Effects of Longitudinal Skin Stretch on the Perception of Friction Nicholas D. Sylvester William

More information

A cutaneous stretch device for forearm rotational guidace

A cutaneous stretch device for forearm rotational guidace Chapter A cutaneous stretch device for forearm rotational guidace Within the project, physical exercises and rehabilitative activities are paramount aspects for the resulting assistive living environment.

More information

A Study of Perceptual Performance in Haptic Virtual Environments

A Study of Perceptual Performance in Haptic Virtual Environments Paper: Rb18-4-2617; 2006/5/22 A Study of Perceptual Performance in Haptic Virtual Marcia K. O Malley, and Gina Upperman Mechanical Engineering and Materials Science, Rice University 6100 Main Street, MEMS

More information

Feeding human senses through Immersion

Feeding human senses through Immersion Virtual Reality Feeding human senses through Immersion 1. How many human senses? 2. Overview of key human senses 3. Sensory stimulation through Immersion 4. Conclusion Th3.1 1. How many human senses? [TRV

More information

University of Michigan 1630 Cram Circle Apt. #13Ann Arbor, MI, 48105, ,

University of Michigan 1630 Cram Circle Apt. #13Ann Arbor, MI, 48105, , EDUCATION Doctor of Philosophy in Mechanical Engineering Apr. 2016, Ann Arbor, MI Specialization: Proposal and Analysis of Human, Machine Control toward Rehabilitation Advisor: Richard B. Gillespie, Ph.D.

More information

Learning to Detect Doorbell Buttons and Broken Ones on Portable Device by Haptic Exploration In An Unsupervised Way and Real-time.

Learning to Detect Doorbell Buttons and Broken Ones on Portable Device by Haptic Exploration In An Unsupervised Way and Real-time. Learning to Detect Doorbell Buttons and Broken Ones on Portable Device by Haptic Exploration In An Unsupervised Way and Real-time Liping Wu April 21, 2011 Abstract The paper proposes a framework so that

More information

Live. With Michelangelo

Live. With Michelangelo Live. With Michelangelo As natural as you are Live. With Michelangelo As natural as you are 1 2 Live. With Michelangelo As natural as you are Few parts of the human body are as versatile and complex as

More information

II. LITERATURE REVIEW

II. LITERATURE REVIEW International Journal of Engineering Science Invention ISSN (Online): 2319 6734, ISSN (Print): 2319 6726 Volume 6 Issue 9 September 2017 PP. 41-45 Bionic Arm * Nayim Ali Khan 1, Nagesh K 2, Rahul R 3 BE

More information

Classifying the Brain's Motor Activity via Deep Learning

Classifying the Brain's Motor Activity via Deep Learning Final Report Classifying the Brain's Motor Activity via Deep Learning Tania Morimoto & Sean Sketch Motivation Over 50 million Americans suffer from mobility or dexterity impairments. Over the past few

More information

The impact of the stimulation frequency on closed-loop control with electrotactile feedback

The impact of the stimulation frequency on closed-loop control with electrotactile feedback Paredes et al. Journal of NeuroEngineering and Rehabilitation (215) 12:35 DOI 1.1186/s12984-15-22-8 JOURNAL OF NEUROENGINEERING JNERAND REHABILITATION RESEARCH Open Access The impact of the stimulation

More information

Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information

Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information Karlin Bark Jason W. Wheeler Sunthar Premakumar Mark R. Cutkosky Center for Design Research Department

More information

Estimating Friction Using Incipient Slip Sensing During a Manipulation Task

Estimating Friction Using Incipient Slip Sensing During a Manipulation Task Estimating Friction Using Incipient Slip Sensing During a Manipulation Task Marc R. Tremblay Mark R. Cutkosky Center for Design Research Building 2-53, Duena Street Stanford University Stanford, CA 9435-426

More information

Emoto-bot Demonstration Control System

Emoto-bot Demonstration Control System Emoto-bot Demonstration Control System I am building a demonstration control system for VEX robotics that creates a human-machine interface for an assistive or companion robotic device. My control system

More information

Digital Extensions with Bi-axial Fingertip Sensors for Supplementary Tactile Feedback Studies

Digital Extensions with Bi-axial Fingertip Sensors for Supplementary Tactile Feedback Studies 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob) Enschede, The Netherlands, August -9, Digital Extensions with Bi-axial Fingertip Sensors for Supplementary Tactile

More information

New Long Stroke Vibration Shaker Design using Linear Motor Technology

New Long Stroke Vibration Shaker Design using Linear Motor Technology New Long Stroke Vibration Shaker Design using Linear Motor Technology The Modal Shop, Inc. A PCB Group Company Patrick Timmons Calibration Systems Engineer Mark Schiefer Senior Scientist Long Stroke Shaker

More information

Salient features make a search easy

Salient features make a search easy Chapter General discussion This thesis examined various aspects of haptic search. It consisted of three parts. In the first part, the saliency of movability and compliance were investigated. In the second

More information

Exploring Surround Haptics Displays

Exploring Surround Haptics Displays Exploring Surround Haptics Displays Ali Israr Disney Research 4615 Forbes Ave. Suite 420, Pittsburgh, PA 15213 USA israr@disneyresearch.com Ivan Poupyrev Disney Research 4615 Forbes Ave. Suite 420, Pittsburgh,

More information

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright E90 Project Proposal 6 December 2006 Paul Azunre Thomas Murray David Wright Table of Contents Abstract 3 Introduction..4 Technical Discussion...4 Tracking Input..4 Haptic Feedack.6 Project Implementation....7

More information

Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers

Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers Maitreyee Wairagkar Brain Embodiment Lab, School of Systems Engineering, University of Reading, Reading, U.K.

More information

Presented by: V.Lakshana Regd. No.: Information Technology CET, Bhubaneswar

Presented by: V.Lakshana Regd. No.: Information Technology CET, Bhubaneswar BRAIN COMPUTER INTERFACE Presented by: V.Lakshana Regd. No.: 0601106040 Information Technology CET, Bhubaneswar Brain Computer Interface from fiction to reality... In the futuristic vision of the Wachowski

More information

DUE to advances in sensing technology, it is possible to

DUE to advances in sensing technology, it is possible to IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, VOL. 20, NO. 1, JANUARY 2012 31 Vibrotactile Sensory Substitution for Object Manipulation: Amplitude Versus Pulse Train Frequency Modulation

More information

Dipartimento di Elettronica Informazione e Bioingegneria Robotics

Dipartimento di Elettronica Informazione e Bioingegneria Robotics Dipartimento di Elettronica Informazione e Bioingegneria Robotics Behavioral robotics @ 2014 Behaviorism behave is what organisms do Behaviorism is built on this assumption, and its goal is to promote

More information

Experiments with Haptic Perception in a Robotic Hand

Experiments with Haptic Perception in a Robotic Hand Experiments with Haptic Perception in a Robotic Hand Magnus Johnsson 1,2 Robert Pallbo 1 Christian Balkenius 2 1 Dept. of Computer Science and 2 Lund University Cognitive Science Lund University, Sweden

More information

IOSR Journal of Engineering (IOSRJEN) e-issn: , p-issn: , Volume 2, Issue 11 (November 2012), PP 37-43

IOSR Journal of Engineering (IOSRJEN) e-issn: , p-issn: ,  Volume 2, Issue 11 (November 2012), PP 37-43 IOSR Journal of Engineering (IOSRJEN) e-issn: 2250-3021, p-issn: 2278-8719, Volume 2, Issue 11 (November 2012), PP 37-43 Operative Precept of robotic arm expending Haptic Virtual System Arnab Das 1, Swagat

More information

Title: A Comparison of Different Tactile Output Devices In An Aviation Application

Title: A Comparison of Different Tactile Output Devices In An Aviation Application Page 1 of 6; 12/2/08 Thesis Proposal Title: A Comparison of Different Tactile Output Devices In An Aviation Application Student: Sharath Kanakamedala Advisor: Christopher G. Prince Proposal: (1) Provide

More information

Group #17 Arian Garcia Javier Morales Tatsiana Smahliuk Christopher Vendette

Group #17 Arian Garcia Javier Morales Tatsiana Smahliuk Christopher Vendette Group #17 Arian Garcia Javier Morales Tatsiana Smahliuk Christopher Vendette Electrical Engineering Electrical Engineering Electrical Engineering Electrical Engineering Contents 1 2 3 4 5 6 7 8 9 Motivation

More information

Robots Learning from Robots: A proof of Concept Study for Co-Manipulation Tasks. Luka Peternel and Arash Ajoudani Presented by Halishia Chugani

Robots Learning from Robots: A proof of Concept Study for Co-Manipulation Tasks. Luka Peternel and Arash Ajoudani Presented by Halishia Chugani Robots Learning from Robots: A proof of Concept Study for Co-Manipulation Tasks Luka Peternel and Arash Ajoudani Presented by Halishia Chugani Robots learning from humans 1. Robots learn from humans 2.

More information

FATIGUE INDEPENDENT AMPLITUDE-FREQUENCY CORRELATIONS IN EMG SIGNALS

FATIGUE INDEPENDENT AMPLITUDE-FREQUENCY CORRELATIONS IN EMG SIGNALS Fatigue independent amplitude-frequency correlations in emg signals. Adam SIEMIEŃSKI 1, Alicja KEBEL 1, Piotr KLAJNER 2 1 Department of Biomechanics, University School of Physical Education in Wrocław

More information

Evaluation of Force, Vibration and Thermal Tactile Feedback in Prosthetic Limbs

Evaluation of Force, Vibration and Thermal Tactile Feedback in Prosthetic Limbs Evaluation of Force, Vibration and Thermal Tactile Feedback in Prosthetic Limbs ABSTRACT Meghan C. Jimenez* SynTouch, LLC Harvey Mudd College While substantial research efforts have been put forth to advance

More information

Booklet of teaching units

Booklet of teaching units International Master Program in Mechatronic Systems for Rehabilitation Booklet of teaching units Third semester (M2 S1) Master Sciences de l Ingénieur Université Pierre et Marie Curie Paris 6 Boite 164,

More information

Touch. Touch & the somatic senses. Josh McDermott May 13,

Touch. Touch & the somatic senses. Josh McDermott May 13, The different sensory modalities register different kinds of energy from the environment. Touch Josh McDermott May 13, 2004 9.35 The sense of touch registers mechanical energy. Basic idea: we bump into

More information

A Pilot Study: Introduction of Time-domain Segment to Intensity-based Perception Model of High-frequency Vibration

A Pilot Study: Introduction of Time-domain Segment to Intensity-based Perception Model of High-frequency Vibration A Pilot Study: Introduction of Time-domain Segment to Intensity-based Perception Model of High-frequency Vibration Nan Cao, Hikaru Nagano, Masashi Konyo, Shogo Okamoto 2 and Satoshi Tadokoro Graduate School

More information

On-Line Interactive Dexterous Grasping

On-Line Interactive Dexterous Grasping On-Line Interactive Dexterous Grasping Matei T. Ciocarlie and Peter K. Allen Columbia University, New York, USA {cmatei,allen}@columbia.edu Abstract. In this paper we describe a system that combines human

More information

Effect of Remote Vibrotactile Noise on Pinch Force Maintenance Ability and Brain Activity

Effect of Remote Vibrotactile Noise on Pinch Force Maintenance Ability and Brain Activity University of Wisconsin Milwaukee UWM Digital Commons Theses and Dissertations August 2013 Effect of Remote Vibrotactile Noise on Pinch Force Maintenance Ability and Brain Activity Ying-Ling Tseng University

More information

PREDICTION OF FINGER FLEXION FROM ELECTROCORTICOGRAPHY DATA

PREDICTION OF FINGER FLEXION FROM ELECTROCORTICOGRAPHY DATA University of Tartu Institute of Computer Science Course Introduction to Computational Neuroscience Roberts Mencis PREDICTION OF FINGER FLEXION FROM ELECTROCORTICOGRAPHY DATA Abstract This project aims

More information

Differences in Fitts Law Task Performance Based on Environment Scaling

Differences in Fitts Law Task Performance Based on Environment Scaling Differences in Fitts Law Task Performance Based on Environment Scaling Gregory S. Lee and Bhavani Thuraisingham Department of Computer Science University of Texas at Dallas 800 West Campbell Road Richardson,

More information

THE HUMAN POWER AMPLIFIER TECHNOLOGY APPLIED TO MATERIAL HANDLING

THE HUMAN POWER AMPLIFIER TECHNOLOGY APPLIED TO MATERIAL HANDLING THE HUMAN POWER AMPLIFIER TECHNOLOGY APPLIED TO MATERIAL HANDLING H. Kazerooni Mechanical Engineering Department Human Engineering Laboratory (HEL) University ofcajifomia, Berkeley, CA 94720-1740 USA E-Mail:

More information

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many Preface The jubilee 25th International Conference on Robotics in Alpe-Adria-Danube Region, RAAD 2016 was held in the conference centre of the Best Western Hotel M, Belgrade, Serbia, from 30 June to 2 July

More information

Effects of Magnitude and Phase Cues on Human Motor Adaptation

Effects of Magnitude and Phase Cues on Human Motor Adaptation Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems Salt Lake City, UT, USA, March 18-20, 2009 Effects of Magnitude and Phase Cues on

More information

Methods for Haptic Feedback in Teleoperated Robotic Surgery

Methods for Haptic Feedback in Teleoperated Robotic Surgery Young Group 5 1 Methods for Haptic Feedback in Teleoperated Robotic Surgery Paper Review Jessie Young Group 5: Haptic Interface for Surgical Manipulator System March 12, 2012 Paper Selection: A. M. Okamura.

More information

Live. With Michelangelo

Live. With Michelangelo Live. With Michelangelo As natural as you are Live. With Michelangelo As natural as you are 1 2 Live. With Michelangelo As natural as you are Few parts of the human body are as versatile and complex as

More information

Evaluation of Haptic Virtual Fixtures in Psychomotor Skill Development for Robotic Surgical Training

Evaluation of Haptic Virtual Fixtures in Psychomotor Skill Development for Robotic Surgical Training Department of Electronics, Information and Bioengineering Neuroengineering and medical robotics Lab Evaluation of Haptic Virtual Fixtures in Psychomotor Skill Development for Robotic Surgical Training

More information

Reconsideration of Ouija Board Motion in Terms of Haptic Illusions (Ⅲ) -Experiment with 1-DoF Linear Rail Device-

Reconsideration of Ouija Board Motion in Terms of Haptic Illusions (Ⅲ) -Experiment with 1-DoF Linear Rail Device- Reconsideration of Ouija Board Motion in Terms of Haptic Illusions (Ⅲ) -Experiment with 1-DoF Linear Rail Device- Takahiro Shitara, Yuriko Nakai, Haruya Uematsu, Vibol Yem, and Hiroyuki Kajimoto, The University

More information

ROBOT ASSISTED STANDING-UP IN PERSONS WITH LOWER LIMB PROSTHESES

ROBOT ASSISTED STANDING-UP IN PERSONS WITH LOWER LIMB PROSTHESES S Proceedings 23rd Annual Conference IEEE/EMBS Oct.25-28, 21, Istanbul, TURKEY ROBOT ASSISTED STANDING-UP IN PERSONS WITH LOWER LIMB PROSTHESES 1, R. Kamnik 1, H. Burger 2, T. Bajd 1 1 Faculty of Electrical

More information

Vibrotactile Device for Optimizing Skin Response to Vibration Abstract Motivation

Vibrotactile Device for Optimizing Skin Response to Vibration Abstract Motivation Vibrotactile Device for Optimizing Skin Response to Vibration Kou, W. McGuire, J. Meyer, A. Wang, A. Department of Biomedical Engineering, University of Wisconsin-Madison Abstract It is important to understand

More information

Design of a Bionic Hand Using Non Invasive Interface

Design of a Bionic Hand Using Non Invasive Interface Design of a Bionic Hand Using Non Invasive Interface By Evan McNabb Electrical and Biomedical Engineering Design Project (4BI6) Department of Electrical and Computer Engineering McMaster University Hamilton,

More information

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 4 & 5 SEPTEMBER 2008, UNIVERSITAT POLITECNICA DE CATALUNYA, BARCELONA, SPAIN MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL

More information

DETC SURFACE ELECTROMYOGRAPHIC CONTROL OF A HUMANOID ROBOT

DETC SURFACE ELECTROMYOGRAPHIC CONTROL OF A HUMANOID ROBOT Proceedings of the ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference IDETC/CIE 2013 August 4-7, 2013, Portland, Oregon, USA DETC2013-13345

More information

Using Simulation to Design Control Strategies for Robotic No-Scar Surgery

Using Simulation to Design Control Strategies for Robotic No-Scar Surgery Using Simulation to Design Control Strategies for Robotic No-Scar Surgery Antonio DE DONNO 1, Florent NAGEOTTE, Philippe ZANNE, Laurent GOFFIN and Michel de MATHELIN LSIIT, University of Strasbourg/CNRS,

More information

Chapter 2 Introduction to Haptics 2.1 Definition of Haptics

Chapter 2 Introduction to Haptics 2.1 Definition of Haptics Chapter 2 Introduction to Haptics 2.1 Definition of Haptics The word haptic originates from the Greek verb hapto to touch and therefore refers to the ability to touch and manipulate objects. The haptic

More information

VOICE CONTROL BASED PROSTHETIC HUMAN ARM

VOICE CONTROL BASED PROSTHETIC HUMAN ARM VOICE CONTROL BASED PROSTHETIC HUMAN ARM Ujwal R 1, Rakshith Narun 2, Harshell Surana 3, Naga Surya S 4, Ch Preetham Dheeraj 5 1.2.3.4.5. Student, Department of Electronics and Communication Engineering,

More information

A Three-Dimensional Evaluation of Body Representation Change of Human Upper Limb Focused on Sense of Ownership and Sense of Agency

A Three-Dimensional Evaluation of Body Representation Change of Human Upper Limb Focused on Sense of Ownership and Sense of Agency A Three-Dimensional Evaluation of Body Representation Change of Human Upper Limb Focused on Sense of Ownership and Sense of Agency Shunsuke Hamasaki, Atsushi Yamashita and Hajime Asama Department of Precision

More information

Restoring the Human Touch

Restoring the Human Touch Restoring the Human Touch Prosthetics imbued with haptics give their wearers fine motor control and a sense of connection By Dustin J. Tyler PhotogRAPHy by MIKe McgRegor W earing a blindfold and noisecanceling

More information

3.0 Apparatus. 3.1 Excitation System

3.0 Apparatus. 3.1 Excitation System 3.0 Apparatus The individual hardware components required for the GVT (Ground Vibration Test) are broken into four categories: excitation system, test-structure system, measurement system, and data acquisition

More information

Independence of perceptual and sensorimotor predictions in the size weight illusion

Independence of perceptual and sensorimotor predictions in the size weight illusion Independence of perceptual and sensorimotor predictions in the size weight illusion J. Randall Flanagan and Michael A. Beltzner Department of Psychology, Queen s University, Kingston, Ontario, K7L 3N6,

More information

EMG Electrodes. Fig. 1. System for measuring an electromyogram.

EMG Electrodes. Fig. 1. System for measuring an electromyogram. 1270 LABORATORY PROJECT NO. 1 DESIGN OF A MYOGRAM CIRCUIT 1. INTRODUCTION 1.1. Electromyograms The gross muscle groups (e.g., biceps) in the human body are actually composed of a large number of parallel

More information

LUCS Haptic Hand I. Abstract. 1 Introduction. Magnus Johnsson. Dept. of Computer Science and Lund University Cognitive Science Lund University, Sweden

LUCS Haptic Hand I. Abstract. 1 Introduction. Magnus Johnsson. Dept. of Computer Science and Lund University Cognitive Science Lund University, Sweden Magnus Johnsson (25). LUCS Haptic Hand I. LUCS Minor, 8. LUCS Haptic Hand I Magnus Johnsson Dept. of Computer Science and Lund University Cognitive Science Lund University, Sweden Abstract This paper describes

More information

Virtual Grasping Using a Data Glove

Virtual Grasping Using a Data Glove Virtual Grasping Using a Data Glove By: Rachel Smith Supervised By: Dr. Kay Robbins 3/25/2005 University of Texas at San Antonio Motivation Navigation in 3D worlds is awkward using traditional mouse Direct

More information

Modeling and Experimental Studies of a Novel 6DOF Haptic Device

Modeling and Experimental Studies of a Novel 6DOF Haptic Device Proceedings of The Canadian Society for Mechanical Engineering Forum 2010 CSME FORUM 2010 June 7-9, 2010, Victoria, British Columbia, Canada Modeling and Experimental Studies of a Novel DOF Haptic Device

More information

Active Vibration Control in Ultrasonic Wire Bonding Improving Bondability on Demanding Surfaces

Active Vibration Control in Ultrasonic Wire Bonding Improving Bondability on Demanding Surfaces Active Vibration Control in Ultrasonic Wire Bonding Improving Bondability on Demanding Surfaces By Dr.-Ing. Michael Brökelmann, Hesse GmbH Ultrasonic wire bonding is an established technology for connecting

More information

Haptic Perception of Real and Virtual Curvature

Haptic Perception of Real and Virtual Curvature Haptic Perception of Real and Virtual Curvature Maarten W.A. Wijntjes 1 and Akihiro Sato 2 Astrid M.L. Kappers 1, and Vincent Hayward 2 1 Helmholtz Institute, Utrecht University, the Netherlands 2 Haptics

More information

The Effect of Frequency Shifting on Audio-Tactile Conversion for Enriching Musical Experience

The Effect of Frequency Shifting on Audio-Tactile Conversion for Enriching Musical Experience The Effect of Frequency Shifting on Audio-Tactile Conversion for Enriching Musical Experience Ryuta Okazaki 1,2, Hidenori Kuribayashi 3, Hiroyuki Kajimioto 1,4 1 The University of Electro-Communications,

More information

Design and Control of the BUAA Four-Fingered Hand

Design and Control of the BUAA Four-Fingered Hand Proceedings of the 2001 IEEE International Conference on Robotics & Automation Seoul, Korea May 21-26, 2001 Design and Control of the BUAA Four-Fingered Hand Y. Zhang, Z. Han, H. Zhang, X. Shang, T. Wang,

More information

Rectilinear System. Introduction. Hardware

Rectilinear System. Introduction. Hardware Rectilinear System Introduction This lab studies the dynamic behavior of a system of translational mass, spring and damper components. The system properties will be determined first making use of basic

More information

Measuring Myoelectric Potential Patterns Based on Two-Dimensional Signal Transmission Technology

Measuring Myoelectric Potential Patterns Based on Two-Dimensional Signal Transmission Technology SICE-ICASE International Joint Conference 2006 Oct. 18-21, 2006 in Bexco, Busan, Korea Measuring Myoelectric Potential Patterns Based on Two-Dimensional Signal Transmission Technology Yasutoshi Makino

More information

Haptic Feedback Improves Manual Excitation of a Sprung Mass

Haptic Feedback Improves Manual Excitation of a Sprung Mass Haptic Feedback Improves Manual Excitation of a Sprung Mass Felix Huang R. Brent Gillespie Art Kuo Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 489 fhuang@umich.edu; brentg@umich.edu;

More information

Touch & Haptics. Touch & High Information Transfer Rate. Modern Haptics. Human. Haptics

Touch & Haptics. Touch & High Information Transfer Rate. Modern Haptics. Human. Haptics Touch & Haptics Touch & High Information Transfer Rate Blind and deaf people have been using touch to substitute vision or hearing for a very long time, and successfully. OPTACON Hong Z Tan Purdue University

More information

Classification of Hand Gestures using Surface Electromyography Signals For Upper-Limb Amputees

Classification of Hand Gestures using Surface Electromyography Signals For Upper-Limb Amputees Classification of Hand Gestures using Surface Electromyography Signals For Upper-Limb Amputees Gregory Luppescu Stanford University Michael Lowney Stanford Univeristy Raj Shah Stanford University I. ITRODUCTIO

More information

Lecture IV. Sensory processing during active versus passive movements

Lecture IV. Sensory processing during active versus passive movements Lecture IV Sensory processing during active versus passive movements The ability to distinguish sensory inputs that are a consequence of our own actions (reafference) from those that result from changes

More information

Effect of Vibrotactile Feedback on Robotic Object Manipulation

Effect of Vibrotactile Feedback on Robotic Object Manipulation The Fourth IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics Roma, Italy. June 24-27, 2012 Effect of Vibrotactile Feedback on Robotic Object Manipulation Qi An, Hajime Asama,

More information

Comparison of Human Haptic Size Discrimination Performance in Simulated Environments with Varying Levels of Force and Stiffness

Comparison of Human Haptic Size Discrimination Performance in Simulated Environments with Varying Levels of Force and Stiffness Comparison of Human Haptic Size Discrimination Performance in Simulated Environments with Varying Levels of Force and Stiffness Gina Upperman, Atsushi Suzuki, and Marcia O Malley Mechanical Engineering

More information