Hi. My name is Jaeyeon [JAY-awn] and I am a Ph.D. candidate in the School of Computing, KAIST.
As a Human-Computer Interaction (HCI) researcher, I have been exploring human haptic perception on various types of computers, including wearable, hand-held, and on-skin interfaces. In my research, I create novel physical user interfaces that enable efficient and natural interactions based on the findings from empirical experiments on human perception to enrich the intersection of HCI and Haptics.
Last summer, I did a research internship at Microsoft Research with Mike Sinclair, Mar Gonzalez-Franco, Eyal Ofek, Christian Holz, and Ken Hinckley. Our paper on a VR controller for in-hand interaction was presented at CHI 2019. Before the internship, I was a visiting student at the HCI Lab (aka the 'iSkin Lab') at Saarland University led by proferssor Jürgen Steimle. Our paper on the human tactile perception with on-skin overlays also was presented at CHI 2019 and received Honorable Mention Award.

I am a recipient of NAVER Ph.D. Fellowship. I have M.S. in Electrical Engineering from KAIST and B.Eng. in Control Engineering from Kwangwoon University. Full list of publications is shown in the Project and Publication sections.

Recent News

Jun 22, 2019  Paper  PseudoBend has been conditionally accepted to UIST 2019 :)
May 9, 2019  CHI 2019  Like A Second Skin has been presented.
May 9, 2019  CHI 2019  TORC has been presented. Slides are available here.
May 6, 2019  CHI 2019  Mode Errors in Korean-English Keyboard has been presented.
May 5, 2019  Video  TORC video got >10k views!
May 2, 2019  Blog  TORC, my internship project at MSR, was featured in Microsoft Research Blog.
Mar 15, 2019  Award  Like A Second Skin receives Best Paper Honorable Mention Award at CHI 2019.
Jan 13, 2019  Special Recognition  for Outstanding Review at CHI 2019.

Honors and Awards

  • Best Paper Honorable Mention Award, CHI 2019
  • Special Recognition for Outstanding Review, CHI 2019
  • Outstanding Paper Award, ISSM 2017
  • DAAD GradUS Global Scholarship
  • ACM UIST 2017 Doctoral Symposium Travel Grant
  • ACM SCF 2017 Summer School Travel Grant
  • NAVER PhD Fellowship Award 2017
  • Google Travel Grant
  • Outstanding TA Award, School of Computing, KAIST
  • Outstanding TA Award, School of Electrical Engineering, KAIST
  • 1st Prize, Graduation Exhibition, School of Robotics, Kwangwoon Univ.
  • Full Scholarship (for 4 years), School of Robotics, Kwangwoon Univ.

Professional Activities

  • Program Committee MobileHCI'19 Late-Breaking Results, CHI'19 Late-breaking Work, TEI'17 Work-in-Progress, CHI'17 Interactivity Demo
  • Reviewer CHI'18-19, UIST'18-19, TEI'17-19, DIS'18, ISWC'17, IEEE VR'19
  • Organizing Committee ISS'19 Student Volunteer Chair
  • Student Volunteer CHI'15-16, UIST'15,18


Research Projects

PseudoBend (UIST'19, accepted)
We present a technique for haptic feedback that creates the illusion that a rigid device is being stretched, bent, or twisted. The method uses a single 6-DOF force sensor and a vibrotactile actuator to render grain vibrations to simulate the vibrations produced during object deformation based on the changes in force or torque exerted on a device.

TORC (@ Microsoft Research, CHI'19)
Recent hand-held controllers have explored a variety of haptic feedback sensations for users in virtual reality by producing both kinesthetic and cutaneous feedback from virtual objects. These controllers are grounded to the user's hand and can only manipulate objects through arm and wrist motions, not using the dexterity of their fingers as they would in real life.

Like a Second Skin (@ Saarland HCI Lab, Honorable Mention at CHI'19)
The emerging class of epidermal devices opens up new opportunities for skin-based sensing, computing, and interaction. Future design of these devices requires an understanding of how skin-worn devices affect the natural tactile perception.

Mode Errors in Korean-English Dual-language Keyboard (CHI'19)
In countries where languages with non-Latin characters are prevalent, people use a keyboard with two language modes namely, the native language and English, and often experience mode errors. To diagnose the mode error problem, we conducted a field study and observed that 78% of the mode errors occurred immediately after application switching.

Square Watch Interaction (IJHCS, 2018)
Smartwatch has a limited input vocabulary because of its small touchscreen. Using touch sensitive edge as an input is one of the promising solutions. We explored interaction techniques that use the possible combinations of touch sensitive edges and the touchscreen.

Touch Branch (Lumi Land (2017); Outstanding Paper Award at ISSM'17; DIS'18)
Interpersonal touch, one of the most primitive social languages, is an excellent design element frequently utilized in interaction design. We built an interactive system that can sense simple touch and interpersonal touches. We observed the interpersonal touches and discussed the effect of social relationship and the spatial distance. This research project was a part of an interactive installation project,Lumi Land (2017), at National Science Museum in Korea.

Multimodal Watch-back Tactile Display (CHI'18)
We proposed the idea of layering two disjoint tactile sensations (wind and vibration) together to expand the information capacity of watch-back tactile display. We presented interaction scenarios and the pattern recognition experiment results of multimodal tactile display.

Non-contact Wearable Tactile Display (UIST'16)
Traditional wearable tactile displays transfer tactile stimulations through a firm contact between the stimulator and the skin. We conjecture that a firm contact may not be always possible and acceptable. We explored the concept of a non-contact wearable tactile display using an airflow, which can transfer information without a firm contact.

Watch-back Tactile Display (CHI'15)
A watch-back tactile display (WBTD) is expected to be a viable supplement to the user interface limitations of a smartwatch. However, its design requires that many design parameters such as tactor types and stimulus patterns be determined. We conducted a series of experiments to explore a best design of a WBTD consisting of 3×3 tactors and presented the results.


Referred Publications in Top Venues (7xCHI/UIST, 1xDIS, 1xIJHCS)

  1. PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations
    Seongkook Heo, Jaeyeon Lee, Daniel Wigdor. UIST 2019 (accepted).
  2. TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction
    Jaeyeon Lee, Mike Sinclair, Mar Gonzalez-Franco, Eyal Ofek, Christian Holz. CHI 2019.
    [MSR blog post] [acm dl] [slides]
  3. Diagnosing and Coping with Mode Errors in Korean-English Dual-language Keyboard
    Sangyoon Lee, Jaeyeon Lee, Geehyuk Lee. CHI 2019.
    [project page] [acm dl]
  4. Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception
    Aditya Shekhar Nittala, Klaus Kruttwig, Jaeyeon Lee, Roland Bennewitz, Eduard Arzt, Jürgen Steimle. CHI 2019. Best Paper Honorable Mention Award
    [pre-print] [project page] [acm dl]
  5. TouchBranch: Understanding Interpersonal Touches in Interactive Installation
    Seungki Kim, Jiwoo Hong, Jaeyeon Lee, Hyunsook Choi, Geehyuk Lee, and Woohun Lee. DIS 2018.
    [gif] [acm dl]
  6. Exploring Multimodal Watch-back Tactile Display using Wind and Vibration
    Youngbo Shim, Jaeyeon Lee, and Geehyuk Lee. CHI 2018.
    [video preview] [acm dl]
  7. Evaluation of Edge-based Interaction on a Square Smartwatch
    Sunggeun Ahn, Jaeyeon Lee, Keunwoo Park, and Geehyuk Lee. IJHCS 109 (2018): 68-78.
    [paper link]
  8. Designing a Non-contact Wearable Tactile Display Using Airflows
    Jaeyeon Lee and Geehyuk Lee. UIST 2016.
    [video figure] [acm dl] [slides]
  9. Investigating the Information Transfer Efficiency of a 3×3 Watch-back Tactile Display
    Jaeyeon Lee, Jaehyun Han, and Geehyuk Lee. CHI 2015.
    [video figure] [acm dl] [slides]

Referred Publications in Other Venues

  1. Developing and Understanding UX of the Interactive Installation with Interpersonal Touch Technology
    Seungki Kim, Jiwoo Hong, Jaeyeon Lee, Geehyuk Lee, Woohun Lee, and Hyunsook Choi. ISSM 2017. Outstanding Paper Award
  2. Defying Gravity: A Novel Method of Converting Screen Orientation
    Jaeyeon Lee and Da Young Ju. IJSH 7.5 (2013).
  3. Implementation of Four Port Birdcage Coil in 3 Tesla MRI System
    Jaeyeon Lee, ChangHeun Oh, and HyunWook Park. ITC-CSCC 2012.

Extended Abstracts: Doctoral Symposium and Demonstrations

  1. Exploring Multimodal Watch-back Tactile Display using Wind and Vibration
    Youngbo Shim, Jaeyeon Lee, and Geehyuk Lee. CHI 2018 EA, Demonstration.
  2. Wind Tactor: An Airflow-based Wearable Tactile Display
    Jaeyeon Lee. UIST 2017 Adjunct, Doctoral Symposium.


Master's Thesis

Last update: July 1st, 2019