Hi. My name is Jaeyeon [JAY-awn] and I am an Assistant Professor in the department of Computer Science and Engineering at UNIST. The focus of my research is to comprehensively characterize user interfaces and interactions, to gain a thorough understanding of the critical elements of these interfaces and their relative strengths and weaknesses. Through quantitative and qualitative user studies, I aim to gain insight into the user experience associated with these novel interfaces and identify areas that require improvement to optimize their performance.
Previously, I completed my Ph.D. in Computer Science at KAIST in 2020, advised by Prof. Geehyuk Lee. I was also a research intern at Microsoft Research (with Mike Sinclair, Mar Gonzalez-Franco, Eyal Ofek, and Christian Holz) and Saarland University (with Prof. Jürgen Steimle). You can find the full list of my publications in my google scholar profile and in my CV (PDF).
Research opportunities? please read before contacting me :)
Thank you for your interest in working with me! Unfortunately, I am not actively recruiting student researchers at this point. Please read this form carefully and submit an application if you are still interested.
News
| Jun 22-24 | UIST 2023 PC Meeting |
| Jun 2-7 | Travel Invited talk at the Universtiy of Virginia |
| May 18 | HFES 2023 A paper on programmable softness display has been accepted to HFES. |
| May 5 | CHI 2024 I'm happy to join the CHI 2024 Program Committee. |
| Apr 22-29 | Travel Attended CHI 2023 as an Interactivity co-chair and an author. Two of my students, Buyoung and Jiseong, joined the travel to Hamburg. |
| Mar 3 | UIST 2023 I joined the UIST 2023 Program Committee. |
| Spring'23 | I'll be teaching CSE333 Introduction to HCI and CSE523 Advanced HCI :) |
| Feb 23 | Korea Haptics Conference I joined the organizing committee as the poster chair. |
| Feb 21-23 | Travel Attended Korea Haptics Society PI Symposium as a presenter. |
| Feb 1-3 | Travel Attended HCI Korea 2023 as a co-organizer and the chair of the SIGCHI Korea Winter Event (Info). Three of my students, Seonggyu, Sung Woo, and Buyoung, joined the travel. |
| Jan 14 | CHI 2023 Two papers have been conditionally accepted to CHI 2023. |
| Jan 11-13 | CHI 2023 PC Meeting |
| Jan 4 | CHI 2024 I'm happy to continue working as a CHI 2024 Interactivity co-chair. |
| Dec 28 | Jiseong started research internship with Prof. Aditya S. Nittala. You will be missed! | Dec 2 | Talk Invited to HCI@KAIST (Scheduled on Dec 16th). | Nov 11 | Korea Haptics Society Attended the 1st plenary meeting of Korea Haptics Society. I'm happy to join the steering committee :) |
| Nov 7 | CHI 2023 All three submissions were invited to R&R. |
| Sep 20 | CHI 2023 Joined the CHI 2023 Program Committee. | Sep 17 | Congrats! Buyoung and Jiseong made their first, first-authored submission to CHI :) |
| Sep 7 | SIGCHI Korea I'll be organizing the SIGCHI Korea Winter Event at HCI Korea 2023. | Jul 19 | Talk Invited to KAIST GSCT Colloquium (Scheduled on Oct 11th). | Jul 15 | Talk Invited to DGIST (Scheduled on Aug 19th). |
| Jun 29 - Jul 1 | Travel KCC 2022 as a workshop presenter. Three of my students, Buyoung, Jiseong, and Ga Yun, joined the travel. | May 18 | Panel Invited as a panelist for the SIGCHI Korea Summer Event (Scheduled on July 8th). | May 11 | Talk Invited to a KCC 2022 Workshop (Scheduled on Jun 30th). |
| Mar 16 | CHI 2023 I will serve as an CHI 2023 Interactivity (Demo) Co-Chair. |
| Mar 16 | SIGCHI Korea I'm happy to join the ACM SIGCHI Local Chapter Steering Committee. | Mar 7 | Talk Invited to Kyung Hee University CS Colloquium (Scheduled on Jun 10th). | Feb 18 | Talk Invited to Yonsei University CS Seminar (Scheduled on May 25th). | Jan 21 | Talk Invited to POSTECH CSE/GSAI Seminar (Scheduled on Apr 20th). |
| Dec 15 | Grant Our research proposal (Co-PI: Prof. Kyungdon Joo) was selected as one of four UNIST A.I. Incubation Project. | Nov 29 | Talk at KwangWoon University. | Oct 29 | Talk at UNIST Design Seminar. | Oct 26 | Talk at KAIST Lovelace Day. | Aug 31 | Joined UNIST Computer Science and Engineering as a new faculty. | Jul 7 | WHC 2021 Presented a poster on MRE-based Haptic I/O device. |
| Feb 22-24 | AH 2021 I served as a Poster Co-Chair. |
| Oct 30 | Talk at Korean Institute of Information Scientist & Engineers - Women Workshop. | Oct 16 | Talk to HCI Engineering & Design Lab at Texas A&M University. | Sep 4 | Award Selected as EECS Rising Stars in Korea. | Aug 20 | Talk Gave a tutorial talk on "Reading Papers to Write CHI Papers" at HCI Korea 2020. | Aug 20 | HCI Korea Co-organized HCI Korea Workshop on How to Write a CHI paper? | Apr 17 | Defended my dissertation on "Non-Contact Wearable Tactile Display using Airflows". |
| Nov 10-13 | ISS 2019 I served as a Student Volunteer Co-Chair. | Oct 22 | UIST 2019 PseudoBend has been presented. Implementation details are here. |
| Oct 1-4 | MobileHCI 2019 I served as an associate chair for Late-breaking Results :) | Sep 25 | Talk to Professor Pedro Lopes's Lab at University of Chicago. |
| Jul 24 | Paper PseudoBend has been accepted to UIST 2019 :) |
| May 9 | CHI 2019 Like A Second Skin has been presented. |
| May 9 | CHI 2019 TORC has been presented. Slides are available here. |
| May 6 | CHI 2019 Mode Errors in Korean-English Keyboard has been presented. |
| May 4-9 | CHI 2019 I served as an associate chair for Late-Breaking Work. |
| May 5 | Video TORC video got >10k views! |
| May 2 | Blog TORC, my internship project at MSR, was featured in Microsoft Research Blog. |
| Mar 15 | Award Like A Second Skin receives Best Paper Honorable Mention Award at CHI 2019. |
| Jan 13 | Special Recognition for Outstanding Review at CHI 2019. |
| Dec 11 | Papers All of three submissions have been accepted to CHI 2019. |
| Jun - Aug | Research Intern at Microsoft Research in Redmond, WA. |
| Jun 12 | DIS 2018 Touch Branch was presented. |
| Apr 25 | CHI 2018 Multimodal Watch-back Tactile Display has been presented. |
| Dec 2017 - Apr 2018 | Visiting Student at Professor Jürgen Steimle's Lab at Saarland University, Germany. |
| Apr 9 | Talk to Professor Herbert Shea's Lab at EPFL, Switzerland. |
| Jan 1 | IJHCS Square Watch Interaction has been published on IJHCS. |
| Nov 10 | Paper Multimodal Tactile Display has been accepted to CHI 2018. |
| Nov 10 | Award Touch Branch won Outstanding Paper Award for ISSM 2017. |
| Aug 1 | Paper My paper got accepted to UIST 2017 Doctoral Symposium, one of my phd wishes :-) |
| Jul 27 | Thesis proposed. |
Honors and Awards
- Best Work-in-Progress Paper Finalists, WHC 2021
- EECS Rising Stars in Korea
- Best Paper Honorable Mention Award, CHI 2019
- Special Recognition for Outstanding Review, CHI 2019
- Outstanding Paper Award, ISSM 2017
- GradUS Global Scholarship
- UIST 2017 Doctoral Symposium
- SCF 2017 Summer School Travel Grant
- NAVER PhD Fellowship Award
- Google Travel Grant
- Outstanding TA Award, School of Computing, KAIST
- Outstanding TA Award, School of Electrical Engineering, KAIST
Teaching
- UNIST CSE333: Introduction to Human-Computer Interaction, Spring 2023
- UNIST CSE523: Advanced Human-Computer Interaction, Spring 2023
- UNIST UNI111: Introduction to CSE, Fall 2022
- UNIST CSE333: Introduction to Human-Computer Interaction, Spring 2022
- UNIST CSE469: Introduction to Robotics, Spring 2022
- UNIST CSE523: Advanced Human-Computer Interaction, Fall 2021
- UNIST UNI111: Introduction to CSE, Fall 2021
Academic Services
-
Steering Committee
- ACM SIGCHI Korea Local Chapter
- Korea Haptics Society
- ACM CHI'24 Interactivity Co-Chair
- Korea Haptics Society Conference Poster Chair
- ACM CHI'23 Interactivity Co-Chair
- ACM SIGCHI Korea Local Chapter Winter Event Organizer
- ACM AHs'21 Poster Co-Chair
- ACM SIGCHI Korea Local Chapter Workshop Mentorship Co-Chair
- ACM ISS'19 Student Volunteer Co-Chair
- ACM CHI'24 Papers
- ACM UIST'23 Papers
- ACM CHI'23 Papers
- ACM MobileHCI'19 Late-Breaking Results
- ACM CHI'19 Late-breaking Work
- ACM TEI'17 Work-in-Progress
- ACM CHI'17 Interactivity
Previous Affliations
- Ph.D. in Computer Science, KAIST
- Research Assistant @ HCI Lab, KAIST
- Research Intern @ Microsoft Research, Redmond, USA
- Visiting Student @ HCI Lab, Saarland University, Germany
- Research Assistant @ Medical Systems Lab, Yonsei University
- M.S. in Electrical Engineering from KAIST
- Research Assistant @ Image Computing Lab, KAIST
- B.Eng. in Control Engineering from Kwangwoon University
Research Interns
- Buyeong Mun (Nov. 2021 - Present)
- Jiseong Kim (Nov. 2021 - Present)
- Sunggyu Jang (Oct. 2022 - Present)
- Sungwoo Kang (Dec. 2022 - Present)
- Jungmin Park (Mar. 2023 - Present)
- Badraa BatUlzii (Mar. 2023 - Present)
Collaborators
- Prof. Kyungdon Joo, UNIST AIGS
- Prof. Aditya Shekhar Nittala, University of Calgary
- Prof. Seongkook Heo, University of Virginia
- Prof. Hyunyoung Kim, University of Birmingham
- Prof. Sunjun Kim, DGIST
Previous Research Projects
PseudoBend (UIST'19)
We present a technique for haptic feedback that creates the illusion that a rigid device is being stretched, bent, or twisted. The method uses a single 6-DOF force sensor and a vibrotactile actuator to render grain vibrations to simulate the vibrations produced during object deformation based on the changes in force or torque exerted on a device.
We present a technique for haptic feedback that creates the illusion that a rigid device is being stretched, bent, or twisted. The method uses a single 6-DOF force sensor and a vibrotactile actuator to render grain vibrations to simulate the vibrations produced during object deformation based on the changes in force or torque exerted on a device.
TORC (@ Microsoft Research, CHI'19)
Recent hand-held controllers have explored a variety of haptic feedback sensations for users in virtual reality by producing both kinesthetic and cutaneous feedback from virtual objects. These controllers are grounded to the user's hand and can only manipulate objects through arm and wrist motions, not using the dexterity of their fingers as they would in real life.
Recent hand-held controllers have explored a variety of haptic feedback sensations for users in virtual reality by producing both kinesthetic and cutaneous feedback from virtual objects. These controllers are grounded to the user's hand and can only manipulate objects through arm and wrist motions, not using the dexterity of their fingers as they would in real life.
Like a Second Skin (@ Saarland HCI Lab, Honorable Mention at CHI'19)
The emerging class of epidermal devices opens up new opportunities for skin-based sensing, computing, and interaction. Future design of these devices requires an understanding of how skin-worn devices affect the natural tactile perception.
The emerging class of epidermal devices opens up new opportunities for skin-based sensing, computing, and interaction. Future design of these devices requires an understanding of how skin-worn devices affect the natural tactile perception.
Mode Errors in Korean-English Dual-language Keyboard (CHI'19)
In countries where languages with non-Latin characters are prevalent, people use a keyboard with two language modes namely, the native language and English, and often experience mode errors. To diagnose the mode error problem, we conducted a field study and observed that 78% of the mode errors occurred immediately after application switching.
In countries where languages with non-Latin characters are prevalent, people use a keyboard with two language modes namely, the native language and English, and often experience mode errors. To diagnose the mode error problem, we conducted a field study and observed that 78% of the mode errors occurred immediately after application switching.
Square Watch Interaction (IJHCS, 2018)
Smartwatch has a limited input vocabulary because of its small touchscreen. Using touch sensitive edge as an input is one of the promising solutions. We explored interaction techniques that use the possible combinations of touch sensitive edges and the touchscreen.
Smartwatch has a limited input vocabulary because of its small touchscreen. Using touch sensitive edge as an input is one of the promising solutions. We explored interaction techniques that use the possible combinations of touch sensitive edges and the touchscreen.
Touch Branch (Lumi Land (2017); Outstanding Paper Award at ISSM'17; DIS'18)
Interpersonal touch, one of the most primitive social languages, is an excellent design element frequently utilized in interaction design. We built an interactive system that can sense simple touch and interpersonal touches. We observed the interpersonal touches and discussed the effect of social relationship and the spatial distance. This research project was a part of an interactive installation project, Lumi Land (2017), at National Science Museum in Korea.
Interpersonal touch, one of the most primitive social languages, is an excellent design element frequently utilized in interaction design. We built an interactive system that can sense simple touch and interpersonal touches. We observed the interpersonal touches and discussed the effect of social relationship and the spatial distance. This research project was a part of an interactive installation project, Lumi Land (2017), at National Science Museum in Korea.
Multimodal Watch-back Tactile Display (CHI'18)
We proposed the idea of layering two disjoint tactile sensations (wind and vibration) together to expand the information capacity of watch-back tactile display. We presented interaction scenarios and the pattern recognition experiment results of multimodal tactile display.
We proposed the idea of layering two disjoint tactile sensations (wind and vibration) together to expand the information capacity of watch-back tactile display. We presented interaction scenarios and the pattern recognition experiment results of multimodal tactile display.
Non-contact Wearable Tactile Display (UIST'16)
Traditional wearable tactile displays transfer tactile stimulations through a firm contact between the stimulator and the skin. We conjecture that a firm contact may not be always possible and acceptable. We explored the concept of a non-contact wearable tactile display using an airflow, which can transfer information without a firm contact.
Traditional wearable tactile displays transfer tactile stimulations through a firm contact between the stimulator and the skin. We conjecture that a firm contact may not be always possible and acceptable. We explored the concept of a non-contact wearable tactile display using an airflow, which can transfer information without a firm contact.
Watch-back Tactile Display (CHI'15)
A watch-back tactile display (WBTD) is expected to be a viable supplement to the user interface limitations of a smartwatch. However, its design requires that many design parameters such as tactor types and stimulus patterns be determined. We conducted a series of experiments to explore a best design of a WBTD consisting of 3×3 tactors and presented the results.
A watch-back tactile display (WBTD) is expected to be a viable supplement to the user interface limitations of a smartwatch. However, its design requires that many design parameters such as tactor types and stimulus patterns be determined. We conducted a series of experiments to explore a best design of a WBTD consisting of 3×3 tactors and presented the results.
Publications
- Augmenting On-Body Touch Input with Tactile Feedback Through Fingernail Haptics Peter Khoa Duc Tran, Purna Valli Anusha Gadepalli, Jaeyeon Lee, Aditya Shekhar Nittala. CHI 2023. [acm dl]
- Design and Field Trial of Tunee in Shared Houses: Exploring Experiences of Sharing Individuals’ Current Noise-level Preferences with Housemates Nari Kim, Sangsu Jang, Hansol Kim, Jaeyeon Lee, Young-Woo Park. CHI 2023. [acm dl]
- PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations Seongkook Heo, Jaeyeon Lee, Daniel Wigdor. UIST 2019. [git repository] [acm dl]
- TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction Jaeyeon Lee, Mike Sinclair, Mar Gonzalez-Franco, Eyal Ofek, Christian Holz. CHI 2019. [MSR blog post] [acm dl] [slides]
- Diagnosing and Coping with Mode Errors in Korean-English Dual-language Keyboard Sangyoon Lee, Jaeyeon Lee, Geehyuk Lee. CHI 2019. [project page] [acm dl]
- Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception Aditya Shekhar Nittala, Klaus Kruttwig, Jaeyeon Lee, Roland Bennewitz, Eduard Arzt, Jürgen Steimle. CHI 2019. Best Paper Honorable Mention Award [pre-print] [project page] [acm dl]
- TouchBranch: Understanding Interpersonal Touches in Interactive Installation Seungki Kim, Jiwoo Hong, Jaeyeon Lee, Hyunsook Choi, Geehyuk Lee, and Woohun Lee. DIS 2018. [gif] [acm dl]
- Exploring Multimodal Watch-back Tactile Display using Wind and Vibration Youngbo Shim, Jaeyeon Lee, and Geehyuk Lee. CHI 2018. [video preview] [acm dl]
- Evaluation of Edge-based Interaction on a Square Smartwatch Sunggeun Ahn, Jaeyeon Lee, Keunwoo Park, and Geehyuk Lee. IJHCS 109 (2018): 68-78. [paper link]
- Developing and Understanding UX of the Interactive Installation with Interpersonal Touch Technology Seungki Kim, Jiwoo Hong, Jaeyeon Lee, Geehyuk Lee, Woohun Lee, and Hyunsook Choi. ISSM 2017. Outstanding Paper Award
- Designing a Non-contact Wearable Tactile Display Using Airflows Jaeyeon Lee and Geehyuk Lee. UIST 2016. [video figure] [acm dl] [slides]
- Investigating the Information Transfer Efficiency of a 3×3 Watch-back Tactile Display Jaeyeon Lee, Jaehyun Han, and Geehyuk Lee. CHI 2015. [video figure] [acm dl] [slides]
- Defying Gravity: A Novel Method of Converting Screen Orientation Jaeyeon Lee and Da Young Ju. IJSH 7.5 (2013).
- Implementation of Four Port Birdcage Coil in 3 Tesla MRI System Jaeyeon Lee, ChangHeun Oh, and HyunWook Park. ITC-CSCC 2012.
Peer-reviewed Conference and Journal Papers
- A Magnetorheological Elastomer Device for Programmable Actuation and Sensing of Soft Haptic Experiences Bingxu Li*, Jaeyeon Lee*, Gregory J. Gerling. WHC 2021, Work-in-Progress.
- PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations Seongkook Heo, Jaeyeon Lee, Daniel Wigdor. UIST 2019 Adjunct, Demonstration.
- Demonstration of TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction Jaeyeon Lee, Mike Sinclair, Mar Gonzalez-Franco, Eyal Ofek, Christian Holz. UIST 2019 Adjunct, Demonstration.
- Exploring Multimodal Watch-back Tactile Display using Wind and Vibration Youngbo Shim, Jaeyeon Lee, and Geehyuk Lee. CHI 2018 EA, Demonstration.
- Wind Tactor: An Airflow-based Wearable Tactile Display Jaeyeon Lee. UIST 2017 Adjunct, Doctoral Symposium.
Extended Abstracts, Posters, and Work-in-Progress
Theses
- Non-Contact Wearable Tactile Display using Airflows Advisor: Geehyuk Lee, Ph.D., School of Computing, KAIST.
- Implementation of Four Port Birdcage Coil in 3 Tesla MRI System Advisor: HyunWook Park, Ph.D., School of Electrical Engineering, KAIST.
Patents Pending and Issued
- Computer device for providing eye-based tactile interface and method of the same KR Patent Application 10-2022-0018698-02-14.
- Presentation of continuous 6-dof parameters using wearable tactile display with multiple skin stretch tactors KR Patent 10-2339031-12-09.
- Smart-toggle for auto recovering from Korean-English mode errors KR Patent 10-2197227-12-24.
- Virtual Reality Controller US Patent 10-838486-11-17.
- Method of Outputting Tactile Pattern and Apparatuses Performing the same KR Patent 10-2095639-03-25.
- Non-contact Wearable Tactile Display Device Using Airflows and Method of Operating the same KR Patent 10-1879982, 2018-07-12.
- Transparent Display Device for Display Different Images on Two Sides KR Patent 10-1718241, 2017-03-14.
Last update: May 2023