PhD student in technical Human-Computer Interaction (Input Detection & Text Entry)

The Sensing, Interaction & Perception Lab is looking for a PhD student in Human-Computer Interaction. The project will focus on input detection from sensor signals (e.g., IMU, EMG, EOG) and interaction in Mixed Reality. A good part of our input modeling will target typing and text entry decoding using character-level and word-level language models.

To learn more about our research, check out our website.

Our group's prior research that is related to this position:

• TapType: Ten-finger text entry on everyday surfaces via Bayesian inference
• TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision
• HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction Using Inertial Sensing

The intersection of sensor-driven input detection and advanced interaction paradigms in Mixed Reality (MR) presents exciting research challenges and opportunities. This PhD project is positioned at the forefront of Human-Computer Interaction (HCI), focusing on leveraging sensor signals such as Inertial Measurement Units (IMU), Electromyography (EMG), and Electrooculography (EOG) for innovative input modeling.

The primary goal is to develop robust methods for detecting, decoding, and interpreting user input in MR environments, with a particular emphasis on typing and text entry. Utilizing character-level and word-level language models, the research will explore how these techniques can enhance user experiences in MR by improving text entry efficiency, accuracy, and context-awareness.

This PhD offers an opportunity to contribute to cutting-edge advancements in HCI by addressing open questions such as:

• How can sensor data be transformed into intuitive and reliable input methods for text entry in MR?
• What novel algorithms or techniques can enhance sensor-driven interaction for various user scenarios?
• How can uncertainty in sensor signals be managed to provide robust and seamless input experiences?

Through this work, you will collaborate with a multidisciplinary team to push the boundaries of input detection and interaction in Mixed Reality.

• Conduct research on sensor-based input detection and interaction in Mixed Reality.
• Develop algorithms for text entry using character-level and word-level language models.
• Design and implement systems leveraging IMU, EMG, and EOG sensor data.
• Evaluate the usability and performance of input detection methods.
• Publish research findings in top-tier HCI and related academic venues.
• Collaborate with a multidisciplinary team on innovative HCI projects.
• Supervise or mentor undergraduate or master’s students on related topics.
• Present research at international conferences and workshops.
• Contribute to lab activities and brainstorming sessions.
• Stay updated with advancements in HCI, machine learning, and sensor systems.

We are seeking a motivated and talented candidate with the following qualifications:

Required Skills and Qualifications

• Academic Background: A Master’s degree in Computer Science, Electrical Engineering, or a related field with a strong focus on HCI, machine learning, or sensor systems
• Technical Expertise: Proficiency in programming (e.g., Python, C++, or similar) and experience with signal processing, machine learning frameworks, or statistical modeling
• Research Orientation: Demonstrated ability to conduct research, as evidenced by thesis work, academic projects, or optionally prior publications
• Communication Skills: Excellent written and verbal communication skills in English for effective collaboration and dissemination of research findings

Suitable backgrounds

Your background should be in Computer Science, Human-Computer Interaction, Electrical Engineering, or Robotics. You should have

• Proven experience in signal processing and even detection or ML-based classification
• Familiarity with sensor modalities: IMU (accelerometers + gyroscopes), EMG (electromyography), or similar (EOG electrooculography, EEG, ...)
• Familiarity with text entry techniques and (small) language models: knowledge of basic natural language processing or text entry techniques
• Familiarity with interactive systems or interaction techniques
• Strong problem-solving and technical debugging skills
• Optional: experience with designing and conducting user experiments, human-centered design principles and usability testing
• Optional: experience in state estimation and filters

ETH requirements:

• written and spoken fluency in English
• PhD in Computer Science, Electrical Engineering, Robotics, or related

This position provides a unique opportunity to engage in high-impact research in a dynamic and supportive lab environment. If you are passionate about pushing the boundaries of Human-Computer Interaction, we encourage you to apply and join us in shaping the future of input detection and interaction in Mixed Reality.

We offer an exciting environment to study and work in.

For more information, check out:

• our projects in the Sensing, Interaction & Perception Lab
• the SIPLAB team
• Christian Holz (PI)

ETH has several internationally recognized research groups dedicated to human-computer interaction, prototyping, electrical engineering, robotics, signal processing, and machine learning. We collaborate with several of them as well as institutions and companies in Switzerland and abroad.