WEBEYETRACK: Scalable Eye-Tracking for the Browser via On-Device Few-Shot Personalization

#STEM #computer #education #stmu
Share

Abstract: 
With advancements in AI, new gaze estimation methods are exceeding state-of-the-art (SOTA) benchmarks, but their real-world application reveals a gap with commercial eye-tracking
solutions. Factors like model size, inference time, and privacy often go unaddressed. Meanwhile, webcam-based eye-tracking methods lack sufficient accuracy, in particular due to head movement. To tackle these issues, we introduce WebEyeTrack, a framework that integrates lightweight SOTA gaze estimation models directly in the browser. It incorporates model-based head pose estimation and on-device few-shot learning with as few as nine calibration samples (k ≤ 9). WebEyeTrack adapts to new users, achieving SOTA performance with an error margin of 2.32 cm on GazeCapture and real-time inference speeds of 2.4 milliseconds on an iPhone 14. Our open-source code is available at https://github.com/RedForestAi/WebEyeTrack
 
Bio: Dr. Yike Zhang is a computer scientist with a research focus on LLMComputer Vision, 6D Pose Estimation, and surgical navigation systems. She recently completed her Ph.D. in Computer Science at Vanderbilt University, where she developed a deep-learning-based navigation system for image-guided cochlear implant surgery. Her work bridges machine learning and medical imaging processing, aiming to improve surgical accuracy, safety, and future clinical translation with real-time image analysis and intraoperative navigation tools. You may find more information about her at https://yikezhang.me/.


  Date and Time

  Location

  Hosts

  Registration



  • Add_To_Calendar_icon Add Event to Calendar
  • One Camino Santa Maria
  • St. Mary's University of San Antonio
  • San Antonio, Texas
  • United States 78228
  • Building: Blank Sheppard Innovation Center (next to building #22 in the map)
  • Room Number: BSIC 203 - Data Science and Machine Learning Lab
  • Click here for Map

  • Contact Event Hosts
  • Starts 08 September 2025 05:00 AM UTC
  • Ends 20 October 2025 11:55 PM UTC
  • No Admission Charge