Rahul Islam

Research

Machine learning on human signals — face, eye, gait, voice.

Mental health sensing

Depression, mood and affect read from the phone you already carry.

  1. [J.6] Summary of the BeyondSmile Challenge on Detecting Depression Through Facial Behavior and Head Gestures

    Rahul Islam, Tongze Zhang, Anlan Dong, Melik Ozolcer, Christina Garcia, Milyun Ni'ma Shoumi, Prerna Jamloki, Sozo Inoue, Sang Won Bae

    International Journal of Activity and Behavior Computing (IJABC 2025)

    Paper DOI

  2. [C.5] MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings

    Rahul Islam, Tongze Zhang, Sang Won Bae

    IEEE International Conference on Ubiquitous Intelligence and Computing (UIC 2024)

    DOI

  3. [C.3] MoodPupilar: Predicting Mood Through Smartphone Detected Pupillary Responses in Naturalistic Settings

    Rahul Islam, Tongze Zhang, Priyanshu Singh Bisen, Sang Won Bae

    IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN 2024)

    DOI

  4. [J.5] FacePsy: An Open-Source Affective Mobile Sensing System - Analyzing Facial Behavior and Head Gesture for Depression Detection in Naturalistic Settings

    Rahul Islam, Sang Won Bae

    Proceedings of the ACM on Human-Computer Interaction (MobileHCI '24)

    DOI Code

  5. [C.2] PupilSense: Detection of Depressive Episodes Through Pupillary Response in the Wild

    Rahul Islam, Sang Won Bae

    Activity and Behavior Computing 2024

    DOI Code

  6. [W.1] Revolutionizing Mental Health Support: An Innovative Affective Mobile Framework for Dynamic, Proactive, and Context-Adaptive Conversational Agents

    Rahul Islam, Sang Won Bae

    ACM IMWUT/Ubicomp 2023, GenAI4PC Symposium

    DOI

  7. [Po.3] Towards Designing Empathetic and Trustworthy AI Chatbots: an Exploratory Study

    Melik Ozolcer, Rahul Islam, Abdullah Mohammed, Tongze Zhang, Sang Won Bae, Ting Liao

    CESUN 2023

    Paper

Substance use sensing

Alcohol and cannabis intoxication from passive sensor data, with just-in-time interventions.

  1. [J.7] Enhancing Interpretable, Transparent, and Unobtrusive Detection of Acute Marijuana Intoxication in Natural Environments: Harnessing Smart Devices and Explainable AI to Empower Just-In-Time Adaptive Interventions: Longitudinal Observational Study

    Sang Won Bae, Tammy Chung, Tongze Zhang, Anind K Dey, Rahul Islam

    JMIR AI 2025

    DOI

  2. [Po.4] Moving Toward Personalized Behavioral Medicine: Integrating Smartphone-based GPS Data into a Digital Alcohol Intervention

    Tammy Chung, Sang Won Bae, Tongze Zhang, Melik Ozolcer, Rahul Islam, Anind Dey, Yiyi Ren, Brian Suffoletto, Aidan GC Wright, Trishnee Bhurosy

    Society of Behavioral Medicine/Annals of Behavioral Medicine 2024

  3. [J.4] Leveraging Mobile Phone Sensors, Machine Learning, and Explainable Artificial Intelligence to Predict Imminent Same-Day Binge-drinking Events to Support Just-in-time Adaptive Interventions: Algorithm Development and Validation Study

    Sang Won Bae, Brian Suffoletto, Tongze Zhang, Tammy Chung, Melik Ozolcer, Rahul Islam, Anind K Dey

    JMIR Formative Research 2023

    DOI

  4. [J.3] Mobile phone sensor-based detection of subjective cannabis intoxication in young adults: A feasibility study in real-world settings

    Sang Won Bae, Tammy Chung, Rahul Islam, Brian Suffoletto, Jiameng Du, Serim Jang, Yuuki Nishiyama, Raghu Mulukutla, Anind K Dey

    Drug and Alcohol Dependence 2021

    DOI

Clinical movement

Gait and pose analysis for cerebral palsy and cognitive decline, run on a phone.

  1. [J.9] AIGaitor: Privacy-preserving and cloud-free motion analysis for everyone, using edge computingTo appear

    Lauhitya Reddy, Rahul Islam, Trisha M. Kesar, Hyeokhyen Kwon

    PLOS ONE 2026 (Under Review)

  2. [J.8] Wearable Sensing for Quantifying Cognitive and Balance Functions in Naturalistic Movements of Older Adults with Mild Cognitive Impairment in Therapeutic EnvironmentsTo appear

    Rahul Islam*, Jangwon Lim*, Dharini Raghavan, Bolaji Omofojoye, Amy D. Rodriguez, Yashar Kiarashi, Rachel Hershenberg, Gari D. Clifford, Hyeokhyen Kwon

    PLOS Digital Health 2026 (* = Equal Contribution, Under Review)

  3. [C.7] Clinically Accessible 2D Video Analysis Accurately Captures 3D Knee Gait KinematicsTo appear

    Jeremy Bauer, Susan Sienko, Lauhitya Reddy, Vedant Kulkarni, Seth Donahue, Ross Chafetz, Anita Bagley, Joseph Krzak, Rahul Islam, Hyeokhyen Kwon

    Annual Meeting of the American Academy for Cerebral Palsy and Developmental Medicine (AACPDM 2026, Under Review)

  4. [C.6] Evaluating the Feasibility of Deploying Quantized Human Pose Estimation on Smartphone for Gait Analysis for Children with Cerebral Palsy

    Rahul Islam, Seth Donahue, Jeremy Bauer, Susan Sienko, Anita Bagley, Joseph Krzak, Maura Eveld, Karen Kruger, Ross Chafetz, Vedant Kulkarni, Hyeokhyen Kwon

    Annual Meeting of the Gait & Clinical Movement Analysis Society (GCMAS 2026)

Eye & biometrics

Iris, pupil and gaze — for identity, and for what the eye gives away.

  1. [J.2] EyeSpyVR: Interactive Eye Sensing Using Off-the-Shelf, Smartphone-Based VR Headsets

    Karan Ahuja, Rahul Islam, Varun Parashar, Kuntal Dey, Chris Harrison, Mayank Goel

    ACM IMWUT/Ubicomp 2018

    DOI

  2. [J.1] Convolutional neural networks for ocular smartphone-based biometrics

    Karan Ahuja, Rahul Islam, Ferdous Barbhuiya, Kuntal Dey

    Pattern Recognition Letters, Volume 91. 2017

    DOI

  3. [C.1] A Preliminary Study of CNNs for Iris and Periocular Verification in the View Spectrum

    Karan Ahuja, Rahul Islam, Ferdous Barbhuiya, Kuntal Dey

    ICPR 2016

    DOI

HCI & systems

Interaction techniques and the tooling underneath — including the dubbing work behind AstraClips.

  1. [C.8] XDubber: Supporting Non-Native Creators with Explainable Cross-Lingual Video DubbingTo appear

    Naoto Nishida, Rahul Islam, Karan Ahuja

    ACM UIST 2026 (Under Review)

  2. [C.4] MotionTrace: IMU-based Trajectory Prediction for Smartphone AR Interactions

    Rahul Islam, Vasco Miguel Liang Xu, Karan Ahuja

    IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN 2024)

    DOI

  3. [Po.2] MicroFlow: Advancing Affective States Detection in Learning Through Micro-Expressions

    Rahul Islam, Sang Won Bae

    CESUN 2023

    Paper

  4. [Po.1] EyamKayo: Interactive Gaze and Facial Expression Captcha

    Utkarsh Dwivedi, Karan Ahuja, Rahul Islam, Ferdous Barbhuiya, Seema Nagar, Kuntal Dey

    ACM IUI 2017

    DOI

  5. [A.1] SenTion: A framework for Sensing Facial Expressions

    Rahul Islam, Karan Ahuja, Sandip Karmakar, Ferdous Barbhuiya

    arXiv preprint arXiv:1608.04489

    DOI