Prithwish Dan

pd337@cornell.edu

new-pfp.jpg

M.S. Student

Cornell University

I am entering the final year of my Computer Science M.S. at Cornell University, advised by Professor Sanjiban Choudhury and Professor Wei-Chiu Ma. After graduation in May 2026, I will be entering the job market for industry research roles.

I work on training robotic agents from human demonstrations in everyday environments. My research interests span learning from human videos, imitation learning (IL), reinforcement learning (RL), and sim-to-real as they serve as the scalable pathways towards learning general purpose robot skills.

Additionally, I am an incoming CVML Research Intern @ Apple, and have prior internship experience as a Software Engineering Intern @ MongoDB.

In my free time, I enjoy Chinese Yo-Yo’ing and dancing.

Link to CV.

News

May 2025 X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real was released as preprint! We learn robot actions from action-less human videos using an object-centric reward in simulation, generating synthetic data for real policies.
Jan 2025 One-Shot Imitation under Mismatched Execution was accepted to ICRA 2025! We enable one-shot imitation of human videos with mismatches in embodiment and execution.
May 2024 MOSAIC: A Modular System for Assistive and Interactive Cooking won best paper at VLMNM workshop and best poster at MoMa workshop at ICRA 2024! It was also accepted to CoRL 2024. We combine multiple foundation models to design a multi-robot collaborative cooking system.
Mar 2024 I received the Merrill Presidential Scholar award!
Jan 2024 InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions was accepted to ICRA 2024! We predict human intent conditioned on future robot actions to enable collaborative manipulation.
Dec 2023 I received the CRA Outstanding Undergraduate Researcher (Honorable Mention) for graduating Class of 2024!
Sep 2023 Excited to release the Collaborative Manipulation Dataset (CoMaD)! CoMaD captures over 6 hours of motion data from 14 unique users involving both human-human and human-robot (Franka robot arm) interactions in a kitchen setting.
Aug 2023 ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting was accepted to CoRL 2023! We learn cost-aware human motion forecasts and plan with them for safe human-robot collaboration.
May 2023 A Game-Theoretic Framework for Joint Forecasting and Planning was accepted to IROS 2023. We frame forecasting and planning as an adversarial game, leading to safer interactions.

Publications

  1. x-sim.png
    X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real
    Prithwish Dan*, Kushal Kedia*, Angela Chao, Edward Weiyi Duan , and 3 more authors
    In Submission, 2025
  2. mismatched_execution.gif
    One-Shot Imitation under Mismatched Execution
    Kushal Kedia*Prithwish Dan*, Angela Chao, Maximus Adrian Pace , and 1 more author
    IEEE International Conference on Robotics and Automation (ICRA), 2025
  3. 2024_mosaic.gif
    MOSAIC: A Modular System for Assistive and Interactive Cooking
    Huaxiaoyue Wang*, Kushal Kedia*, Juntao Ren*Prithwish Dan , and 13 more authors
    8th Annual Conference on Robot Learning (CoRL), 2024
  4. interact-1400.webp
    InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions
    Kushal Kedia, Atiksh Bhardwaj, Prithwish Dan, and Sanjiban Choudhury
    IEEE International Conference on Robotics and Automation (ICRA), 2024
  5. 2023_manicast.gif
    ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting
    Kushal Kedia, Prithwish Dan, Atiksh Bhardwaj, and Sanjiban Choudhury
    7th Annual Conference on Robot Learning (CoRL), 2023
  6. game.gif
    A Game-Theoretic Framework for Joint Forecasting and Planning
    Kushal Kedia, Prithwish Dan, and Sanjiban Choudhury
    2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023