Xin You

Xin You

Ph.D. @ Institute of Medical Robotics, Shanghai Jiao Tong University

I received my Ph.D. degree from the Institute of Medical Robotics, Shanghai Jiao Tong University, where I was supervised by Prof. Yun Gu and Prof. Jie Yang.

I was also a visiting scholar at the Chair for Computer Aided Medical Procedures & Augmented Reality, Technical University of Munich, where I worked with Prof. Nassir Navab on anatomical motion modeling. I have had the privilege to collaborate with Prof. Shaohua Kevin Zhou on histology image analysis. Prior to this, I interned at GMAI center, Shanghai AI Laboratory, working with Prof. Junjun He on foundation models for medical image segmentation.

My research advances AI for medicine and healthcare through generative and agentic AI, multimodal learning, and world models. Ultimately, I aim to build virtual patients — faithful, dynamic digital twins that can support preoperative planning and intraoperative navigation in real-world clinical settings.

Note: I'm always open to academic collaborations and discussions. Please feel free to reach out by sjtu_youxin [at] sjtu [dot] edu [dot] cn.

Affiliations

What's New

Research Topics

Multi-modal representation learning, foundation models and agentic AI that reason across modalities and clinical context.

  • Geometry-guided Diffusion Improves AI-based Polyp Detection, Classification, and Re-identification
    K. Hao, Y. Chu, J. Wu, H. Chen, L. Zhou, Y. Xu, J. Cheng, Xin You, H. Zhang, H. Peng, Guang-Zhong Yang, and Yun Gu
    Preprint NPJ Digital Medicine, under review, 2026
  • MLOW: Interpretable Low-Rank Frequency Magnitude Decomposition of Multiple Effects for Time Series Forecasting
    Runze Yang, Longbing Cao, Xiaoming Wu, Xin You, Kun Fang, Jianxun Li, and Jie Yang
    arXiv arXiv preprint, 2026
    Paper
  • MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis
    Zhengyang Xu, Han Li, Jingsong Liu, Linrui Xie, Xin You, Shihui Zu, Ayako Ito, Xinyu Hao, Hongming Xu, S. Kevin Zhou, Nassir Navab, and Peter J. Schüffler
    arXiv arXiv preprint, 2026
    Paper
  • Multi-class Segmentation of Aortic Branches and Zones in Computed Tomography Angiography: The AortaSeg24 Challenge
    Muhammad Imran, Jonathan R. Krebs, Vishal Balaji Sivaraman, Teng Zhang, Amarjeet Kumar, Walker R. Ueland, Michael J. Fassler, Chang Wang, Jinlong Huang, Xiao Sun, and others
    MedIA Medical Image Analysis, 2026
    Paper Project
  • SenseNova-U1.5: Towards Native Unified Visual Intelligence
    Haiwen Diao, Jiahao Wang, Chenjing Ding, Hanming Deng, Jiangnan Chen, Ruixi Zhang, Ruohui Wang, Wenwen Tong, Xiangyu Fan, Yubo Wang, and others
    arXiv Technical Report, 2026
    Paper Code
  • SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture
    Haiwen Diao, Penghao Wu, Hanming Deng, Jiahao Wang, Shihao Bai, Silei Wu, Weichen Fan, Wenjie Ye, Wenwen Tong, Xiangyu Fan, and others
    arXiv Technical Report, 2026
    Paper Code
  • The TopCoW Challenge: Topology-Aware Circle of Willis Segmentation for CT and MR Angiography
    Kaiyuan Yang, Fabio Musio, Yihui Ma, Norman Juchler, Johannes C. Paetzold, Rami Al-Maskari, Luciano Höher, Hongwei Bran Li, Ibrahim Ethem Hamamci, Anjany Sekuboyina, and others
    NEJM AI NEJM AI, 2026
    Paper Project
  • Towards Boundary Confusion for Volumetric Medical Image Segmentation
    Xin You, Ming Ding, Minghui Zhang, Hanxiao Zhang, Junyang Wu, Jie Yang, Yi Yu, and Yun Gu
    MedIA Medical Image Analysis, 2026
    Paper Code
  • Towards Voxel Spacing Consistency for Medical Image Segmentation
    Xin You, Runze Yang, Minghui Zhang, Hanxiao Zhang, Han Li, Yi Yu, Jie Yang, Nassir Navab, and Yun Gu
    arXiv arXiv preprint, 2026
    Paper
  • TriALS: Triphasic-Aided Liver Lesion Segmentation Benchmark in Non-Contrast CT
    Marawan Elbatel, Mohamed Ghonim, Jiaji Mao, Zhuosheng Lin, Katharina Eckstein, Andrés Martínez Mora, Jonathan Deissler, Maximilian Rokuss, Constantin Ulrich, Zdravko Marinov, and others
    arXiv MedIA, under review, 2026
    Paper Code
  • TubeMLLM: A Foundation Model for Topology Knowledge Exploration in Vessel-like Anatomy
    Yaoyu Liu, Minghui Zhang, Xin You, Hanxiao Zhang, and Yun Gu
    arXiv arXiv preprint, 2026
    Paper
  • Vision as Unified Multimodal Generation
    Xiaoyang Han, Jianhua Li, Kewang Deng, Zukai Chen, Xuanke Shi, Sihan Wang, Boxuan Li, Linyan Wang, Siyi Xie, Xin You, and others
    arXiv Technical Report, 2026
    Paper
  • Computing Assessment for Liver Fibrosis Staging Using Real-World MR Images
    Hanxiao Zhang, Minghui Zhang, Xin You, Yun Gu, and Guang-Zhong Yang
    MICCAIW MICCAI Challenge on Comprehensive Analysis and Computing of Real-World Medical Images (CARE), 2025
    Paper
  • FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imaging
    Xin You, Runze Yang, Chuyan Zhang, Zhongliang Jiang, Jie Yang, and Nassir Navab
    ICCV ICCV 2025, 2025
    Paper
  • Fourier Basis Mapping: A Time-Frequency Learning Framework for Time Series Forecasting
    Runze Yang, Longbing Cao, Xin You, Kun Fang, Jianxun Li, and Jie Yang
    arXiv IEEE TPAMI, under review, Under review, 2025
    Paper Code
  • From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC
    Jingsong Liu, Xiaofeng Deng, Han Li, Azar Kazemi, Christian Grashei, Gesa Wilkens, Xin You, Tanja Groll, Nassir Navab, Carolin Mogler, and Peter J. Schüffler
    CIBM Computers in Biology and Medicine, 2025
    Paper
  • HASD: Hierarchical Adaption for Pathology Slide-level Domain-shift
    Jingsong Liu, Han Li, Chen Yang, Michael Deutges, Ario Sadafi, Xin You, Katharina Breininger, Nassir Navab, and Peter J. Schüffler
    MICCAI MICCAI 2025, 2025
    Paper Code
  • SLoRD: Structural Low-Rank Descriptors for Shape Consistency in Vertebrae Segmentation
    Xin You, Yixin Lou, Minghui Zhang, Jie Yang, and Yun Gu
    JBHI IEEE Journal of Biomedical and Health Informatics, 2025
    Paper Code
  • Shape-aware Sampling Matters in the Modeling of Multi-Class Tubular Structures
    Minghui Zhang, Yaoyu Liu, Xin You, Hanxiao Zhang, and Yun Gu
    arXiv arXiv preprint, 2025
    Paper
  • Temporal Differential Fields for 4D Motion Modeling via Image-to-Video Synthesis
    Xin You, Minghui Zhang, Hanxiao Zhang, Jie Yang, and Nassir Navab
    MICCAI MICCAI 2025, 2025
    Paper Code
  • TopoSculpt: Betti-Steered Topological Sculpting of 3D Fine-grained Tubular Shapes
    Minghui Zhang, Yaoyu Liu, Junyang Wu, Xin You, Hanxiao Zhang, Junjun He, and Yun Gu
    arXiv arXiv preprint, Under review, 2025
    Paper Code
  • ChromTR: Chromosome Detection in Raw Metaphase Cell Images via Deformable Transformers
    Chao Xia, Jiyue Wang, Xin You, Yaling Fan, Bing Chen, Saijuan Chen, and Jie Yang
    FMD Frontiers of Medicine, 2024
    Paper
  • Implicit Representation Embraces Challenging Attributes of Pulmonary Airway Tree Structures
    Minghui Zhang, Hanxiao Zhang, Xin You, Guang-Zhong Yang, and Yun Gu
    MICCAI MICCAI 2024, 2024
    Paper Code
  • LNQ 2023 Challenge: Benchmark of Weakly-supervised Techniques for Mediastinal Lymph Node Quantification
    Reuben Dorent, Roya Khajavi, Tagwa Idris, Erik Ziegler, Bhanusupriya Somarouthu, Heather Jacene, Ann LaCasce, Jonathan Deissler, Jan Ehrhardt, Sofija Engelson, and others
    Journal MELBA, 2024
    Paper
  • Learning with Explicit Shape Priors for Medical Image Segmentation
    Xin You, Junjun He, Jie Yang, and Yun Gu
    TMI IEEE TMI, 2024
    Paper Code
  • PASS: Test-time Prompting to Adapt Styles and Semantic Shapes in Medical Image Segmentation
    Chuyan Zhang, Hao Zheng, Xin You, Yefeng Zheng, and Yun Gu
    TMI IEEE TMI, 2024
    Paper Code
  • Topology-aware Exploration of Circle of Willis for CTA and MRA: Segmentation, Detection, and Classification
    Minghui Zhang, Xin You, Hanxiao Zhang, and Yun Gu
    arXiv TopCoW24 Challenge @ MICCAI 2024, 2024
    Paper
  • Multi-site, Multi-domain Airway Tree Modeling
    Minghui Zhang, Yangqian Wu, Hanxiao Zhang, Yulei Qin, Hao Zheng, Wen Tang, Corey Arnold, Chenhao Pei, Pengxin Yu, Yang Nan, and others
    MedIA Medical Image Analysis, 2023
    Paper Project
  • SAM-Med2D
    Junlong Cheng, Jin Ye, Zhongying Deng, Jianpin Chen, Tianbin Li, Haoyu Wang, Yanzhou Su, Ziyan Huang, Jilong Chen, Lei Jiang, and others (Xin You as co-contributor)
    arXiv arXiv preprint, 2023
    Paper Code
  • Semantic Difference Guidance for the Uncertain Boundary Segmentation of CT Left Atrial Appendage
    Xin You, Ming Ding, Minghui Zhang, Yangqian Wu, Yi Yu, Yun Gu, and Jie Yang
    MICCAI MICCAI 2023, 2023
    Paper Code
  • VerteFormer: A Single-staged Transformer Network for Vertebrae Segmentation from CT Images with Arbitrary Field of Views
    Xin You, Yun Gu, Yingying Liu, Steve Lu, Xin Tang, and Jie Yang
    MedPhys Medical Physics, 2023
    Paper
  • A More Design-Flexible Medical Transformer for Volumetric Image Segmentation
    Xin You, Yun Gu, Junjun He, Hui Sun, and Jie Yang
    MLMI MICCAI Workshop on Machine Learning in Medical Imaging, 2022
    Paper
  • EG-Trans3DUNet: A Single-staged Transformer-based Model for Accurate Vertebrae Segmentation from Spinal CT Images
    Xin You, Yun Gu, Yingying Liu, Steve Lu, Xin Tang, and Jie Yang
    ISBI IEEE International Symposium on Biomedical Imaging, 2022
    Paper

Talks & Activities

Invited Talks

  • 2025.03

    Generative AI for Anatomical Motion Modeling in 4D Medical Imaging, invited talk at CAMP, Technical University of Munich

    TUM CAMP
  • 2024.08

    Explicit Shape Priors Embrace Anatomical Structure Modeling, invited talk at Suzhou Institute for Advanced Research, University of Science and Technology of China.

    SIAR, USTC
  • 2022.04

    Generalized Models for 3D Medical Image Segmentation, invited talk at GMAI Center, Shanghai AI Laboratory.

    Shanghai AI Lab

Teaching Assistant

  • 2023.07 — 2023.08

    Teaching Assistant for Summer Camp of Institute of Medical Robotics, SJTU.
  • 2022 — 2023 Spring

    Teaching Assistant for Intelligent Information Processing, SJTU.
  • 2020 — 2021 Fall

    Teaching Assistant for C++ Programming, SJTU.

Regular Reviewer

  • Journal Reviewer: TPAMI, TIP, TNNLS, Medical Image Analysis, TMI, JBHI, and PR.

  • Conference Reviewer: CVPR, ICCV, ECCV, NeurIPS, ICLR, AAAI, MICCAI, MIDL, IPCAI and ISBI.

Funders and Collaborators

Shanghai Jiao Tong University Shanghai Jiao Tong University Technical University of Munich Technical University of Munich Munich Center for Machine Learning Munich Center for Machine Learning Shanghai Artificial Intelligence Laboratory Shanghai Artificial Intelligence Laboratory SenseNova SenseNova NVIDIA NVIDIA AMD AMD