Xue Yang (杨学)
Researcher at OpenGVLab, Shanghai AI Laboratory
Ph.D. at ThinkLab, Shanghai Jiao Tong University
Address: 701 Yunjin Road, Xuhui District, Shanghai, China
Email: yangxue0827@126.com, yangxue@pjlab.org.cn

Unsplashed background img 1


🇨🇳 Biography

Xue Yang is now a Researcher at OpenGVLab, Shanghai AI Laboratory, collaborated with Prof. Jifeng Dai and Dr. Xizhou Zhu. Xue Yang's research interests include deep learning and computer vision, with a focus on generic/oriented object detection/instance segmentation, AI Agent, Vision-Language Models.

Xue Yang received the B. E. degree from School of Information Science and Engineering, Central South University, Hunan, China, in 2016. He received the M. S. degree from School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, China, in 2019. Xue Yang obtained the Ph.D. degree from Wu Honor Class (吴文俊人工智能博士班), Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China, in 2023. His research advisor is Prof. Junchi Yan.

Xue Yang has published about 30 papers at the top international CV/ML/AI conferences and journals, such as TPAMI, IJCV, CVPR, ECCV, ICCV, ICML, NeurIPS, ICLR, AAAI and ACM MM. He is also the leading contributor to the MMRotate and AlphaRotate open-source projects for oriented object detection, and with 8000+ stars in Github. Xue Yang won SJTU Outstanding Doctoral Dissertation (2023), CCF Outstanding Doctoral Dissertation Award (2023), CCF-CV Academic Emerging Scholar (2022), Shanghai Outstanding Graduates (2023), Doctoral National Scholarship (2021/2022), SJTU Scholar Star Nomination Award (2021), and also selected into the World's Top 2% Scientists 2022/2023 List.

Looking for self-motivated collaborators with the goal of publishing Top-Tier papers on the topic of remote sensing image interpretation, including but not limited to multi-modal foundation model, weakly-/semi-supervised oriented object detection, etc. Please do not hesitate to contact me via email or WeChat.

🔥 News
  • • 03 / 2024:   SJTU Outstanding Doctoral Dissertation, fifteen winners in SJTU [上海交通大学优秀博士学位论文，全校15人/工学8人]
  • • 02 / 2024:   Four papers on oriented object detection, LLM for AI Agent (Minecraft) are accepted by CVPR 2024
  • • 02 / 2024:   One collaborative paper on oriented object detection (ARS-DETR) is accepted by TGRS
  • • 12 / 2023:   I'm awarded the CCF Doctoral Dissertation Award, nine winners in China [CCF 优秀博士学位论文激励计划，全国九人]
  • • 12 / 2023:   One paper on oriented object detection (AlphaRotate) is accepted by ICASSP 2024
  • • 11 / 2023:   I'm selected into the World's Top 2% Scientists 2022/2023 List
  • • 10 / 2023:   I'm elected as CSIG-BVD Committee Member at PRCV 2023
  • • 09 / 2023:   One paper on oriented object detection (H2RBox-v2) is accepted by NeurIPS 2023
  • • 07 / 2023:   One collaborative paper on self-supervised text recognition (CCD) is accepted by ICCV 2023
  • • 07 / 2023:   Researcher at OpenGVLab, Shanghai AI Laboratory, working with Prof. Jifeng Dai and Dr. Xizhou Zhu
  • • 06 / 2023:   A report is made at the Valse 2023 Wuxi [Valse 2023 无锡, W2：遥感影像解译], [报告PPT], [报告回放]
  • • 05 / 2023:   I'm awarded the Shanghai Outstanding Graduates
  • • 05 / 2023:   Passed the doctoral dissertation defense [dissertation], [slides], [playback]
  • • 03 / 2023:   Jittor implementation of CSL and RSDet are supported in JDet
  • • 03 / 2023:   A report is made at OpenMMLab [OpenMMLab社区开放麦], [slides], [bilibili], [zhihu]
  • • 02 / 2023:   Research internship at OpenGVLab, Shanghai AI Laboratory, working with Prof. Jifeng Dai and Dr. Xizhou Zhu
  • • 02 / 2023:   One collaborative paper on text recognition (SIGA) is accepted by CVPR 2023
  • • 02 / 2023:   One paper on oriented object detection is accepted by SCIENTIA SINICA Informationis 《中国科学：信息科学》
  • • 01 / 2023:   One collaborative paper on oriented object detection (G-Rep) is accepted by Remote Sensing
  • • 01 / 2023:   Three papers on rotation detection (H2RBox, KFIoU), instance segmentation (PatchDCT) are accepted by ICLR 2023
  • • 01 / 2023:   One collaborative paper on oriented object detection (TIOE) is accepted by ISPRS
  • • 12 / 2022:   A report is made at the Doctoral Forum of PRCV 2022 [PRCV 2022 博士生论坛]
  • • 12 / 2022:   I'm awarded by the CCF-CV Academic Emerging Scholar, three winners in China [CCF-CV 学术新锐学者，全国三人]
  • • 11 / 2022:   Jittor implementation of GWD, KLD, KFIoU and H2RBox are supported in JDet
  • • 11 / 2022:   One collaborative paper on oriented object detection (PVT-SAR) is accepted by JSTARS
  • • 09 / 2022:   I'm awarded by the Doctoral National Scholarship
  • • 08 / 2022:   🎉🎉 My google scholar citations have exceeded 2000!
  • • 08 / 2022:   One paper on oriented object detection is accepted by TPAMI
  • • 07 / 2022:   A report is made at OpenMMLab [OpenMMLab社区开放麦], [slides], [slides], [bilibili], [zhihu]
  • • 06 / 2022:   MMRotate is accepted by ACM MM 2022 as Oral
  • • 06 / 2022:   A report is made at Young Scholars Forum of Wu Wenjun's artificial intelligence doctoral class [吴班Talk], [slides]
  • • 06 / 2022:   One collaborative paper on oriented object detection (RSDet++) is accepted by TCSVT
  • • 04 / 2022:   One paper on oriented object detection (SCRDet++) is accepted by TPAMI
  • • 03 / 2022:   One collaborative paper on image inpainting is accepted by CVPR 2022
  • • 02 / 2022:   A PyTorch-based oriented object detection benchmark is released, called MMRotate
  • • 02 / 2022:   Research internship at EI Innovation Lab, Huawei Cloud, Shanghai, working with Prof. Qi Tian and Dr. Xiaopeng Zhang
  • • 02 / 2022:   One paper on oriented object detection is accepted by IJCV
  • • 12 / 2021:   I'm nominated by SJTU Scholar Star 2021, [上海交通大学“学术之星”提名奖]
  • • 12 / 2021:   A report is made at the fifth Jittor Forum [第五期“计图”论坛], [slides]
  • • 10 / 2021:   Ranking in the Top 40 in the ninth Baidu Scholarship
  • • 09 / 2021:   One paper on oriented object detection (KLD) is accepted by NeurIPS 2021
  • • 09 / 2021:   I'm awarded by the Doctoral National Scholarship (Top-1 in CSE)
  • • 09 / 2021:   One collaborative paper on oriented object detection (RIDet) is accepted by GRSL
  • • 07 / 2021:   One collaborative paper on image inpainting is accepted by ICCV 2021
  • • 07 / 2021:   One collaborative paper on oriented object detection (SLA) is accepted by Remote Sensing
  • • 05 / 2021:   A report is made at the Magnolia Young Scholar Forum [白玉兰青年学者论坛], [slides]
  • • 05 / 2021:   One paper on oriented object detection (GWD) is accepted by ICML 2021
  • • 03 / 2021:   One paper on oriented object detection (DCL) is accepted by CVPR 2021
  • • 12 / 2020:   Two papers (one collaborative paper) on oriented object detection (R3Det, RSDet) are accepted by AAAI 2021
  • • 10 / 2020:   A TensorFlow-based oriented object detection benchmark is released, called AlphaRotate
  • • 10 / 2020:   Research internship at EI Innovation Lab, Huawei, Shenzhen, working with Prof. Qi Tian and Dr. Xiaopeng Zhang
  • • 07 / 2020:   One paper on oriented object detection (CSL) is accepted by ECCV 2020
  • • 09 / 2019:   I'm supported by Wu Wen Jun Honorary Doctoral Scholarship, AI Institute, Shanghai Jiao Tong University
  • • 09 / 2019:   I'm joining Department of CSE at Shanghai Jiao Tong University as a Ph.D. student, supervised by Prof. Junchi Yan
  • • 07 / 2019:   One paper on oriented object detection (SCRDet) is accepted by ICCV 2019
📝 Recent Works [Full List]
( * indicates equal contribution, † indicates corresponding author, # indicates project lead)

Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learning
Yan Li, Weiwei Guo†, Xue Yang, Ning Liao, Dunyun He, Jiaqi Zhou, Wenxian Yu
EfficientMFD: Towards More Efficient Multimodal Synchronous Fusion Detection
Jiaqing Zhang, Mingxiang Cao, Xue Yang, Weiying Xie, Jie Lei, Daixun Li, Geng Yang, Wenbo Huang, Yunsong Li
Theoretically Achieving Continuous Representation of Oriented Bounding Boxes
Zikai Xiao, Guoye Yang, Xue Yang, Taijiang Mu†, Junchi Yan, Shimin Hu
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-end Oriented Object Detection with Single Point Supervision
Yi Yu*, Xue Yang*, Qingyun Li, Feipeng Da†, Jifeng Dai, Yu Qiao, Junchi Yan†
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
PointOBB: Learning Oriented Object Detection via Single Point Supervision
Junwei Luo, Xue Yang#, Yu Yi, Qingyun Li, Junchi Yan, Yansheng Li†
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
P2RBox: A Single Point is All You Need for Oriented Object Detection
Guangming Cao*, Xuehui Yu*, Wenwen Yu, Xumeng Han, Xue Yang, Guorong Li, Jianbin Jiao, Zhenjun Han†
📝 LLMs and AI Agent [Full List]
Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
Hao Li*, Xue Yang*, Zhaokai Wang*, Xizhou Zhu, Jie Zhou, Yu Qiao, Xiaogang Wang, Hongsheng Li, Lewei Lu, Jifeng Dai†
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
Zhaoyang Liu*, Yinan He*, Wenhai Wang*, Weiyun Wang*, Yi Wang*, Shoufa Chen*, Qinglong Zhang*, Yang Yang, Qingyun Li, Jiashuo Yu, Kunchang Li, Zhe Chen, Xue Yang, Xizhou Zhu, Yali Wang, Limin Wang, Ping Luo, Jifeng Dai, Yu Qiao
📝 Oriented Object Detection [Full List]
AlphaRotate: A Rotation Detection Benchmark using TensorFlow
Xue Yang, Yue Zhou, Wenlong Liao, Tao He, Junchi Yan†
In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP, CCF-B), Seoul, Korea, 2024
H2RBox-v2: Incorporating Symmetry for Boosting Horizontal Box Supervised Oriented Object Detection
Yi Yu*, Xue Yang*, Qingyun Li, Yue Zhou, Gefan Zhang, Feipeng Da†, Junchi Yan†
Advances in Neural Information Processing Systems (NeurIPS, CCF-A), New Orleans, Louisiana, USA, 2023
H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detection
Xue Yang, Gefan Zhang, Wentng Li, Xuehui Wang, Yue Zhou, Junchi Yan†
In International Conference on Learning Representations (ICLR, Tsinghua-A), Kigali, Rwanda, 2023
The KFIoU Loss for Rotated Object Detection
Xue Yang, Yue Zhou, Gefan Zhang, Jirui Yang, Wentao Wang, Junchi Yan†, Xiaopeng Zhang, Qi Tian
In International Conference on Learning Representations (ICLR, Tsinghua-A), Kigali, Rwanda, 2023
Detecting Rotated Objects as Gaussian Distributions and Its 3-D Generalization
Xue Yang, Gefan Zhang, Xiaojiang Yang, Yue Zhou, Wentao Wang, Jin Tang, Tao He, Junchi Yan†
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI, CCF-A), 2022
ESI Highly Cited Paper
MMRotate: A Rotated Object Detection Benchmark using PyTorch
Yue Zhou*, Xue Yang*, Gefan Zhang, Jiabao Wang, Yanyi Liu, Liping Hou, Xue Jiang†, Xingzhao Liu, Junchi Yan†, Chengqi Lyu, Wenwei Zhang, Kai Chen
In Proceedings of the 30th ACM International Conference on Multimedia (ACM MM, CCF-A), Lisboa, Portugal, Open Source Software Competition, Oral, 2022
SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothing
Xue Yang, Junchi Yan†, Wenlong Liao, Xiaokang Yang, Jin Tang, Tao He
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI, CCF-A), 2022
ESI Hot Cited Paper, ESI Highly Cited Paper
On the Arbitrary-Oriented Object Detection: Classification based Approaches Revisited
Xue Yang, Junchi Yan†
International Journal of Computer Vision (IJCV, CCF-A), 2022
Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergence
Xue Yang, Xiaojiang Yang, Jirui Yang, Qi Ming, Wentao Wang, Qi Tian, Junchi Yan†
Advances in Neural Information Processing Systems (NeurIPS, CCF-A), Virtual, 2021
Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss
Xue Yang, Junchi Yan†, Qi Ming, Wentao Wang, Xiaopeng Zhang, Qi Tian
In International Conference on Machine Learning (ICML, CCF-A), Virtual, 2021
Dense Label Encoding for Boundary Discontinuity Free Rotation Detection
Xue Yang, Liping Hou, Yue Zhou, Wentao Wang, Junchi Yan†
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Virtual, 2021
Learning Modulated Loss for Rotated Object Detection
Wen Qian, Xue Yang, Silong Peng†, Junchi Yan, Yue Guo
In Proceedings of the Thirty-Five AAAI Conference on Artificial Intelligence (AAAI, CCF-A), Vancouver, Canada (Virtual), 2021
Most Influential AAAI'21 Paper, Top 10
R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object
Xue Yang, Junchi Yan†, Ziming Feng, Tao He
In Proceedings of the Thirty-Five AAAI Conference on Artificial Intelligence (AAAI, CCF-A), Vancouver, Canada (Virtual), 2021
Most Influential AAAI'21 Paper, Top 1
Arbitrary-Oriented Object Detection with Circular Smooth Label
Xue Yang, Junchi Yan†
In Proceedings of the European Conference on Computer Vision (ECCV, CCF-B, Tsinghua-A), Glasgow, Scotland, UK (Virtual), 2020
SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects
Xue Yang, Jirui Yang, Junchi Yan†, Yue Zhang, Tengfei Zhang, Zhi Guo, Sun Xian, Kun Fu
In Proceedings of the IEEE International Conference on Computer Vision (ICCV, CCF-A), Seoul, Korea, 2019
Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks
Xue Yang, Hao Sun, Kun Fu†, Jirui Yang, Xian Sun, Menglong Yan, Zhi Guo
In Remote Sensing, 2018
ESI Highly Cited Paper
LEARN MORE>>
📝 Object Detection, Instance Segmentation and Beyond [Full List]
PatchDCT: Patch Refinement for High Quality Instance Segmentation
Qinrou Wen, Jirui Yang, Xue Yang, Kewei Liang†
In International Conference on Learning Representations (ICLR, Tsinghua-A), Kigali, Rwanda, 2023
📝 Scene Text Detection and Recognition [Full List]
Self-supervised Character-to-Character Distillation for Text Recognition
Tongkun Guan, Wei Shen†, Xue Yang, Qi Feng, Zekun Jiang, Xiaokang Yang
In Proceedings of the IEEE International Conference on Computer Vision (ICCV, CCF-A), Paris, France, 2023
Self-supervised Implicit Glyph Attention for Text Recognition
Tongkun Guan, Chaochen Gu†, Jingzheng Tu, Xue Yang, Qi Feng, Yudi Zhao, Wei Shen†
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Vancouver, Canada, 2023
📝 Low-Level Vision [Full List]
Dual-path Image Inpainting with Auxiliary GAN Inversion
Wentao Wang, Li Niu†, Jianfu Zhang, Xue Yang, Liqing Zhang†
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), New Orleans, Louisiana, USA, 2022
Parallel Multi-Resolution Fusion Network for Image Inpainting
Wentao Wang, Jianfu Zhang, Li Niu†, Haoyu Ling, Xue Yang, Liqing Zhang†
In Proceedings of the IEEE International Conference on Computer Vision (ICCV, CCF-A), Virtual, 2021
📚 Academic Activities
Conference Reviewers
  •   • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021-2024
  •   • IEEE/CVF International Conference on Computer Vision (ICCV), 2023
  •   • European Conference on Computer Vision (ECCV), 2022/2024
  •   • Asian Conference on Computer Vision (ACCV), 2024
  •   • Neural Information Processing Systems (NeurIPS), 2022-2023
  •   • International Conference on Machine Learning (ICML), 2022-2024
  •   • International Conference on Learning Representations (ICLR), 2024
  •   • AAAI Conference on Artificial Intelligence (AAAI), 2022-2024
  •   • ACM International Conference on Multimedia (ACM MM), 2021-2024
Journal Reviewers
  •   • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  •   • International Journal of Computer Vision (IJCV)
  •   • IEEE Transactions on Image Processing (TIP)
  •   • Pattern Recognition (PR)
  •   • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  •   • IEEE Transactions on Geoscience and Remote Sensing (TGRS)
  •   • IEEE Geoscience and Remote Sensing Letters (GRSL)
  •   • IEEE Transactions on Intelligent Transportation Systems (TITS)
  •   • IEEE Transactions on Multimedia Computing Communications and Applications (TOMM)
  •   • Remote Sensing
Tech. Talks
🎓 Education

B.E. degree from School of Information Science and Engineering, Central South University, Hunan, China
Sep. 2012 - July 2016

M.S. degree from School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, China
Sep. 2016 - July 2019

Ph.D. in CV, Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
Sep. 2019 - July 2023
🧑🏻‍💻 Internship and Cooperation
                       
🎖 Awards
🛠 Projects
yangxue0827
DetectionTeamUCAS
Thinklab-SJTU
SJTU-Thinklab-Det
open-mmlab/mmrotate
Jittor/JDet
💻 Demos


👬 Close Collaborators
Yue Zhou (PostDoc., SJTU), Yi Yu (PostDoc., SEU), Gefan Zhang (Master, SJTU), Wentao Wang (Ph.D., SJTU), Jirui Yang (Master, UCAS), Qi Ming (Ph.D., BIT), Xuehui Wang (Ph.D., SJTU), Qingyun Li (Ph.D., HIT), Tongkun Guan (Ph.D., SJTU), Junwei Luo (Master, WHU), Wentong Li (Ph.D., ZJU)
Copyright © Xue Yang 2020