📝 Summary

Conference: CVPR/ICCV/ECCV (7/3/1), NeurIPS/ICML/ICLR (2/1/3), AAAI (2), ACM MM (1)

Journal: TPAMI (2), IJCV (1), SCIENTIA SINICA Informationis (1), IEEE Transactions (4)

Award: ESI Hot Cited Paper (1), ESI Highly Cited Paper (5), Most Influential Paper (2)

* indicates equal contribution, indicates corresponding author, # indicates project lead
📝 LLMs and AI Agent

Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
Hao Li*, Xue Yang*, Zhaokai Wang*, Xizhou Zhu, Jie Zhou, Yu Qiao, Xiaogang Wang, Hongsheng Li, Lewei Lu, Jifeng Dai
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
citations
[project page]

InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
Zhaoyang Liu*, Yinan He*, Wenhai Wang*, Weiyun Wang*, Yi Wang*, Shoufa Chen*, Qinglong Zhang*, Yang Yang, Qingyun Li, Jiashuo Yu, Kunchang Li, Zhe Chen, Xue Yang, Xizhou Zhu, Yali Wang, Limin Wang, Ping Luo, Jifeng Dai, Yu Qiao
citations
[InternGPT]
[Demo]

📝 Oriented Object Detection

Theoretically Achieving Continuous Representation of Oriented Bounding Boxes
Zikai Xiao, Guoye Yang, Xue Yang, Taijiang Mu, Junchi Yan, Shimin Hu
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
citations
[JDet]

Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-end Oriented Object Detection with Single Point Supervision
Yi Yu*, Xue Yang*, Qingyun Li, Feipeng Da, Jifeng Dai, Yu Qiao, Junchi Yan
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
citations
[Point2RBox-MMRotate]
[解读]

PointOBB: Learning Oriented Object Detection via Single Point Supervision
Junwei Luo, Xue Yang#, Yu Yi, Qingyun Li, Junchi Yan, Yansheng Li
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Seattle WA, USA, 2024
citations
[PointOBB-Pytorch]
[解读]

ARS-DETR: Aspect Ratio Sensitive Oriented Object Detection with Transformer
Ying Zeng, Yushi Chen, Xue Yang, Qingyun Li, Junchi Yan
IEEE Transactions on Geoscience and Remote Sensin (TGRS, CCF-B), 2024
citations
[ARS-DETR-PyTorch]

AlphaRotate: A Rotation Detection Benchmark using TensorFlow
Xue Yang, Yue Zhou, Wenlong Liao, Tao He, Junchi Yan
In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP, CCF-B), Seoul, Korea, 2024
citations
[docs]
[AlphaRotate-TF]

P2RBox: A Single Point is All You Need for Oriented Object Detection
Guangming Cao*, Xuehui Yu*, Wenwen Yu, Xumeng Han, Xue Yang, Guorong Li, Jianbin Jiao, Zhenjun Han
citations

H2RBox-v2: Incorporating Symmetry for Boosting Horizontal Box Supervised Oriented Object Detection
Yi Yu*, Xue Yang*, Qingyun Li, Yue Zhou, Gefan Zhang, Feipeng Da, Junchi Yan
Advances in Neural Information Processing Systems (NeurIPS, CCF-A), New Orleans, Louisiana, USA, 2023
citations
[H2RBox-v2-MMRotate]
[解读]

G-Rep: Gaussian Representation for Arbitrary-Oriented Object Detection
Liping Hou, Ke Lu, Xue Yang, Yuqiu Li, Jian Xue
In Remote Sensing, 2023
citations
[paper]

H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detection
Xue Yang, Gefan Zhang, Wentng Li, Xuehui Wang, Yue Zhou, Junchi Yan
In International Conference on Learning Representations (ICLR, Tsinghua-A), Kigali, Rwanda, 2023
citations
[H2RBox-PyTorch], [H2RBox-MMRotate]
[H2RBox-Jittor], [H2RBox-JDet]
[解读], [知乎视频解读]
[B站视频解读]

The KFIoU Loss for Rotated Object Detection
Xue Yang, Yue Zhou, Gefan Zhang, Jirui Yang, Wentao Wang, Junchi Yan, Xiaopeng Zhang, Qi Tian
In International Conference on Learning Representations (ICLR, Tsinghua-A), Kigali, Rwanda, 2023
citations
[KFIoU-TF], [KFIoU-PyTorch], [KFIoU-Jittor]
[解读]

Task Interleaving and Orientation Estimation for High-Precision Oriented Object Detection in Aerial Images
Qi Ming, Lingjuan Miao, Zhiqiang Zhou, Junjie Song, Yunpeng Dong, Xue Yang
ISPRS Journal of Photogrammetry and Remote Sensing (ISPRS), 2023
citations
[paper]
[TIOE-PyTorch],

PVT-SAR: An Arbitrarily Oriented SAR Ship Detector with Pyramid Vision Transformer
Yue Zhou, Xue Jiang, Guozheng Xu, Xue Yang, Xingzhao Liu
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS), 2022
citations
[paper]

Detecting Rotated Objects as Gaussian Distributions and Its 3-D Generalization
Xue Yang, Gefan Zhang, Xiaojiang Yang, Yue Zhou, Wentao Wang, Jin Tang, Tao He, Junchi Yan
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI, CCF-A), 2022
citations
[AlphaRotate], [MMRotate], [mmdet3d-gaussian], [JDet]
[GWD解读], [KLD解读], [知乎视频解读]
[视频解读]

MMRotate: A Rotated Object Detection Benchmark using PyTorch
Yue Zhou*, Xue Yang*, Gefan Zhang, Jiabao Wang, Yanyi Liu, Liping Hou, Xue Jiang, Xingzhao Liu, Junchi Yan, Chengqi Lyu, Wenwei Zhang, Kai Chen
In Proceedings of the 30th ACM International Conference on Multimedia (ACM MM, CCF-A), Lisboa, Portugal, Open Source Software Competition, Oral, 2022
citations
[MMRotate]
[Video]

RSDet++: Point-based Modulated Loss for More Accurate Rotated Object Detection
Wen Qian, Xue Yang, Silong Peng, Junchi Yan, Xiujuan Zhang
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT, CCF-B), 2022
citations
[RSDet++-TF]

SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothing
Xue Yang, Junchi Yan, Wenlong Liao, Xiaokang Yang, Jin Tang, Tao He
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI, CCF-A), 2022
citations
[IoU-Smooth L1 Loss-TF], [DOTA-DOAI]
[S2TLD]
[project page]

On the Arbitrary-Oriented Object Detection: Classification based Approaches Revisited
Xue Yang, Junchi Yan
International Journal of Computer Vision (IJCV, CCF-A), 2022
citations
[CSL-TF], [DCL-TF], [OHDet-TF]
[OHD-SJTU]
[project page]

Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergence
Xue Yang, Xiaojiang Yang, Jirui Yang, Qi Ming, Wentao Wang, Qi Tian, Junchi Yan
Advances in Neural Information Processing Systems (NeurIPS, CCF-A), Virtual, 2021
citations
[KLD-TF], [KLD-PyTorch], [KLD-Jittor]
[slides], [poster]
[解读], [知乎视频解读]
[视频解读]

Optimization for Arbitrary-Oriented Object Detection via Representation Invariance Loss
Qi Ming, Lingjuan Miao, Zhiqiang Zhou, Xue Yang, Yunpeng Dong
IEEE Geoscience and Remote Sensing Letters (GRSL, CCF-C), 2021
citations
[RIDet-TF], [RIDet-PyTorch]

Sparse Label Assignment for Oriented Object Detection in Aerial Images
Qi Ming, Lingjuan Miao, Zhiqiang Zhou, Junjie Song, Xue Yang
In Remote Sensing, 2021
citations
[paper]
[SLA-PyTorch]

Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss
Xue Yang, Junchi Yan, Qi Ming, Wentao Wang, Xiaopeng Zhang, Qi Tian
In International Conference on Machine Learning (ICML, CCF-A), Virtual, 2021
citations
[GWD-TF], [GWD-PyTorch], [GWD-Jittor]
[slides], [poster]
[解读], [知乎视频解读]
[视频解读]

Dense Label Encoding for Boundary Discontinuity Free Rotation Detection
Xue Yang, Liping Hou, Yue Zhou, Wentao Wang, Junchi Yan
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Virtual, 2021
citations
[RetinaNet-DCL-TF], [R3Det-DCL-TF]
[slides], [poster]
[解读]

Learning Modulated Loss for Rotated Object Detection
Wen Qian, Xue Yang, Silong Peng, Junchi Yan, Yue Guo
In Proceedings of the Thirty-Five AAAI Conference on Artificial Intelligence (AAAI, CCF-A), Vancouver, Canada (Virtual), 2021
citations
[RSDet-TF] [RSDet-Jittor]
[slides], [poster]
[解读]

R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object
Xue Yang, Junchi Yan, Ziming Feng, Tao He
In Proceedings of the Thirty-Five AAAI Conference on Artificial Intelligence (AAAI, CCF-A), Vancouver, Canada (Virtual), 2021
citations
[R3Det-TF], [R3Det-PyTorch]
[slides], [poster] [期刊版本《中国科学:信息科学》]

Arbitrary-Oriented Object Detection with Circular Smooth Label
Xue Yang, Junchi Yan
In Proceedings of the European Conference on Computer Vision (ECCV, CCF-B, Tsinghua-A), Glasgow, Scotland, UK (Virtual), 2020
citations
[CSL-RetinaNet-TF] [CSL-RetinaNet-PyTorch] [CSL-RetinaNet-Jittor]
[slides]
[解读]

SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects
Xue Yang, Jirui Yang, Junchi Yan, Yue Zhang, Tengfei Zhang, Zhi Guo, Sun Xian, Kun Fu
In Proceedings of the IEEE International Conference on Computer Vision (ICCV, CCF-A), Seoul, Korea, 2019
citations
[IoU-Smooth L1 Loss-TF], [R2CNN++-TF]
[poster]
[解读]

Position detection and direction prediction for arbitrary-oriented ships via multitask rotation region convolutional neural network
Xue Yang, Hao Sun, Xian Sun, Menglong Yan, Zhi Guo, Kun Fu
In IEEE Access, 2018
citations
[paper]
[R2CNN_HEAD_FPN-TF]

Object Detection With Head Direction in Remote Sensing Images Based on Rotational Region CNN
Xue Yang, Kun Fu, Hao Sun, Xian Sun, Menglong Yan, Wenhui Diao, Zhi Guo
In IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2018
citations
[paper]

Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks
Xue Yang, Hao Sun, Kun Fu, Jirui Yang, Xian Sun, Menglong Yan, Zhi Guo
In Remote Sensing, 2018
citations
[R-DFPN-TF]

📝 Object Detection, Instance Segmentation and Beyond

Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learning
Yan Li, Weiwei Guo, Xue Yang, Ning Liao, Dunyun He, Jiaqi Zhou, Wenxian Yu
citations

EfficientMFD: Towards More Efficient Multimodal Synchronous Fusion Detection
Jiaqing Zhang, Mingxiang Cao, Xue Yang, Weiying Xie, Jie Lei, Daixun Li, Geng Yang, Wenbo Huang, Yunsong Li
citations
[EfficientMFD-PyTorch]

PatchDCT: Patch Refinement for High Quality Instance Segmentation
Qinrou Wen, Jirui Yang, Xue Yang, Kewei Liang
In International Conference on Learning Representations (ICLR, Tsinghua-A), Kigali, Rwanda, 2023
citations
[PatchDCT-PyTorch]
[解读], [知乎视频解读]
[B站视频解读]

Rethinking Classification and Localization for Cascade R-CNN
Ang Li, Xue Yang, Chongyang Zhang
In Proceedings of the 30th British Machine Vision Conference (BMVC, CCF-C), Cardiff, Wales, UK, 2019
citations

A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection
Jiao Jiao, Yue Zhang, Hao Sun, Xue Yang, Xun Gao, Wen Hong, Kun Fu, Xian Sun
In IEEE Access, 2018
citations
[paper]

📝 Scene Text Detection and Recognition

Self-supervised Character-to-Character Distillation for Text Recognition
Tongkun Guan, Wei Shen, Xue Yang, Qi Feng, Zekun Jiang, Xiaokang Yang
In Proceedings of the IEEE International Conference on Computer Vision (ICCV, CCF-A), Paris, France, 2023
citations
[CCD-PyTorch]
[解读]

Self-supervised Implicit Glyph Attention for Text Recognition
Tongkun Guan, Chaochen Gu, Jingzheng Tu, Xue Yang, Qi Feng, Yudi Zhao, Wei Shen
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), Vancouver, Canada, 2023
citations
[SIGA-PyTorch]
[解读]

📝 Low-Level Vision

Dual-path Image Inpainting with Auxiliary GAN Inversion
Wentao Wang, Li Niu, Jianfu Zhang, Xue Yang, Liqing Zhang
In Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR, CCF-A), New Orleans, Louisiana, USA, 2022
citations
[paper], [poster]

Parallel Multi-Resolution Fusion Network for Image Inpainting
Wentao Wang, Jianfu Zhang, Li Niu, Haoyu Ling, Xue Yang, Liqing Zhang
In Proceedings of the IEEE International Conference on Computer Vision (ICCV, CCF-A), Virtual, 2021
citations
[paper], [poster]