杨 帅

王选计算机研究所
北京大学

个人简介

杨帅, 北京大学王选计算机技术研究所助理教授、博导、北京大学博雅青年学者、未名青年学者、国家级青年人才计划获得者. 分别在2015年和2020年获得北京大学的学士学位和博士学位, 2020年至2024年在新加坡南洋理工大学先后任博士后和研究助理教授. 获得了IEEE ICME 2020的最佳论文奖和IEEE MMSP 2015的Top10%论文奖. 获得了2020年中国图象图形学学会优秀博士学位论文奖和北京大学优秀博士学位论文奖. 担任ACM MM和BMVC的领域主席.

主要研究领域为智能媒体计算和计算机视觉, 专注图像风格化和图像编辑.

科研经历

  • 2024.03    至   今: 助理教授 | STRUCT@北京大学
  • 2023.03-2024.02: 研究助理教授 | MMLab@南洋理工大学
  • 2020.10-2023.03: 博士后 | MMLab@南洋理工大学 | 导师 Prof. Chen Change Loy
  • 2018.09-2019.09: 访问学者 | VITA@德州农工大学 | 导师 Prof. Atlas Wang
  • 2017.03-2017.08: 访问学生 | GSIP@日本国立情报学研究所 | 导师 Prof. Gene Cheung
  • 2015.09-2020.07: 博士 | STRUCT@北京大学 | 导师 郭宗明 研究员
  • 2010.09-2015.07: 学士 | STRUCT@北京大学 | 导师 刘家瑛 副教授

最新动态

  • 2025.02 😆 3 篇论文被 CVPR 2025 接收!
  • 2024.12 参会 智能传媒技术发展论坛 作学术报告: 智能视觉艺术创作
  • 2024.11 参会 黄大年茶思屋 多媒体领域青年学者论坛 作学术报告: 人像智能艺术渲染
  • 2024.07 加入 CSIG 中国图象图形学学会 多媒体专委会
  • 2024.07 参加 ICME Workshop on AIArt 作 Keynote 报告: AIGC for Human Artistic Rendering
  • 2024.07 😆 2 篇论文被 ECCV 2024 接收!
  • 2024.05 参会 ISCAS 作 Tutorial: AIGC for Image and Video Generation
  • 2024.03 加入 北京大学 王选计算机技术研究所 担任助理教授
  • 展开更多
    •
  • 2024.09 欢迎巴西圣保罗大学 Roberto M. Cesar-Jr 教授来访!
  • 2024.08 参加 APSIPA panel discussion
  • 2024.06 参加 VALSE Webinar 作学术报告: 人像智能艺术设计
  • 2024.02 😆 2 篇论文被 CVPR 2024 接收!
  • 2023.07 😆 4 篇论文被 ICCV 2023 接收!
  • 2023.03 晋升 南洋理工大学S-Lab 研究助理教授 (RAP)

科研项目

  • 2025-2028, 主持, 国家自然科学基金面上项目: 视觉内容的智能可控生成编辑研究, No.62471009
  • 2024-2025, 主持, CCF-腾讯犀牛鸟科研基金项目: 图像视频的智能可控生成与编辑, CCF-Tencent RAGR20240118
  • 2025-2027, 参与, 国家重点研发计划: 复杂动态场景高保真实时三维重建, 2024YFB2809101
  • 2023-2025, 合作研究员, 商汤高校合作项目: Artistic Neural Radiance Fields, HASI-006
  • 2021-2023, 合作研究员, 新加坡教育部Tier-1基金: Human-Centric Visual Manipulation via Interactive Dialog, MoE Tier-1 RG13/21

发表成果

完整列表请移步 Google Scholar; 论文相关资源请移步 Publication

精选期刊论文
  1. Shuai Yang, Liming Jiang, Ziwei Liu, and Chen Change Loy. "GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation", IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.45, No.10, pp.11869-11993, Oct. 2023.
  2. Shuai Yang, Zhangyang Wang, and Jiaying Liu. "Shape-Matching GAN++: Scale Controllable Dynamic Artistic Text Style Transfer", IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.44, No.7, pp.3807-3820, July 2022.
  3. Shuai Yang†, Wenjing Wang†, and Jiaying Liu. "TE141K: Artistic Text Benchmark for Text Effect Transfer", IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.43, pp.3709-3723, Oct. 2021. (†Equal contribution)
  4. Shuai Yang, Liming Jiang, Ziwei Liu, and Chen Change Loy. "VToonify: Controllable High-Resolution Portrait Video Style Transfer", ACM Transactions on Graphics (SIGGRAPH Asia - TOG), Vol.41, No.6, pp.1-15, 2022.
  5. Shuai Yang, Zhangyang Wang, Jiaying Liu, and Zongming Guo. "Controllable Sketch-to-Image Translation for Robust Face Synthesis", IEEE Transactions on Image Processing (TIP), Vol.30, pp.8797-8810, 2021.
  6. Shuai Yang, Jiaying Liu, Wenhan Yang, and Zongming Guo. "Context-Aware Text-Based Binary Image Stylization and Synthesis", IEEE Transactions on Image Processing (TIP), Vol.28, No.2, pp.952-964, Feb. 2019.
  7. Shuai Yang, Yueyu Hu, Wenhan Yang, Ling-Yu Duan, and Jiaying Liu. "Towards Coding for Human and Machine Vision: Scalable Face Image Coding", IEEE Transactions on Multimedia (TMM), Vol.23, pp.2957-2971, Sep. 2021.
  8. Shuai Yang, Jiaying Liu, Zhouhui Lian, and Zongming Guo. "Text Effects Transfer via Distribution-Aware Texture Synthesis", Computer Vision and Image Understanding (CVIU), Vol.174, pp.43-56, Sep. 2018.
  9. Shuai Yang, Jiaying Liu, Yuming Fang, and Zongming Guo. "Joint-Feature Guided Depth Map Super-Resolution with Face Priors", IEEE Transactions on Cybernetics (TCYB), Vol.48, No.1, pp.399-411, Jan. 2018.
  10. Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, and Ziwei Liu. "Text2Human: Text-Driven Controllable Human Image Generation", ACM Transactions on Graphics (SIGGRAPH - TOG), Vol.41, No.4, pp.1-11, 2022.
  11. Xinhao Wang, Wenjing Wang, Shuai Yang, and Jiaying Liu. "CLAST: Contrastive Learning for Arbitrary Style Transfer", IEEE Transactions on Image Processing (TIP), Vol.31, pp.6761-6772, 2022.
  12. Wenjing Wang, Shuai Yang, Jizheng Xu, and Jiaying Liu. "Consistent Video Style Transfer via Relaxation and Regularization", IEEE Transactions on Image Processing (TIP), Vol.29, pp.8680-8695, 2020.
  13. Wenhan Yang, Jiaying Liu, Shuai Yang, and Zongming Guo. "Scale-Free Single Image Deraining via Visibility-Enhanced Recurrent Wavelet Learning", IEEE Transactions on Image Processing (TIP), Vol.28, No.6, pp.2948-2961, Jun. 2019.
  14. Jiaying Liu, Wenhan Yang, Shuai Yang, and Zongming Guo. "D3R-Net: Dynamic Routing Residue Recurrent Network for Video Rain Removal", IEEE Transactions on Image Processing (TIP), Vol.28, No.2, pp.699-712, Feb. 2019.
  15. Wendong Mao, Shuai Yang, Huihong Shi, Jiaying Liu, Zhongfeng Wang. "Intelligent Typography: Artistic Text Style Transfer for Complex Texture and Structure", IEEE Transactions on Multimedia (TMM), Vol. 25, pp.6485-6498, Nov. 2023.
  16. Jiaying Liu, Shuai Yang, Yuming Fang, Zongming Guo. "Structure-Guided Image Inpainting Using Homography Transformation", IEEE Transactions on Multimedia (TMM), Vol.20, No.12, pp.3252-3265, Dec. 2018.
精选会议论文:
  1. Shuai Yang, Yifan Zhou, Ziwei Liu, and Chen Change Loy. "FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  2. Shuai Yang, Yifan Zhou, Ziwei Liu, and Chen Change Loy. "Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation", ACM SIGGRAPH Asia Conference Proceedings (SIGGRAPH Asia), 2023.
  3. Shuai Yang, Liming Jiang, Ziwei Liu, and Chen Change Loy. "StyleGANEX: StyleGAN-Based Manipulation Beyond Cropped Aligned Faces", International Conference on Computer Vision (ICCV), 2023.
  4. Shuai Yang, Liming Jiang, Ziwei Liu, and Chen Change Loy. "Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  5. Shuai Yang, Liming Jiang, Ziwei Liu, and Chen Change Loy. "Unsupervised Image-to-Image Translation with Generative Prior", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  6. Shuai Yang, Zhangyang Wang, Jiaying Liu, and Zongming Guo. "Deep Plastic Surgery: Robust and Controllable Image Editing with Human-Drawn Sketches", European Conference on Computer Vision (ECCV), 2020.
  7. Shuai Yang, Zhangyang Wang, Zhaowen Wang, Ning Xu, Jiaying Liu, Zongming Guo. "Controllable Artistic Text Style Transfer via Shape-Matching GAN", IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
  8. Shuai Yang, Jiaying Liu, Wenjing Wang and Zongming Guo. "TET-GAN: Text Effects Transfer via Stylization and Destylization", AAAI Conference on Artificial Intelligence (AAAI), 2019.
  9. Shuai Yang, Jiaying Liu, Wenhan Yang, and Zongming Guo. "Context-Aware Unsupervised Text Stylization", ACM Multimedia (ACM MM), 2018.
  10. Shuai Yang, Jiaying Liu, Zhouhui Lian, and Zongming Guo. "Awesome Typography: Statistics-Based Text Effects Transfer", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  11. Xiang Gao, Shuai Yang, Jiaying Liu. "PTDiffusion: Free Lunch for Generating Optical Illusion Hidden Pictures using Phase-Transferred Diffusion Model", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
  12. Yifan Zhou, Zeqi Xiao, Shuai Yang, Xingang Pan. "Alias-free Latent Diffusion Models: Improving Fractional Shift Equivariance of Diffusion Latent Space", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2025.
  13. Yuhan Wang, Fangzhou Hong, Shuai Yang, Liming Jiang, Wayne Wu, Chen Change Loy. "MEAT: Multiview Diffusion Model for Human Generation on Megapixels with Mesh Attention", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
  14. Zeqi Xiao, Wenqi Ouyang, Yifan Zhou, Shuai Yang, Lei Yang, Jianlou Si, Xingang Pan. "Trajectory Attention for Fine-grained Video Motion Control", International Conference on Learning Representations (ICLR), 2025.
  15. Yushi Lan, Shangchen Zhou, Zhaoyang Lyu, Fangzhou Hong, Shuai Yang, Bo Dai, Xingang Pan, Chen Change Loy. "GaussianAnything: Interactive Point Cloud Latent Diffusion for 3D Generation", International Conference on Learning Representations (ICLR), 2025.
  16. Zeqi Xiao, Yifan Zhou, Shuai Yang, Xingang Pan. "Video Diffusion Models are Training-free Motion Interpreter and Controller", Advances in Neural Information Processing Systems (NeurIPS), 2024.
  17. Yifan Li, Yuhang Bai, Shuai Yang, and Jiaying Liu. "COCO-LC: Colorfulness Controllable Language-based Colorization", ACM Multimedia (ACM MM), 2024.
  18. Yushi Lan, Fangzhou Hong, Shuai Yang, Shangchen Zhou, Xuyi Meng, Bo Dai, Xingang Pan, Chen Change Loy. "LN3Diff: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation", European Conference on Computer Vision (ECCV), 2024.
  19. Yuming Jiang, Nanxuan Zhao, Qing Liu, Krishna Kumar Singh, Shuai Yang, Chen Change Loy, Ziwei Liu. "GroupDiff: Diffusion-based Group Portrait Editing", European Conference on Computer Vision (ECCV), 2024.
  20. Yuming Jiang, Tianxing Wu, Shuai Yang, Chenyang Si, Dahua Lin, Yu Qiao, Chen Change Loy, Ziwei Liu. "VideoBooth: Diffusion-based Video Generation with Image Prompts", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  21. Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, and Ziwei Liu. "Text2Performer: Text-Driven Human Video Generation", IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
  22. Yuxin Jiang, Liming Jiang, Shuai Yang, and Chen Change Loy. "Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation", IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
  23. Junzhe Zhang, Yushi Lan, Shuai Yang, Fangzhou Hong, Quan Wang, Chai Kiat Yeo, Ziwei Liu, and Chen Change Loy. "DeformToon3D: Deformable 3D Toonification from Neural Radiance Fields", IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
  24. Yushi Lan, Xuyi Meng, Shuai Yang, Chen Change Loy, and Bo Dai. "E3DGE: Self-supervised Geometry-Aware Encoder for Style-based 3D GAN Inversion", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  25. Hao Liang, Shuai Yang, Wenjing Wang and Jiaying Liu. "Instance-Aware Coherent Video Style Transfer for Chinese Ink Wash Painting", International Joint Conference on Artificial Intelligence (IJCAI), 2021.
  26. Qiyu Dai, Shuai Yang, Wenjing Wang, Wei Xiang and Jiaying Liu. "Edit Like A Designer: Modeling Design Workflows for Unaligned Fashion Editing", ACM Multimedia (ACM MM), 2021.
  27. Yu Han, Shuai Yang, Wenjing Wang, and Jiaying Liu. "From Design Draft to Real Attire: Unaligned Fashion Image Translation", ACM Multimedia (ACM MM), 2020.
  28. Yueyu Hu, Shuai Yang, Wenhan Yang, Ling-Yu Duan, and Jiaying Liu. "Towards Coding for Human and Machine Vision: A Scalable Image Coding Approach", IEEE International Conference on Multimedia & Expo (ICME), 2020. (Best Paper Award)
  29. Wenjing Wang, Jiaying Liu, Shuai Yang, and Zongming Guo. "Typography with Decor: Intelligent Text Style Transfer", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  30. Jiaying Liu, Wenhan Yang, Shuai Yang, Zongming Guo. "Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  31. Saboya Yang, Jiaying Liu, Shuai Yang, Sifeng Xia and Zongming Guo. "Hierarchical Oil Painting Stylization with Limited Reference via Sparse Representation", IEEE International Workshop on Multimedia Signal Processing (MMSP), 2015. (Top 10% Paper Awards)
书籍教材:
  1. Shuai Yang, Zhengbo Xu, Wenjing Wang, Jiaying Liu. "Artistic Text Style Transfer". ISBN: 978-1003406273, Artificial Intelligence for Art Creation and Understanding, CRC Press. 2024-08-29
  2. Ziwei Liu, Shuai Yang, Yuming Jiang, Ziqi Huang. "Generative Networks". ISBN: 978-3-031-43566-9, Handbook of Face Recognition. Springer, Cham. 2023-12-30
  3. 刘家瑛, 杨帅, 杨文瀚, 段凌宇, 《计算机视觉理论与实践》, ISBN: 9787040574463, 2022-10-01 (“智能基座”优秀教材)
授权专利:
  1. 刘家瑛, 杨帅, 杨文瀚, 郭宗明, 一种图文结合的海报生成方法和系统, ZL201811068309.9, 2023年05月02日.
  2. 刘家瑛, 胡煜章, 汪文靖, 杨帅, 郭宗明, 一种针对特效字的智能字效迁移方法, ZL201910440039.8, 2022年07月26日.
  3. 刘家瑛, 胡越予, 杨帅, 王德昭, 郭宗明, 一种可扩展人机协同图像编码方法及编码系统, ZL2019114155617, 2022年01月06日.
  4. 杨帅, 刘家瑛, 宋思捷, 郭宗明, 深度图增强方法和深度图增强装置, ZL201611093936.9, 2021年04月09日.
  5. 刘家瑛, 杨帅, 汪文靖, 郭宗明, 一种联合风格化和去风格化的艺术字编辑方法和系统, ZL201811487971.8, 2021年01月19日.
  6. 刘家瑛, 杨文瀚, 魏晨, 杨帅, 郭宗明, 视频去雨的方法、装置、设备及计算机可读存储介质, ZL201810541578.6, 2020年12月04日.
  7. 刘家瑛, 杨帅, 连宙辉, 郭宗明, 一种基于多通道的艺术字生成方法及系统, ZL201810078035.5, 2020年11月03日.
  8. 杨帅, 刘家瑛, 夏思烽, 郭宗明, 图像拼接方法及装置, ZL201710134639.2, 2020年10月16日.
  9. 杨帅, 夏思烽, 刘家瑛, 郭宗明, 多张图片融合的方法及装置, ZL201710021329.X, 2020年10月16日.
  10. 杨文瀚, 刘家瑛, 杨帅, 郭宗明, 一种基于网络图像块检索的图像重建方法及系统, ZL2015100633384.5, 2019年08月30日.
  11. 白蔚, 刘家瑛, 杨帅, 郭宗明, 一种图像风格化重建方法及装置, ZL201510379988.1, 2019年05月07日.
  12. 杨撒博雅, 刘家瑛, 杨帅, 郭宗明, 图像风格化重建的方法和装置, ZL201510045335.X, 2019年05月14日.
  13. 杨帅, 刘家瑛, 李马丁, 李翘楚, 郭宗明, 多边形检测方法和多边形检测装置, ZL201410193194.1, 2019年02月26日.
  14. 刘家瑛, 李翘楚, 李马丁, 杨帅, 郭宗明, 图像处理装置和图像处理方法, ZL 201410200267.5, 2018年04月17日.
申请专利:
  1. 杨帅, 兰晰程, 高文硕, 张璐瑶, 刘家瑛, 一种具有周期性的清晰图像生成方法, 202411823199.8, 2024年12月11日.
  2. 杨帅, 高文硕, 兰晰程, 张璐瑶, 基于隐式神经表示和文本到视频扩散模型的矢量图形动画生成方法及系统, 202411799939.9, 2024年12月09日.
  3. 刘家瑛, 李一凡, 杨帅, 一种颜色可控的文本引导灰色图着色方法及系统, 2024107362011, 2024年06月07日.
  4. 姜瑜铭, 杨帅，许统量，吴文岩，吕健勤，刘子纬，视频生成及模型训练方法、装置、设备、存储介质, 202311175888.8, 2023年09月11日.
  5. 杨帅, 蒋李鸣, 刘子纬, 吕健勤, 陶晴怡, 图像处理方法、装置、设备及存储介质, 202310355783.4, 2023年04月04日.
  6. 杨帅, 蒋李鸣, 刘子纬, 吕健勤, 张俊哲, 模型训练及图像处理方法、装置、设备及存储介质, 202310189704.7, 2023年02月08日.
  7. 杨帅, 蒋李鸣, 刘子纬, 吕健勤, 陶晴怡, 图像处理方法及装置、终端、存储介质, 202210430944.7, 2022年04月22日.
  8. 杨帅, 蒋李鸣, 刘子纬, 吕健勤, 钱晨, 图像转换方法、装置、设备及存储介质, 202210179321.7, 2022年02月25日.
  9. 刘家瑛, 梁浩, 汪文靖, 杨帅, 郭宗明, 一种基于实例分割和参考帧的水墨视频生成方法及装置, 202110571615X, 2021年05月25日.
  10. 刘家瑛, 王欣灏, 汪文靖, 杨帅, 郭宗明, 一种基于对比学习的任意风格迁移方法及系统, 202110528861.7, 2021年05月14日.

奖项荣誉

  • 2024, 王选青年教师奖, 北京大学王选计算机研究所
  • 2024, 北京市科学技术发明奖 二等奖
  • 2023, 杰出审稿人, IEEE/CVF CVPR
  • 2022, 杰出审稿人, ECCV
  • 2020, 最佳论文奖, IEEE ICME
  • 2020, 优秀博士学位论文奖, 中国图象图形学学会
  • 2020, 优秀博士学位论文奖, 北京大学
  • 2019, 学术十杰, 北京大学信息科学技术学院
  • 2018, 网络新青年形象大使, 北京大学
  • 2015, 十佳毕业论文, 北京大学信息科学技术学院
  • 2015, Top 10% 论文奖, IEEE MMSP

学术服务

学术机构任职
  • CSIG 中国图象图形学学会, 多媒体专委会委员
  • VALSE 视觉与学习青年学者研讨会, 执行领域主席委员会 EACC
领域主席 AC
  • ACM MM 2024
  • BMVC 2023/2024
资深程序委员 SPC:
  • AAAI 2022/23/24
程序委员/审稿人 PC/Reviwer:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  • IEEE Transactions on Visualization and Computer Graphics (TVCG)
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • IEEE Transactions on Multimedia (TMM)
  • CVPR 2019/20/21/22/23/24
  • ICCV 2019/21/23
  • ECCV 2020/22/24
  • SIGGRAPH 2022/23/24, SIGGRAPH Asia 2023
  • ICLR 2022/23/25
  • AAAI 2020/21
  • NeurIPS 2022/23

教学工作

  • 04831300 图像处理 (本科生课程) 2024 秋季
  • 04831750 程序设计实习 (本科生课程) 2025 春季