Research

Selected Publications:

2021

  • Xiu-Shen Wei, Yi-Zhe Song, Oisin Mac Aodha, Jianxin Wu, Yuxin Peng, Jinhui Tang, Jian Yang, Serge Belongie, Fine-Grained Image Analysis with Deep Learning: A Survey, TPAMI 2021
  • Anran Qi, Yulia Gryaditskaya, Jifei Song, Yongxin Yang, Yonggang Qi, Timothy M. Hospedales, Tao Xiang, Yi-Zhe Song, Towards Fine-Grained Sketch-Based 3D Shape Retrieval, TIP 2021
  • Ling Luo, Yulia Gryaditskaya, Yongxin Yang, Tao Xiang, Yi-Zhe Song, Fine-Grained VR Sketching: Dataset and Insights, 3DV 2021
  • Lan Yang, Kaiyue Pang, Honggang Zhang, Yi-Zhe Song, SketchAA: Abstract Representation for Abstract Sketches, ICCV 2021
  • Yonggang Qi, Guoyao Su, Pinaki Nath Chowdhury, Mingkang Li, Yi-Zhe Song, SketchLattice: Latticed Representation for Sketch Manipulation, ICCV 2021
  • Ayan Kumar Bhunia, Aneeshan Sain, Pinaki Nath Chowdhury, Yi-Zhe Song, Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillation, ICCV 2021
  • Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Yi-Zhe Song, Towards the Unseen: Iterative Text Recognition by Distilling from Errors, ICCV 2021
  • Ayan Kumar Bhunia, Aneeshan Sain, Amandeep Kumar, Shuvozit Ghose, Pinaki Nath Chowdhury, Yi-Zhe Song, Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognition, ICCV 2021
  • Dongliang Chang, Kaiyue Pang, Yixiao Zheng, Zhanyu Ma, Yi-Zhe Song, Jun Guo, Your “Flamingo” is My “Bird”: Fine-Grained, or Not, CVPR 2021 (Oral)
  • Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting, CVPR 2021
  • Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Cloud2Curve: Generation and Vectorization of Parametric Sketches, CVPR 2021
  • Aneeshan Sain, Ayan Kumar Bhunia, Yongxin Yang, Tao Xiang, Yi-Zhe Song, StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval, CVPR 2021
  • Yonggang Qi, Kai Zhang, Aneeshan Sain, Yi-Zhe Song, PQA: Perceptual Question Answering, CVPR 2021
  • Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Yongxin Yang, Tao Xiang, Yi-Zhe Song, More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch-Based Image Retrieval, CVPR 2021
  • Ayan Kumar Bhunia, Shuvozit Ghose, Amandeep Kumar, Pinaki Nath Chowdhury, Aneeshan Sain, Yi-Zhe Song, MetaHTR: Towards Writer-Adaptive Handwritten Text Recognition, CVPR 2021
  • Anran Qi, Yulia Gryaditskaya, Jifei Song, Yongxin Yang, Yonggang Qi, Timothy M. Hospedales, Tao Xiang, Yi-Zhe Song, Towards Fine-Grained Sketch-Based 3D Shape Retrieval, IEEE Transactions on Image Processing (IEEE TIP), 2021

2020

  • Ling Luo, Yulia Gryaditskaya, Yongxin Yang, Tao Xiang, Yi-Zhe Song, Towards 3D VR-Sketch to 3D Shape Retrieval, 3DV 2020 (Oral)
  • Yue Zhong, Yulia Gryaditskaya, Honggang Zhang, Yi-Zhe Song, Deep Sketch-Based Modelling: Tips and Tricks, 3DV 2020
  • Guoyao Su, Yonggang Qi, Kaiyue Pang , Jie Yang, Yi-Zhe Song, SketchHealer: A Graph-to-Sequence Network for Recreating Partial Human Sketches, BMVC 2020 (Oral)
  • Aneeshan Sain, Ayan Kumar Bhunia, Yongxin Yang, Tao Xiang, Yi-Zhe Song, Cross-Modal Hierarchical Modelling for Fine-Grained Sketch Based Image Retrieval, BMVC 2020 (Oral)
  • Ayan Kumar Bhunia*, Ayan Das*, Umar Riaz Muhammad*, Yongxin Yang, Timothy M. Hospedales, Tao Xiang, Yulia Gryaditskaya, Yi-Zhe Song . Pixelor: A Competitive Sketching AI Agent. So you think you can beat me? SIGGRAPH Asia 2020
  • Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, BézierSketch: A generative model for scalable vector sketches, ECCV 2020
  • Jianshu Zhang, Jun Du, Yongxin Yang, Yi-Zhe Song, Si Wei, Lirong Dai, A Tree-Structured Decoder for Image-to-Markup Generation, ICML 2020
  • Kaiyue Pang, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Solving Mixed-modal Jigsaw Puzzle for Fine-Grained Sketch-Based Image Retrieval, CVPR 2020
  • Ayan Kumar Bhunia, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrieval, CVPR 2020 (Oral)

2019

  • Da Li, Jianshu Zhang, Yongxin Yang, Cong Liu, Yi-Zhe Song, Timothy Hospedales, Episodic Training for Domain Generalization, International Conference on Computer Vision (ICCV 2019, Oral)
  • Umar Riaz Muhammad, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Goal-Driven Sequential Data Abstraction, International Conference on Computer Vision (ICCV 2019)
  • Kaiyue Pang, Ke Li, Yongxin Yang, Timothy  Hospedales, Tao Xiang, Yi-Zhe Song, Generalising Fine-Grained Sketch-Based Image Retrieval, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019) 
  • Jifei Song, Yongxin Yang, Yi-Zhe Song, Tao  Xiang, Timothy  Hospedales, Generalizable Person Re-identification by Domain-Invariant Mapping Network, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019)
  • Sounak Dey, Pau Riba, Anjan Dutta, Josep Llados, Yi-Zhe Song, Doodle to Search: Practical Zero-Shot Sketch-based Image Retrieval, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019, Oral)
  • K. Li, K. Pang, Y. Song, T. Xiang, T. M. Hospedales, H. Zhang, Towards A Deep Universal Sketch Perceptual Grouper, IEEE Transactions on Image Processing (IEEE TIP)

2018

  • Kaiyue Pang, Da Li, Jifei Song, Yi-Zhe Song, Tao Xiang, Timothy Hospedales, Deep Factorised Inverse-Sketching, European Conference on Computer Vision (ECCV 2018)
  • Changqing Zou*, Qian Yu*, Ruofei Du, Haoran Mo, Yi-Zhe Song, Tao Xiang, Chengying Gao, Baoquan Chen, and Hao Zhang, SketchyScene: Richly-Annotated Scene Sketches, European Conference on Computer Vision (ECCV 2018)
  • Ke Li, Kaiyue Pang, Jifei Song, Yi-Zhe Song, Tao Xiang, Timothy Hospedales, Universal Sketch Perceptual Grouping, European Conference on Computer Vision (ECCV 2018)
  • Jifei Song, Kaiyue Pang, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Learning to Sketch with Shortcut Cycle Consistency, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
  • Conghui Hu, Da Li, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Sketch-a-Classifier: Sketch-based Photo Classifier Generation, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018, Spotlight)
  • Umar Muhammad, Yongxin Yang, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Learning Deep Sketch Abstraction, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
  • Peng Xu, Yongye Huang, Tongtong Yuan, Kaiyue Pang, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Zhanyu Ma, Jun Guo, SketchMate: Deep Hashing for Million-Scale Human Sketch Retrieval, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
  • Da Li, Yongxin Yang, Yi-Zhe Song and Timothy M. Hospedales, Learning to Generalize: Meta-Learning for Domain Generalization, AAAI Conference on Artificial Intelligence (AAAI 2018)
  • L Pang, Y Wang, YZ Song, T Huang, Y Tian, Cross-Domain Adversarial Feature Learning for Sketch Re-identification, ACM Multimedia Conference on Multimedia (ACM MM 2018)
     

2017

  • Da Li, Yongxin Yang, Yi-Zhe Song and Timothy M. Hospedales, Deeper, Broader and Artier Domain Generalization, International Conference on Computer Vision (ICCV 2017)
  • Jifei Song∗, Qian Yu∗, Yi-Zhe Song, Tao Xiang and Timothy M. Hospedales, Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval, International Conference on Computer Vision (ICCV 2017) (* Equal Contribution)
  • Kaiyue Pang, Yi-Zhe Song, Tao Xiang and Timothy M. Hospedales, Cross-domain Generative Learning for Fine-Grained Sketch-Based Image Retrieval, British Machine Vision Conference (BMVC 2017), Poster
  • Conghui Hu, Da Li, Yi-Zhe Song and Timothy M. Hospedales, Now You See Me: Deep Face Hallucination for Unviewed Sketches, British Machine Vision Conference (BMVC 2017, Oral),
  • Jifei Song, Yi-Zhe Song, Tao Xiang and Timothy M. Hospedales, Fine-Grained Image Retrieval: the Text/Sketch Input Dilemma, British Machine Vision Conference (BMVC 2017), Poster
  • Ke Li, Kaiyue Pang, Yi-Zhe Song, Timothy M. Hospedales, Tao Xiang, Honggang Zhang, Synergistic Instance-Level Subspace Alignment for Fine-Grained Sketch-based Image Retrieval, IEEE Transactions on Image Processing (IEEE TIP)

2016

  • S Ouyang, T Hospedales, YZ Song, X Li, CC Loy, X Wang, A survey on heterogeneous face recognition: Sketch, infra-red, 3D and low-resolution, Image and Vision Computing
  • Y. Li, Y-Z. Song, T. Hospedales and S. Gong, Free-hand sketch synthesis with deformable stroke models,  International Journal of Computer Vision (IJCV)
  • Qian Yu, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales, Chen Change Loy, Sketch Me That Shoe, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016, Oral)
  • Shuxin Ouyang, Timothy M. Hospedales, Yi-Zhe Song and Xueming Li, ForgetMeNot: Memory-Aware Forensic Facial Sketch Matching, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016, Spotlight)
  • J. Song, Y-Z. Song, T. Xiang, T. Hospedales and X. Ruan, Deep Multi-task Attribute-driven Ranking for Fine-grained Sketch-based Image Retrieval, British Machine Vision Conference (BMVC 2016, Oral)
  • Q. Yu, Y. Yang, F. Liu, Y-Z. Song, T. Xiang and T. Hospedales, Sketch-a-Net: a Deep Neural Network that Beats Humans, International Journal of Computer Vision (IJCV)
  • Ke Li, Kaiyue Pang, Yi-Zhe Song, Timothy Hospedales, Honggang Zhang and Yichuan Hu, Fine-Grained Sketch-Based Image Retrieval: The Role of Part-Aware Attributes, IEEE Winter Conference on Applications of Computer Vision (WACV 2016)
  • Yonggang Qi, Yi-Zhe Song, Honggang Zhang, Jun Liu, Sketch-Based Image Retrieval via Siamese Convolutional Neural Network, IEEE International Conference on Image Processing (ICIP 2016)

2015

  • Q. Yu, Y. Yang, Y-Z. Song, T. Xiang and T. Hospedales, Sketch-a-Net that Beats Humans, British Machine Vision Conference (BMVC 2015, Best Paper Award)
  • Yonggang Qi, Yi-Zhe Song, Tao Xiang, Honggang Zhang, Timothy Hospedales, Yi Li and Jun Guo, Making Better Use of Edges via Perceptual Grouping, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015)
  • Yi Li, Timothy M. Hospedales, Yi-Zhe Song and Shaogang Gong, Free-hand Sketch Recognition by Multi-Kernel Feature Learning, Computer Vision and Image Understanding (CVIU)
  • Yonggang Qi, Jun Guo, Yi-Zhe Song, Tao Xiang, Honggang Zhang, Zheng-Hua Tan, Im2Sketch: Sketch generation by unconflicted perceptual grouping, Neurocomputing

2014

  • S. Ouyang, T. Hospedales, Y.-Z. Song and X. Li, Cross-Modal Face Matching: Beyond Viewed Sketches, Asian Conference on Computer Vision (ACCV 2014)
  • S. Ouyang, T. Hospedales, Y.-Z. Song and X. Li, A Survey on Heterogeneous Face Recognition: Sketch, Infra-red, 3D and Low-resolution, Image and Vision Computing (IVC)
  • Y. Li, T. Hospedales, Y.-Z. Song and S. Gong, Fine-grained sketch-based image retrieval by matching deformable part models, British Machine Vision Conference (BMVC 2014)

2013

  • Yonggang Qi, Jun Guo, Yi Li, Honggang Zhang, Tao Xiang, Yi-Zhe Song, Sketching by perceptual grouping, IEEE International Conference on Image Processing (ICIP 2013)
  • Yi Li, T. Hospedales, Yi-Zhe Song, Shaogang Gong, Sketch Recognition by Ensemble Matching of Structured Features, British Machine Vision Conference (BMVC 2013)
  • Yi-Zhe Song, David Pickup, Chuan Li, Paul Rosin, Peter S Hall, Abstract art by shape classification, IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG)