CVM Lab @ IIT

Computer Vision and Multimedia Laboratory

Department of Computer Science, Illinois Institute of Technology



About Our Lab

Our Computer Vision and Multimedia Laboratory (CVM-Lab) is affiliated with IIT (Illinois Institute of Technology) at Chicago, IL. Our research work is committed to enabling machines with the ability to intelligently perceive, understand and interact with humans and the real world via multiple sensory information from vision, language, audio, and other sources. Concretely, we aim to develop theoretical and practical research projects for multimodal learning and its various applications, biomedical image analysis, and neural network compression.

Our CVM-Lab activity collaborates with other laboratories and industries, and always looks for postdoc research fellows and prospective Ph.D. students to join us. Please contact Prof. Yan Yan at yyan34@iit.edu with your CV for opening positions.

Lab News

02-2024: Five papers accepted to CVPR 2024.

12-2023: One paper accepted to FG 2024.

12-2023: One paper accepted to ICASSP 2024.

10-2023: One paper accepted to WACV 2024.

07-2023: Two papers accepted to ICCV 2023.

02-2023: One paper accepted to CVPR 2023.

01-2023: One paper accepted to ICLR 2023.

10-2022: One paper accepted to WACV 2023.

07-2022: Four papers accepted to ECCV 2022.

06-2022: One paper accepted to ACM Multimedia 2022.

Lab Members

Prof. Yan Yan
Assistant Professor
Bin Duan
Ph.D. student, IIT
Yuzhang Shang
Ph.D. student, IIT
Changchang Sun
Ph.D. student, IIT
Bin Xie
Ph.D. student, IIT
Mark Leischner (Part-Time)
Ph.D. student, IIT
Jianyuan Ni
Ph.D. student, TX State
Zhenghao Zhao
Ph.D. student, IIT
Weitai Kang
Ph.D. student, IIT
Junyi Wu
Ph.D. student, IIT
Gengyu Zhang
Ph.D. student, IIT
Kaiang Wen
Ph.D. student, IIT
Haoxuan Wang
Ph.D. student, IIT
Feiran Wang
Ph.D. student, IIT

Ye Zhu, PhD student during 09/2020-09/2023. Postdoc Researcher, Princeton University.

Keshav Bhandari, PhD student during 09/2018-07/2022. Data Scientist, Tesla.

Gaowen Liu, visiting during 09/2018-09/2020. Data Scientist, Cisco.

Aihua Zheng, visiting during 09/2019-08/2020. Associate Professor, Anhui University.

Xianjing Han, visiting during 09/2019-08/2020. Ph.D. Student, Shandong University.

Na Zheng, visiting during 09/2019-08/2020. Ph.D. Student, Shandong University.

Songsong Wu, visiting during 08/2018-09/2019. Associate Professor, Guangdong University of Petrochemical Technology.

Hao Tang, visiting during 06/2018-05/2019. Postdoc, ETH CV Lab.

Yutian Lin, visiting during 09/2018-03/2019. Associate Professor, Wuhan University.

Research Works

  • Selected
  • All

Causal-DFQ: Causality Guided Data-free Network Quantization

Yuzhang Shang, Bingxin Xu, Gaowen Liu, Ramana Rao Kompella, Yan Yan

International Conference on Computer Vision (ICCV), 2023

Towards Saner Deep Image Registration

Bin Duan, Ming Zhong, Yan Yan

International Conference on Computer Vision (ICCV), 2023

Post-training Quantization on Diffusion Models

Yuzhang Shang*, Zhihang Yuan*, Bin Xie, Bingzhe Wu, Yan Yan

Computer Vision and Pattern Recognition (CVPR), 2023

Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation

Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan

International Conference on Learning Representations (ICLR), 2023

Lipschitz Continuity Retained Binary Neural Network

Yuzhang Shang, Dan Xu, Bin Duan, Ziliang Zong, Liqiang Nie, Yan Yan

European Conference on Computer Vision (ECCV), 2022

Network Binarization via Contrastive Learning

Yuzhang Shang, Dan Xu, Ziliang Zong, Liqiang Nie, Yan Yan

European Conference on Computer Vision (ECCV), 2022

Quantized GAN for Complex Music Generation from Dance Videos

Ye Zhu, Kyle Olszewski, Yu Wu, Panos Achlioptas, Menglei Chai, Yan Yan, and Sergey Tulyakov

European Conference on Computer Vision (ECCV), 2022

Learning Omnidirectional Flow in 360-degree Video via Siamese Representation

Keshav Bhandari, Bin Duan, Gaowen Liu, Hugo Latapie, Ziliang Zong, Yan Yan

European Conference on Computer Vision (ECCV), 2022

LONDON: Lipschitz Continuity Guided Knowledge Distillation

Yuzhang Shang, Bin Duan, Ziliang Zong, Liqiang Nie, and Yan Yan

International Conference on Computer Vision (ICCV), 2021

Saying the Unseen: Video Descriptions via Dialog Agents

Ye Zhu, Yu Wu, Yi Yang, and Yan Yan

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021

Unsupervised Neural Tracing In Densely Labeled Multispectral Brainbow Images

Bin Duan, Logan Walker, DouglasRoossien, Fred Shen, Dawen Cai, Yan Yan

IEEE International Symposium on Biomedical Imaging (ISBI), 2021

Learning Audio-Visual Correlations From Variational Cross-Modal Generations

Ye Zhu, Yu Wu, Hugo Latapie, Yi Yang, and Yan Yan

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021

Revisiting Optical Flow Estimation in 360 Videos

K. Bhandari, Z. Zong, and Yan Yan

International Conference on Pattern Recognition (ICPR), 2020

Audio-Visual Event Localization via Recursive Fusion by Joint Co-Attention

Bin Duan, Hao Tang, Wei Wang, Ziliang Zong, Guowei Yang, Yan Yan

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020

EGOK360: A 360 Egocentric Kinetic Human Activity Video Dataset

K. Bhandari, Mario A. DeLaGarza, Z. Zong, Hugo Latapie, Y. Yan

International conference on Image Processing (ICIP), 2020

Hierarchical HMM for Eye Movement Classifications

Ye Zhu, Yu Wu, Hugo Latapie, Yi Yang, and Yan Yan

European Conference on Computer Vision Workshop (ECCV Workshop), 2020

An IoT Edge Computing Framework Using Cordova Accessor Host

Ngu, A. H., Eyitayo, J., Yang, G., Campbell, C., Sheng, Q. Z., and Ni, J.

IEEE Internet of Things Journal