MI X

The MIx Group @ University of Birmingham

2 minutes

an img

Machine Intelligence + X,

X =

We are the Machine Intelligence + x group at the School of Computer Science, University of Birmingham. Welcome!
Our group mainly studies machine learning and computer vision, and also interested in other applied machine learning problems including multimodal data, neuroscience, healthcare, physics, chemistry, to name a few. That is where the x lies in.

Key research interests:
  • Learning representations with limited human supervision, e.g. self-/semi-/weakly-supervised learning
  • Multimodal data processing and analysis, e.g. vision-language, vision-audio, etc.
  • Open-world problems, e.g. incremental learning, open-vocabulary visual understanding
  • Visual semantics understanding, e.g. semantic segmentation, saliency modelling
  • 3D problems, e.g. depth estimation, multi-view geometry, 3D generation
  • Healthcare, e.g. medical image understanding and analysis, explanable AI for healthcare
  • AI for science, including neuroscience, physics and chemistry

News #

Oct 2023: Two papers (1 Oral 1 Poster) are accepted to WACV 2024, congrats to all the co-authors! Sep 2023: Grateful to be awarded the Royal Society Short Industry Fellowship! Aug 2023: One paper is accepted to IJCV. Congrats to all the co-authors! Jul 2023: Four papers are accepted to ICCV 2023. Congrats to all the co-authors (esp. the MSc students Hao and Chenyuan)! Apr 2023: Grateful to receive the International Exchanges Grant from The Royal Society! Apr 2023: Two papers are accepted to CVPR 2023 Workshops (Foundation Model and Sight and Sound) about self-supervised multi-modal (video-text-audio) representation learning Mar 2023: Two papers are accepted to ICLR 2023 workshops (TML4H and Neural Fields) about medical video quality assessment and neural representations in low-level vision. Congrats to Jong (PhD) and Wentian (MSc)! Oct 2022: Very glad to receive the Best Paper Award at the ECCV 2022 Workshop on Medical Computer Vision! Congrats to the PULSENet Team! Sep 2022: One paper is accepted to NeurIPS 2022 about continual learning Aug 2022: One paper is accepted to ECCV 2022 Workshop (ECCV-MCV) about anatomy-aware contrastive medical representation learning Feb 2022: Birthday of the MIx group @ the University of Birmingham

Collections

Sections

Contact and Join Us

Contact E-mail: mix.group.uk@gmail.com Join us We are always looking for people with strong self-motivation, unusual creativity, and passion for hard problems! If you share the same intetests and passion with us, please send your CV together with a short description (2 – 3 sentences) of your research interests to the above email address (with the keywords “[PhD/Postdoc/RA/Visitor/Collaboration application]” in your email subject). Prospective PhD students Please apply via the University application system here, and mention the PI’s name on your application.

2 minutes

Datasets

Scene Context-Aware Salient Object Detection ICCV, Dataset link: https://github.com/SirisAvishek/Scene_Context_Aware_Saliency This is a new dataset about salient object detection considering the scene context. For more details please refer to the paper Tactile Sketch Saliency ACM MM, Dataset link: https://bitbucket.org/JianboJiao/tactilesketchsaliency/src/master/ This is a new dataset about tactile saliency on sketch data, i.e. measuring which region is more likely to be touched on the object depicted by a sketch. For more details pelase refer to the paper Attention Shift Saliency Ranks CVPR, Dataset link: https://cove.

1 minute

Projects

COMPaD: Commercial-Oriented Multi-modal Poster Generation and Design The Royal Society, PI The poster design market for commercial users has long thrived, but traditional user-designer collaboration often suffers from time-consuming and inefficient communication, resulting in compromised designs. This creates a pressing need for an automated and user-friendly solution for commercial poster generation. Recent advancements in artificial intelligence (AI) have shown great promise in generating high-quality content. In this collaborative research, we aim to make a step forward towards bridging this gap.

3 minutes

Publications

*Equal contribution Disentangled Pre-training for Image Matting Yanda Li, Zilong Huang, Gang Yu, Ling Chen, Yunchao Wei, Jianbo Jiao IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Oral Presentation (2.5%), 2024 [PDF] [BibTeX] [Code] [Project Page] FreMIM: Fourier Transform Meets Masked Image Modeling for Medical Image Segmentation Wenxuan Wang*, Jing Wang*, Chen Chen, Jianbo Jiao, Yuanxiu Cai, Shanshan Song, Jiangyun Li IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024 [PDF] [BibTeX] [Code] [Project Page] Inferring Attention Shifts for Salient Instance Ranking Avishek Siris, Jianbo Jiao, Gary K.

3 minutes

Team Members

Jianbo Jiao Principle Investigator Jianbo is an Assistant Professor in the School of Computer Science at the University of Birmingham, a Royal Society Short Industry Fellow, and a visiting researcher at the University of Oxford. Cai Wingfield Research Fellow (2023 -), MI n Cai is a Senior Research Data Scientist with the Interdisciplinary Institute for Data Science and AI (IIDSAI) at the University of Birmingham. He received his PhD in theoretical computer science at the University of Bath, and has worked as a researcher in cognitive science at the universities of Cambridge and Lancaster.

4 minutes