Multi(Modal) Data in Healthcare – The Roadmap Towards Patient-Centered AI Systems

Dr Catarina Barata

Institute for Systems and Robotics (ISR | Lisboa)

Resumen/Abstract

We live in an increasingly digital world, where large amounts of information are generated and stored every day. One such example is the medical field, where technological advances have played a significant role, making it possible to digitalize and store healthcare data. Electronic health records (EHRs), which serve as digital repositories, allow the tracking of patients’ entire healthcare journeys across various settings and providers. Large biobanks offer complete populational healthcare views, covering specific areas like oncology and cardiology. Finally, the rising of public repositories for medical images and genome/microbiome sequencing facilitated the access to healthcare data. All combined, we are living an exciting era for computer vision and machine learning (ML) in medicine, where researchers are moving from narrowly defined tasks, which used a single type of healthcare data, to broader challenges, such as predicting treatment responses, that require a more centered view of the patient. This is only accomplished when integrating data from multiple sources, as well as from different time stamps, which poses new and exciting challenges for ML systems. In this talk I will provide a roadmap on the integration of multi healthcare data, from data representation to its fusion in multimodal and longitudinal ML systems, using examples of our recent work to showcase opportunities and obstacles currently faced by ML methods. Profesor proponente EPS: Marcos Escudero.

Curriculum ponente

Catarina Barata (CB) is an Assistant Professor at IST and Researcher at ISR, where she is currently a member of its scientific committee. She is a Scholar Member of the European Laboratory for Learning and Intelligent Systems (ELLIS) and its Lisbon Unit (LUMLIS). Her main line of research focuses on the application of machine learning models to societal problems, mainly healthcare, aiming for development of explainable artificial intelligence models. In 2021 she received a Google Research Award for her work in personalizing treatment for skin cancer patients, where she addressed the identification of molecular biomarkers across various imaging modalities. She participated in several research projects, being PI of one of them (DeepMutation) and co-PI of ISR for the Center for Responsible AI, a consortium of companies, startups and research units funded by the RRP. Presently she is the PI of two national projects (OptSurgAI and MMIST) and the ISR-coordination of an European Project (NextGenTools), all focusing on the development of multimodal systems in different healthcare applications She currently supervises two PhD students (plus one concluded), having also supervised more than 30 master theses and one visiting professor, published 20articles in scientific journals, and presented more than 40 papers at international conferences. She is involved in the organization of the annual ISIC Workshop at top conferences, including CVPR, ECCV, MICCAI.