Advancing Ultrasound Medical Continuous Learning with Task-Specific Generalization and Adaptability
Abstract
As artificial intelligence progresses in the field of medical ultrasound image analysis, mitigating catastrophic forgetting during continuous learning processes in disease diagnosis and fetal ultrasound assistance is crucial. Inspired by the significant performance improvements achieved in various downstream visual tasks through advanced visual representations, we introduce a novel approach called Masked Ultrasound Image Modeling (MUIM) to prevent forgetting of new disease diagnosis tasks. In this approach, MUIM initially pre-trains on ultrasound images specific to the current task. By utilizing a masked autoencoder to train on unlabeled ultrasound images, it learns highly abstract representations of task-relevant information. To ensure the model’s adaptability to new tasks, we propose contrastive Historical-Current Learning strategy, which enhances the model’s ability to retain and integrate knowledge from previous tasks while learning new ones. By incorporating knowledge distillation loss and the exponential moving average (EMA) technique for joint inference and continuously updating new knowledge into the historical expert model, our approach enables the model to adaptively learn new tasks while preventing forgetting of old ones.
This work addresses catastrophic forgetting in ultrasound medical image analysis with masked ultrasound image modeling and contrastive historical-current learning.
