Characterizing Transfer Learning with Multi-task Learning Curves
Analysis
Key Takeaways
- •Proposes a method to characterize transfer learning using multi-task learning curves.
- •Focuses on perturbing the dataset size rather than model updates.
- •Offers a quantitative approach to assess transfer effects.
- •Evaluated on a drug-target interaction dataset.
- •Highlights the ability to delineate pairwise and contextual transfer effects.
“Learning curves can better capture the effects of multi-task learning and their multi-task extensions can delineate pairwise and contextual transfer effects in foundation models.”