Scaling Remote Sensing Foundation Models: Data-Driven Insights
Analysis
Key Takeaways
- •Explores scaling behaviors of vision transformers on petascale remote sensing data.
- •Identifies a data-limited regime, suggesting data collection is more critical than model size.
- •Provides practical insights for data collection, compute budgets, and optimization schedules for future RS foundation models.
“Performance is consistent with a data limited regime rather than a model parameter-limited one.”