GrowTAS: Efficient ViT Architecture Search via Progressive Subnet Expansion

The article proposes a novel approach, GrowTAS, for efficient architecture search in Vision Transformers (ViTs). This method leverages progressive expansion from smaller to larger subnets.

• •GrowTAS focuses on improving the efficiency of ViT architecture search.
• •The core idea is a progressive expansion strategy based on subnets.
• •The paper is published on ArXiv, a pre-print server, indicating it's research in progress.