GrowTAS: Efficient ViT Architecture Search via Progressive Subnet Expansion

The article proposes a novel approach, GrowTAS, for efficient architecture search in Vision Transformers (ViTs). This method leverages progressive expansion from smaller to larger subnets.