Block-sparse GPU kernels
Published:Dec 6, 2017 08:00
•1 min read
•OpenAI News
Analysis
This article announces the release of optimized GPU kernels for block-sparse neural networks. The key claim is significant performance improvement over existing libraries like cuBLAS and cuSPARSE, with demonstrated success in text sentiment analysis and generative modeling. The focus is on technical innovation and performance gains.
Key Takeaways
- •OpenAI is releasing highly-optimized GPU kernels.
- •These kernels are designed for block-sparse neural networks.
- •They offer significant performance improvements over existing libraries.
- •Demonstrated success in text sentiment analysis and generative modeling.
Reference
“Depending on the chosen sparsity, these kernels can run orders of magnitude faster than cuBLAS or cuSPARSE.”