Taming arXiv with Natural Language Processing w/ John Bohannon - TWiML Talk #136

This podcast episode from Practical AI features John Bohannon, Director of Science at AI startup Primer. The discussion centers on Primer Science, a tool designed to manage the overwhelming volume of machine learning papers on arXiv. The tool uses unsupervised learning to categorize content, generate summaries, and track activity in different innovation areas. The conversation delves into the technical aspects of Primer Science, including its data pipeline, the tools employed, the methods for establishing 'ground truth' for model training, and the use of heuristics to enhance NLP processing. The episode highlights the challenges of keeping up with the rapid growth of AI research and the innovative solutions being developed to address this issue.

• •Primer Science uses unsupervised learning to categorize and summarize research papers on arXiv.
• •The tool addresses the challenge of managing the vast amount of machine learning papers.
• •The episode discusses the technical details of the tool's data pipeline, model training, and use of heuristics.