Rumble-2-Flash, an open-source 0.5B-parameter speech recognition model, achieves competitive accuracy with significantly smaller parameters, outperforming models 15x its size on the Open ASR Leaderboard, and reaching 7,000 RTFx throughput on full batches, translating to an hour of audio in about half a second. AI summary
Firehose
Filtered to tagged “large language models” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
This paper introduces a benchmark for automatic video rough-cut using large vision-language models, which can help improve the efficiency and quality of media production workflows. Practitioners can use this benchmark to evaluate and improve the performance of their own models on rough-cut tasks.
This paper develops a framework to adapt large language models while preserving their general capabilities, allowing for selective unlearning and learning of new capabilities. Practitioners caring about model adaptation and generalization might care about this work.
This paper presents a system called QDA that uses an agent to design the best quantization recipe for large language models, allowing for faster and more accurate quantization. Practitioners might care about QDA because it can save time and improve model accuracy, making it easier to deploy large language models in real-world applications.
This paper develops a new series of large language models (Xing 4) by optimizing architecture and training infrastructure for efficient use on specialized chips (Ascend). Practitioners may care about the techniques described here because they could improve the performance and scalability of their own AI models.
This paper investigates how large language models withhold responses under uncertainty or safety risks, and why this withholding (called abstention) is important for trustworthy models. Practitioners might care about understanding abstention to improve the reliability of language models in applications where they must make decisions that could have safety implications.