Resource

  

Research and Innovation

Top 40 CVPR posters (11 minute read) A list of curated computer vision papers from the 2024 CVPR conference.

Toucan TTS in 7000 languages (GitHub Repo) Toucan recently released a set of new text-to-speech models that it has extended to work with every ISO-639-3 standard language.

Engineering & Resources:

1300 tokens per second on Mac (7 minute read) Implementing batch parallel KV cache in MLX leads to dramatic inference time speed up for synthetic data generation and model completions.

Mixture of Attention in LLMs (GitHub Repo) The Mixture of Attention (MoA) approach optimizes sparse attention in large language models by tailoring unique sparse attention configurations for different heads and layers.

Train vision models in TRL (GitHub Repo) TRL is a Hugging Face library for training transformers with reinforcement learning. This example allows you to also perform the same process for vision-based language models like LLaVA. Remote Sensing Change Detection (18 minute read) This project introduces CDMask and CDMaskFormer, two new models for remote sensing change detection. Apple Intelligence (14 minute read) Apple has integrated generative AI into its core applications, enhancing features like Safari summaries, Mail categorization, and Siri's functionality, rather than creating standalone AI products, showcasing the company's focus on privacy and user control. Llama TTF (3 minute read) This post shows how to run a small Llama language model in a font file. Ability AI raises $1.1m pre-seed round (4 minute read) Ability AI, a marketing startup, has raised a round to build its marketing agent technologies. June (GitHub Repo) June is a local voice chatbot that combines the power of Ollama, Hugging Face Transformers, and the Coqui TTS Toolkit.