Researchers from Sakana AI and NVIDIA tackle the high cost of large language models by targeting feedforward layer inefficiencies. Utilizing unstructured sparsity, they aim to make computations within these layers more efficient, focusing on batched training and high-throughput inference.
Companies like Meta and Google are using large language models to train smaller, more efficient models through LLM distillation. Soft-label distillation allows student models to inherit reasoning capabilities from teachers, improving training stability and efficiency.
Exa's integration with Strands Agents SDK streamlines AI agents' access to structured web content for seamless decision-making. Strands Agents SDK's model-driven architecture enhances agent capabilities with over 40 pre-built tools and support for MCP servers.
Miro partners with AWS to develop BugManager, an AI-powered solution for automated bug triaging, reducing reassignments and time-to-resolution. BugManager uses optimized prompts and Retrieval Augmented Generation (RAG) for higher accuracy in bug classification.
NVIDIA CEO Jensen Huang highlights the beginning of the AI revolution at Carnegie Mellon commencement. AI offers America a chance to reindustrialize and create opportunities for all.
NVIDIA introduces Star Elastic, a method to embed multiple nested submodels in one parent model, reducing training and deployment costs for large language models. Star Elastic utilizes importance estimation and trainable routers to create nested variants with different parameter budgets in one checkpoint.
Anthropic's new Natural Language Autoencoders (NLAs) translate complex model activations into readable text, revealing hidden internal reasoning. NLAs are already being used to catch cheating models and fix language bugs before public release.
Halliburton partners with AWS to develop an AI-powered assistant for Seismic Engine, reducing workflow creation time by up to 95%. Geoscientists can now configure processing tools through natural language interaction, improving efficiency and accessibility.
Recent advancements in adaptive parallel reasoning allow models to independently decompose and coordinate subtasks, leading to improved reasoning capabilities and reduced latency in complex tasks. Models now explore alternative hypotheses and correct mistakes, synthesizing conclusions without committing to a single solution, revolutionizing math, coding, and agentic benchmarks.
Automation has led to income inequality growth in the U. S. since 1980 by replacing higher-paid workers, impacting productivity. Study by MIT's Daron Acemoglu & Yale's Pascual Restrepo highlights firms' inefficient automation targeting.
AI agents are evolving to autonomously complete complex tasks. Amazon Bedrock AgentCore introduces payment capabilities for agents in partnership with Coinbase and Stripe, streamlining transactions and enhancing developer efficiency.
Meta AI team introduces NeuralBench, a comprehensive open-source framework for evaluating AI models of brain activity, addressing the fragmented NeuroAI evaluation landscape. NeuralBench-EEG v1.0 is the largest benchmark of its kind, covering 36 tasks, 94 datasets, and 14 deep learning architectures under a standardized interface.
Implementing Reinforcement Learning with Verifiable Rewards (RLVR) improves training performance by introducing transparency into reward signals. Techniques like GRPO and few-shot examples enhance results, demonstrated with the GSM8K dataset for math problem solving accuracy.
Inference efficiency is a key bottleneck in AI deployment as agentic coding systems like Claude Code, Codex, and Cursor strain underlying inference engines. TokenSpeed, an open-source LLM inference engine by LightSeek Foundation, maximizes per-GPU TPM and per-user TPS for agentic workloads with five interlocking subsystems.
Zyphra AI releases ZAYA1-8B, a high-performing MoE language model with 760M active parameters. It outperforms larger models on math tasks and features innovative architecture for efficient inference.