Data, not algorithms, drives AI value. Companies like Amazon, Google, and Microsoft excel due to proprietary high-quality datasets. Data quality is crucial for AI success, making it the strategic asset for competitive advantage in the 21st century.
Google DeepMind introduces Gemini Robotics-ER 1.6, an upgrade enhancing robot reasoning capabilities for real-world tasks. The model acts as a high-level strategist, guiding physical actions through advanced spatial reasoning and instrument reading.
Researchers from UC San Diego and Together AI introduce Parcae, a looped transformer architecture that outperforms prior models, using the same parameters and training data. Parcae's design addresses memory constraints and enables more compute per forward pass, solving stability issues seen in past looped models.
Automated Reasoning checks in Amazon Bedrock Guardrails ensure mathematically proven, auditable AI outputs for regulated industries. By using formal verification methods, compliance teams can achieve provably correct results, addressing the limitations of probabilistic AI validation.
ChatGPT shows bias against non-"standard" English varieties, with responses exhibiting stereotypes and condescension. Study prompts GPT-3.5 Turbo and GPT-4 with 10 English varieties, revealing retention of Standard American English features.
An encoder maps objects to noiseless images, quantifying how well measurements distinguish objects. AI can extract useful information even when encoded in ways humans cannot interpret, optimizing imaging systems based on their information content.
Training a modern large language model involves pretraining for general language patterns, followed by supervised fine-tuning for specific tasks. Techniques like LoRA and RLHF refine the model, leading to deployment in real-world systems for optimal performance and value delivery.
Recent advances in Large Language Models (LLMs) enable exciting integrated applications, but prompt injection attacks pose a major threat. StruQ and SecAlign are proposed defenses to mitigate prompt injection threats in LLM systems like Google Docs and ChatGPT.
New divide and conquer RL algorithm challenges traditional TD learning, offering scalability to long-horizon tasks. Off-policy RL allows flexibility with old data, crucial for complex domains like robotics and healthcare.
PLAID, a model that generates protein sequences and structures, reflects AI's role in biology. The model addresses challenges like all-atom generation and organism specificity, aiming to generate useful proteins efficiently.
Understanding complex machine learning systems like Large Language Models (LLMs) is crucial for AI. New algorithms like SPEX and ProxySPEX aim to identify critical interactions at scale by measuring influence through ablation, isolating drivers of decisions with the fewest possible perturbations.
Researchers have uncovered the learning dynamics of word2vec, revealing its linear structure and sequential steps. The algorithm's minimal neural model provides insights into feature learning in advanced language tasks.
AI tool assists BBFC in classifying UK HBO Max TV shows like The Pitt and Game of Thrones spinoff by flagging contentious scenes for human review. Tool helps identify compliance issues like violence, nudity, and bad language.
British AI company Narwhal Labs faces backlash over sexist ad claiming 'AI employee' outworks everyone without asking for a raise. Advertising Standards Authority receives complaints about campaign featuring controversial strapline.
Data centers have shifted to AI token factories, focusing on cost per token rather than raw compute power. NVIDIA offers the lowest cost per token in the industry, maximizing revenue and profit margins.