MIT's Improbable AI Lab has developed a multimodal framework called HiP, which uses three different foundation models to help robots create detailed plans for complex tasks. Unlike other models, HiP does not require access to paired vision, language, and action data, making it more cost-effective and transparent.
This article explores methods for creating fine-tuning datasets to generate Cypher queries from text, utilizing large language models (LLMs) and a predefined graph schema. The author also mentions an ongoing project that aims to develop a comprehensive fine-tuning dataset using a human-in-the-loop approach.
Researchers at MIT and IBM have developed a new method called "physics-enhanced deep surrogate" (PEDS) that combines a low-fidelity physics simulator with a neural network generator to create data-driven surrogate models for complex physical systems. The PEDS method is affordable, efficient, and reduces the training data needed by at least a factor of 100 while achieving a target error of 5 per...
Developers of open world video games and analytics managers both face the challenge of balancing exploration and exploitation. To solve this tension, they can build alternative paths, offer knowledge management systems, foster online communities, and make continuous improvements. Salespeople, like gamers, have main quests in the form of specific metrics they need to track, so creating simple an...
The aviation industry has a fatality risk of 0.11, making it one of the safest modes of transportation. MIT scientists are looking to aviation as a model for regulating AI in healthcare to ensure marginalized patients are not harmed by biased AI models.
Google Brain introduced Transformer in 2017, a flexible architecture that outperformed existing deep learning approaches, and is now used in models like BERT and GPT. GPT, a decoder model, uses a language modeling task to generate new sequences, and follows a two-stage framework of pre-training and fine-tuning.
The article discusses the importance of understanding context windows in Transformer training and usage, particularly with the rise of proprietary LLMs and techniques like RAG. It explores how different factors affect the maximum context length a transformer model can process and questions whether bigger is always better.
OpenAI introduces updates to ChatGPT AI models, addressing the "laziness" issue in GPT-4 Turbo and launching the new GPT-3.5 Turbo model with lower pricing. Users have reported a decline in task completion depth with ChatGPT-4, prompting OpenAI's response.
Generative AI applications using large language models (LLMs) offer economic value, but managing security, privacy, and compliance is crucial. This article provides guidance on addressing vulnerabilities, implementing security best practices, and architecting risk management strategies for generative AI applications.
OpenAI has released an easy-to-use web tool to create custom AI assistants without coding, requiring only a Google or Microsoft account and a $20/month OpenAI Plus subscription. Users can personalize their AI assistant's name, picture, tone, and interaction style, and enhance its knowledge by uploading specific documents.
This article explores the limitations of using Large Language Models (LLMs) for conversational data analysis and proposes a 'Data Recipes' methodology as an alternative. The methodology allows for the creation of a reusable Data Recipes Library, improving response times and enabling community contribution.
Developing LLM applications can be both exciting and challenging, with the need to consider safety, performance, and cost. Starting with low-risk applications and adopting a "Cheap LLM First" policy can help mitigate risks and reduce the amount of work required for launch.
The article discusses the singular value decomposition (SVD) algorithm and the author's process of refactoring the Jacobi algorithm from the GNU Scientific Library to Python/NumPy. The author validates their from-scratch SVD function using the np.linalg.svd() function and highlights the usefulness of SVD in classical statistics and machine learning.
The UK's top intelligence agency warns that malicious cyberactivity will increase with the incorporation of AI, with ransomware being the biggest threat. AI will lower barriers to entry, allowing both novices and experienced threat actors to exploit vulnerabilities and bypass security defenses more efficiently.
GeForce NOW levels up PC gaming on mobile with higher-resolution support on Android, offering immersive gameplay on the go. New games added to the library include Stargate: Timekeepers, Enshrouded, and Metal: Hellsinger.