In the context of expanding quality assurance (QA) automation adoption within an organization, new challenges emerge as teams attempt to manage and organize an increasing number of tests for various applications. The author explores a solution called QA Studio, which facilitates defining tests in natural language and running them through AI-powered visual navigation. In this post, the focus shi...
The article discusses the challenge of scaling PyTorch training on a cluster, which is primarily caused by the complexity of building and maintaining the required containers. This involves ensuring that every container has the same CUDA runtime, PyTorch build, NCCL, EFA libraries, and AWS OFI NCCL plugin. To address this issue, AWS introduced the Ray Train Deep Learning Container (DLC), which i...
Amazon Web Services (AWS) has been named a leader in Gartner's 2026 Magic Quadrant for Contact Center as a Service (CCaaS) for the fourth consecutive year for Amazon Connect. Amazon Connect Customer is designed to deliver personalized, intelligent experiences without sacrificing efficiency, flexibility, or control. The solution builds a comprehensive picture of every customer, uses AI to unders...
Exowatt, a company specializing in modular, dispatchable solar systems, uses advanced technology to harness solar energy, store it as heat, and generate electricity on demand for energy-intensive applications like AI data centers. To optimize operations, they've implemented an AI system for real-time alarm triage and decision-making at the edge, where connectivity and resources are limited. Tra...
Meta's Privacy Aware Infrastructure (PAI) introduces PrivacyLib, a common library used for enforcing and monitoring data flows in the final stage of PAI workflow. Previously, new privacy requirements meant integrating privacy enforcement separately into each data and processing system, leading to a lengthy process. PrivacyLib allows system integration once, with new privacy capabilities as modu...
In this post, we share the story of Property Finder, a digital real estate application, where 96.8% of their evaluation labels were found to be inherited from a single model's predictions rather than verified by human experts, leading to systemic bias and inaccurate comparisons of alternative models. Property Finder, which processes thousands of property images daily across the Middle East and ...
MIT Professor Paris Smaragdis, a musician and computer scientist, is on a mission to enhance machine hearing. He aims to develop machines with superior hearing capabilities, enabling them to locate sounds such as traffic accidents or industrial drill malfunctions. Smaragdis, a Greek native, discovered his fascination with sound and technology at a young age through classical guitar and synthesi...
Amazon SageMaker's new SOCI (Seekable OCI) indexing for AI Training and Processing jobs allows for lazy loading of container images, reducing image download time from minutes to seconds. SOCI indexing is an open-source technology that maps every file inside an image and stores it in Amazon ECR as a separate artifact. SageMaker checks for the index automatically and behaves accordingly, either l...
This text discusses the benefits and evolution of enterprise agentic retrieval using Amazon Bedrock Knowledge Bases on the AWS Cloud Development Kit (CDK). Traditional Retrieval Augmented Generation (RAG) systems have limitations, such as handling questions that span multiple corpora or require multiple lookups. To overcome these challenges, the text introduces agentic retrieval, where a reason...
The author employed AI to enhance the performance of their existing C# gradient boosting regression implementation, resulting in significant improvements. Gradient boosting regression is a tree-based method used to predict a single numeric value, such as predicting a maximum safe loan amount based on various factors. This process involves creating a collection of decision trees, where each tree...
The author implemented a decision tree regression system using JavaScript and used an AI system to analyze its correctness. The AI discovered edge cases where the code might fail and suggested improvements for enhanced performance. After extensive efforts, a revised version of the JavaScript decision tree regression was developed, leading to a synthetic dataset with 220 items as an example. Key...
Climate Week NYC, an annual event bringing together over 100,000 people in more than 1,000 events across New York City to discuss climate challenges and explore solutions, saw a strong presence from the MIT community this year. MIT was represented multiple days with appearances by Evelyn Wang, vice president for energy and climate, and numerous sessions organized by MIT departments, labs, cente...
This text discusses the challenge of managing computer vision models across multiple cameras in industrial quality inspection systems. Each camera captures the world differently, resulting in unique training data. To address this, individual fine-tuned models are needed for each camera, leading to the need to train, evaluate, version, and ship thousands of models without human intervention. The...
In this text, the author explains the concept of an "AI agent" and how it faces the same issue as the character in the movie "Groundhog Day," where it must re-read its entire story before performing an action. This leads to high costs due to repeated inputs. The author then introduces "prompt caching," a solution where previously processed inputs are saved and reused, reducing costs and maintai...
In the early development of artificial intelligence (AI), engineers like those at MIT believed introducing randomness and irrationality were necessary for machines to mimic human-like creativity, according to MIT assistant professor Benjamin Lindquist. Tracing back to mid-20th century ideas, engineers saw creativity as stemming from unexpected leaps of logic or even a dream-like state. To emula...