Generative AI and large language models dominated enterprise trends this year, with companies like Amdocs, Dropbox, and SAP building customized applications using RAG and LLMs. Open-source pretrained models are set to revolutionize businesses' operational strategies, while off-the-shelf AI and microservices make it easier for developers to create complex applications.
Large language models (LLMs) like GPT NeoX and Pythia are gaining popularity, with billions of parameters and impressive performance. Training these models on AWS Trainium is cost-effective and efficient, thanks to optimizations like rotational positional embedding (ROPE) and partial rotation techniques.
The article explores common data clustering techniques, with a focus on spectral clustering. Using k-means to compute cluster labels from eigenvectors is found to be the best approach, despite variations and complexities.
GeForce NOW adds 17 new games, including The Day Before and Avatar: Frontiers of Pandora, with over 500 games now supporting RTX ON. Ultimate members can experience cinematic ray tracing and stream at up to 4K resolution, while Priority members can build and survive at 1080p and 60fps.
Mistral AI announces Mixtral 8x7B, an AI language model that matches OpenAI's GPT-3.5 in performance, bringing us closer to having a ChatGPT-3.5-level AI assistant that can run locally. Mistral's models have open weights and fewer restrictions than those from OpenAI, Anthropic, or Google.