NEWS IN BRIEF: AI/ML FRESH UPDATES

Get your daily dose of global tech news and stay ahead in the industry! Read more about AI trends and breakthroughs from around the world

Revolutionizing Training and Inference with TSP: 2.6x Faster Performance

Zyphra introduces Tensor and Sequence Parallelism (TSP) for large transformer models, reducing per-GPU memory usage in benchmark tests on up to 1,024 AMD MI300X GPUs. TSP combines Tensor Parallelism (TP) and Sequence Parallelism (SP) to optimize memory management, offering a new approach to parallelism folding for improved efficiency.

Fixing Tokenization Drift

Tokenization drift occurs when small formatting changes lead to unpredictable shifts in model behavior. Leading spaces create different token IDs, impacting attention computation and model performance.

Unlocking the Mysteries of Sleep with Beacon Biosignals

Beacon Biosignals, founded by Jake Donoghue PhD ’19 and former MIT researcher Jarrett Revels, uses EEG technology to monitor brain activity during sleep at home. The company's FDA-cleared device has been used in over 40 clinical trials globally to study conditions like major depressive disorder and Alzheimer’s disease.

Mastering the Power of Language

MIT senior Olivia Honeycutt's research focuses on the intersection of human thinking, language learning, technology, and social group interaction. She explores how language shapes our perception of the world and ourselves, delving into areas like neurolinguistics and AI at MIT.

The Power of Curiosity in Science

MIT President Sally Kornbluth emphasizes the importance of basic science and the critical role of universities in research. She warns of potential negative ramifications for the U.S. if the pipeline of basic science is strained due to funding uncertainties.