InfoWorld

Databricks adds MemAlign to MLflow to cut cost and latency of LLM evaluation

By replacing repeated fine‑tuning with a dual‑memory system, MemAlign reduces the cost and instability of training LLM judges ...
Digi Times

ByteDance open-sources COMET to boost MoE efficiency, accelerating LLM training by 1.7x

ByteDance's Doubao AI team has open-sourced COMET, a Mixture of Experts (MoE) optimization framework that improves large language model (LLM) training efficiency while reducing costs. Already ...
Hosted on MSN

9 reasons why you should consider onsite LLM training and inferencing

Running large language models at the enterprise level often means sending prompts and data to a managed service in the cloud, much like with consumer use cases. This has worked in the past because ...
insideHPC

Exascale: Univ. of Maryland Researchers Nominated for Gordon Bell Prize for Extreme Scale LLM Training Using Frontier

Oct. 12, 2024 — A research team led by the University of Maryland has been nominated for the Association for Computing Machinery’s Gordon Bell Prize. The team is being recognized for developing a ...
Business Wire

TensorOpera and Aethir Team Up to Advance Massive-Scale LLM Training on Decentralized Cloud

PALO ALTO, Calif.--(BUSINESS WIRE)--TensorOpera, the company providing “Your Generative AI Platform at Scale,” has partnered with Aethir, a distributed cloud infrastructure provider, to accelerate its ...
InfoWorld

DSPy: An open-source framework for LLM-powered applications

DSPy (short for Declarative Self-improving Python) is an open-source Python framework created by researchers at Stanford University. Described as a toolkit for “programming, rather than prompting, ...
The Next Platform

Finding NeMo Features for Fresh LLM Building Boost

This week Nvidia shared details about upcoming updates to its platform for building, tuning, and deploying generative AI models. The framework, called NeMo (not to be confused with Nvidia’s ...
ZDNet

Nvidia doubles down on AI language models and inference as a substrate for the Metaverse, in data centers, the cloud and at the edge

Machine learning, task automation and robotics are already widely used in business. These and other AI technologies are about to multiply, and we look at how organizations can best take advantage of ...
Semiconductor Engineering

LLM-based Agentic Framework Automating HW Security Threat Modeling And Test Plan Generation (U. of Florida)

A new technical paper titled “ThreatLens: LLM-guided Threat Modeling and Test Plan Generation for Hardware Security Verification” was published by researchers at University of Florida. “Current ...