GPUs are usually the most expensive part of any training run, and most teams can't keep them busy. The bottleneck usually isn't the model. It's getting data from where it lives to the GPU fast enough - and every second those chips sit waiting, you're burning both time and money.
Official announcementDatabricks Blog
Accelerate GPU training on Unity Catalog tables with UCDataset
From the official release
Today we're releasing the Unity Catalog Dataset (UCDataset) in Beta on AI Runtime. UCDataset is a native PyTorch data loader that streams Unity Catalog tables directly to every GPU in your training job, with no exports, no copies, and no custom loader code.
On simulated production workloads, UCDataset cut training time by 10x compared with reading an exported Parquet copy of the same data.
The problem: Your GPUs are waiting on your data
This is a short excerpt. Read the full announcement on the official source.
Continue on databricks.com → (opens in a new window)Related stories
Official announcement
Amazon Bedrock AgentCore now offers a Web Search API
AWS What’s New
Today, AWS announces the general availability of the Web Search API on Amazon Bedrock AgentCore, which lets you search the web with a single API call. Web Search on AgentCore has been available as an MCP tool through AgentCore Gateway. The new InvokeWebSearch API gives applicatio
Official announcement
Amazon CloudWatch Logs announces account-level retention policies
AWS What’s New
Amazon CloudWatch Logs now supports account-level retention policies, so you can use a single policy to set how long log data is kept across all or subset of log groups in an AWS account. Account-level policies allow platform and security teams to bring each log group in line wit
Official announcement
AWS Glue adds 100 new native connectors for popular SaaS applications
AWS What’s New
AWS Glue now supports 100 new native connectors that simplify access to data in popular SaaS and REST API-based applications. Previously, bringing data from SaaS applications into AWS required writing custom code. Now, teams can create a connection once in the AWS Glue Data Catal
Official announcement
Databricks' Commitment to European Sovereignty
Databricks Blog
Over a Decade of Investment in EuropeDatabricks has been building in Europe since...
Official announcement
Make a Robot Arm Feel Weightless with NVIDIA Holoscan 5
NVIDIA Developer Blog
Picture guiding a robot arm by hand while its motors supply just enough torque to support its weight and keep the robot upright. This simple interaction, a... Picture guiding a robot arm by hand while its motors supply just enough torque to support its weight and keep the robot u
Official announcement
Accelerating Reinforcement Learning Weight Refit with the Reshard Collective
NVIDIA Developer Blog
During reinforcement learning (RL) post-training, training trajectories are generated on the fly by running inference with the current policy model. For... During reinforcement learning (RL) post-training, training trajectories are generated on the fly by running inference with t