News

Windows Server 2025 GPU Improvements Promise Major AI Support

Currently in public preview, Windows Server 2025 is shaping up to be a major beneficiary of Microsoft's wide-ranging collaboration with chip giant Nvidia.

With powerful GPUs that are able to support resource-intensive AI model training, deep learning inferencing and other AI tasks, Nvidia is arguably a key element of Microsoft's ascendance to the near-top of the generative AI food chain.

The next version of Microsoft's server OS also stands to benefit. In Microsoft's late-May announcement of the Windows Server 2025 preview release, it described the improvements coming to product as spanning "AI, performance and scale."

"Azure hosts some of the world's largest workloads that push the limits of CPU and memory capabilities to process huge data sets across distributed environments," the company said at the time. "With the growth of AI and machine learning, GPUs have become a key part of cloud solutions because they're great at performing many parallel operations on large data. Windows Server 2025 brings you many of these advantages across GPUs, storage, networking, and scalability."

In an article last week titled "Introducing GPU Innovations with Windows Server 2025," Microsoft went into more detail about these GPU benefits.

"GPUs are essential for AI due to their parallel processing capabilities and highly scalable architecture," said the article authored by Afia Boakye and Rebecca Wambua on Microsoft's Tech Community site, discussing Windows Server 2025 Datacenter and Azure Stack HCI 24H2.

"Using the upcoming OS releases, Microsoft's customers can provide an entire GPU to a VM, which can run either Linux or Server, in a failover cluster using discrete device assignment (DDA)," they said. "This means that mission-critical AI workloads can easily run in a clustered VM and, upon an unexpected fault or a planned move, the VM will restart on another node in the cluster, using a GPU on that node.

Microsoft is touting "GPU partitioning" as a key differentiator coming to Windows Server 2025. GPU partitioning helps users partition a supported GPU and assign those partitions to different VMs in a failover cluster, resulting in multiple VMs that can share a single physical GPU, giving each VM an isolated fraction of the physical GPU's capabilities.

"Further, due to a planned or unplanned move, the VMs will restart on different nodes in the cluster, using GPU partitions on those different nodes," Microsoft said. "Besides enabling clustered VMs to use GPU-P, the upcoming OS releases are bringing live migration to VMs using GPU-P. Live migration for GPU-P enables customers to balance mission-critical workloads across their fleet and to conduct hardware maintenance and software upgrades without stopping their VMs."

More information about Windows Server 2025 is available here.

About the Author

David Ramel is an editor and writer for Converge360.

Featured

  • Red Brick Graphic

    Microsoft To Pour Millions into Partner Incentives, Azure and Security in FY2025

    Microsoft's inaugural MCAPS Start for Partners event took place this week, marking the beginning of its fiscal 2025.

  • New Microsoft Security Releases Aim To Smooth the Road to Zero Trust

    IT teams often juggle multiple tools to monitor and maintain the security of their environments. Two new products released by Microsoft this week aim to consolidate their toolboxes and help organizations achieve zero trust faster.

  • Antitrust Worries Hound Microsoft Off OpenAI's Board: Report

    In a move likely meant to assuage antitrust regulators' concerns, Microsoft on Wednesday stepped down from its role as a non-voting OpenAI board member.

  • Image of a futuristic maze

    The 2024 Microsoft Product Roadmap

    Everything Microsoft partners and IT pros need to know about major Microsoft product milestones this year.