News

Microsoft Supercomputer Announced at Build Among World's Top 5

A supercomputer unveiled by Microsoft at Build this week reportedly "ranks in the top five" of the 500 leading publicly disclosed supercomputers, the company said.

Hosted in Azure datacenters, the supercomputer consists of "a single system with more than 285,000 CPU cores, 10,000 GPUs and 400 gigabits per second of network connectivity for each GPU server," according to Microsoft. It was built for San Francisco-based AI software development company OpenAI. Microsoft already acts as OpenAI's cloud services provider, as well as its investor, providing the company with $1 billion last year.

The supercomputer is being used to build large-scale models for things like language translation, text search, speech recognition and "computer vision," according to Kevin Scott, Microsoft's chief technical officer. The companies are finding that a "single massive model" tends to work better for certain tasks, such as "learning" by scanning text. Models only need to be trained once when they have "massive amounts of data and supercomputing resources," according to Microsoft.

Turing Models Going Open Source
Microsoft has its own large-scale AI models that it is using to improve "language understanding tasks across Bing, Office, Dynamics and other productivity products." These models are called "Microsoft Turing models."

The Microsoft Turing models soon will be released as open source code, Microsoft indicated. The Microsoft Turing AI model used for language was described as the "world's largest," with "17 billion parameters."

In related announcements, Microsoft indicated it had updated DeepSpeed, which is an "open-source deep learning training optimization library" for PyTorch. PyTorch is an open source library used for natural language processing and computer vision.

Microsoft also added support for model training to the ONNX Runtime, enabling models to get trained "45 percent faster." Microsoft uses the DeepSpeed PyTorch library and the ONNX Runtime to train its AI models.

AI Bias-Checking Tools
The Azure Machine Learning service now includes "responsible machine learning" enhancements designed to help developers "understand, protect and control their models," Microsoft announced on Tuesday.

The InterpretML toolkit can provide such insights into AI models, Microsoft claimed. Scandinavian Airlines is using Microsoft's InterpretML toolkit to check the parameters used to detect fraud in its frequent-flyer EuroBonus program, for instance.

Microsoft also has a new WhiteNoise toolkit for assessing privacy when using the Azure Machine Learning service, which is now available for developers as open source code at the GitHub repository. It enables analysis while protecting private information, Microsoft asserts. The WhiteNoise toolkit was developed in conjunction with researchers at the Harvard Institute for Quantitative Social Science and School of Engineering.

In June, Microsoft plans to add a new Fairlearn toolkit for use with the Azure Machine Learning service. Fairlearn is another tool for developers that can be used to "assess and improve the fairness of AI systems," such as checking on models that recognize skin-tone, gender or age visual characteristics. The Fairlearn toolkit was developed by members of the research group Fairness, Accountability, Transparency and Ethics in AI (FATE).

The advisory services company EY has used the Fairlearn toolkit on "a machine learning model the firm built for automated lending decisions." The toolkit is used to assess fairness based on gender-recognition capabilities, Microsoft indicated.

About the Author

Kurt Mackie is senior news producer for 1105 Media's Converge360 group.

Featured

  • Phishing Attacks Impersonate Microsoft's Brand the Most

    Security solutions firm Check Point this week gave Microsoft the dubious distinction of being the "most imitated" company used for phishing attacks.

  • Remote Work To Drive Higher Cloud, IT Services Spending in 2021

    Global tech spending has taken a hit in 2020 due to the COVID-19 pandemic, but analysts expect it to rebound next year.

  • 2020 Microsoft Conference Calendar: For Partners, IT Pros and Developers

    Here's your guide to all the IT training sessions, partner meet-ups and annual Microsoft conferences you won't want to miss. (Now updated with COVID-19-related event changes.)

  • The 2020 Microsoft Product Roadmap

    From the next major update to Windows 10 to the next generations of .NET and PowerShell, here's what's on tap from Microsoft this year.