Turing-NLG: A 17-billion-parameter language model by Microsoft

Turing Natural Language Generation (T-NLG) is a 17 billion parameter language model by Microsoft that outperforms the state of the art on many downstream NLP tasks. We present a demo of the model, including its freeform generation, question answering, and summarization capabilities, to academics for feedback and research purposes.  – This summary was generated by […]

The post Turing-NLG: A 17-billion-parameter language model by Microsoft appeared first on Microsoft Research.

Continue reading Turing-NLG: A 17-billion-parameter language model by Microsoft

ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters

The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. Microsoft is releasing an open-source library called DeepSpeed, which vastly advances large model training by improving scale, speed, cost, and usability, unlocking the ability to […]

The post ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters appeared first on Microsoft Research.

Continue reading ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters

Executive Customer Meetings at Microsoft at RSA 2020 | San Francisco, CA

Microsoft at RSA 2020 | San Francisco, CA is fast approaching (February 24-27, 2020) and we’d like to make you aware of executive side meeting opportunities for security customers.
 
Specifically, we are providing the opportunity for US Gover… Continue reading Executive Customer Meetings at Microsoft at RSA 2020 | San Francisco, CA

Black History Month: Building a better future together

Gladys Hall was born on March 19, 1925, in Atmore, Alabama, at a time when her prospects and those of her family were inextricably linked to the circumstances of her birth and race. Her father worked tirelessly to provide for his family. He ran a dry cleaning business from their home, where Gladys started working…

The post Black History Month: Building a better future together appeared first on The Official Microsoft Blog.

Continue reading Black History Month: Building a better future together

Collaboration just got easier: Real time co-authoring now available in Visio for the web

The future of work is here, and it’s more collaborative than ever before. With everyone becoming more globally connected, collaboration has become paramount today. While it’s not always possible to collaborate in person, working together to share ideas… Continue reading Collaboration just got easier: Real time co-authoring now available in Visio for the web