A new Artificial Intelligence-based system from Microsoft intends to automatically caption images in documents and emails so that software for visual issues can read it out.
A group of researchers from Microsoft elucidated their machine learning model in a paper on preprint repository arXiv.
Microsoft’s model uses VIsual VOcabulary pre-training (VIVO). The system leverages hefty amounts of paired image-tag data to learn a visual language. A 2nd dataset of appropriately captioned pictures is then used to aid teach the AI system how to describe the pictures properly.
A software engineering manager with Microsoft’s Artificial Intelligence platform group, Saqib Shaikh mentioned,
“Ideally, everyone would include alt text for all images in documents, on the web, in social media – as this enables people who are blind to access the content and participate in the conversation. But, alas, people don’t.”
Overall, the researchers anticipate Artificial Intelligence to deliver two times the performance of Microsoft’s present captioning system.
Microsoft’s CTO of Azure AI Cognitive Services, Xuedong Huang said that they are taking the AI breakthrough to Azure as a platform to serve a comprehensive set of users. Huang further added that it is not just a breakthrough on the research. Rather, the time it took to turn that breakthrough into production on Azure is also a breakthrough, as per him.
The enhanced auto-captioning feature is also anticipated to be presented on Outlook, Word, and PowerPoint later this year.
The Future is Now Media Group have launched a YouTube show called The Future is Now Digest, hosted by Miguel Francis-Santiago. Together […]
April 30, 2020
PRESS RELEASE — 10,000 participants are expected to join CHAIN2020 in Hong Kong on January 15, which aims to become one of […]
December 27, 2019
Research into CBDCs will play a crucial part in the fintech development endeavors of Hong Kong. The Hong Kong Monetary Authority has […]
June 11, 2021
Segal-Knowles, the Bank of England’s executive director of the Financial Market Infrastructure Directorate recently commented that stablecoins are hardly “launching us off […]
June 11, 2021