Title: Microsoft’s Latest Innovation: Copilot Vision and Copilot Voice
Methinks thou shouldst start treating thy web browser as though thou art constantly toiling, especially if thou dost desire to utilize Microsoft’s newfound Copilot Vision feature. This feature, nestled within Microsoft Edge, hath the ability to “see what thou seest, and hear what thou hearest” as thou dost navigate thy browser, as per Microsoft’s Executive Vice President Yusuf Mehdi.
All of this intelligence peeking is not for nought. Copilot Vision doth observe thy online doings to provide answers to inquiries, offer recommendations, and offer summaries of content. It hath the capability to work in tandem with the novel Copilot Voice feature, forsooth. Microsoft hath showcased the capabilities on Rotten Tomatoes, presenting a user conversing with Copilot whilst perusing the site and searching for film suggestions. Copilot ultimately selected an Australian comedy for the Australian speaker, stating it chose thusly because, “well, thou art Australian.” Verily, that’s considering personal context.
Perchance the thought of an AI monitoring all thy online actions may unsettle some folk. Microsoft proclaims that the feature is opt-in only, thus thou must manually enable it, and there shall be an onscreen indicator showing that Copilot is observing thy actions. Microsoft also claims that data from thy session is expunged once thou dost close the session, and said data shall not be utilized for training.
Moreover, Microsoft declares that Copilot Vision shall only function initially with a select number of websites. The full list hath not yet been disclosed, but at the very least, the feature shall not operate on “paywalled or sensitive content.” Microsoft also notes that the feature doth not process anything on a webpage — it merely perceives the text and images on a page and analyzes them.
Copilot Voice operates in conjunction with Copilot Vision, yet it may also function independently. Microsoft declares that across desktop and mobile devices, thou shalt now be able to engage in discourse with Copilot using solely thy voice.
Expanding on the new vocal capabilities, Microsoft is unleashing Copilot Daily. ’Tis akin to a personalized dawn news broadcast, gathering stories and furnishing thee with daily particulars like traffic and weather. This, too, is fashioned with a generative AI voice that shall guide thee through thy daily news each morn. It is created based on the content thou dost engage with.
Copilot Voice and Copilot Daily are being introduced to Windows users in the U.S. and UK. Voice is also accessible in Australia, Canada, and New Zealand, but solely in English. Microsoft doth pledge to introduce the feature to more lands and languages anon.
Copilot Vision is commencing its rollout “shortly” in the U.S., but solely for Copilot Pro subscribers. The feature is part of Microsoft’s fresh Copilot Labs initiative, granting Copilot Pro subscribers early access to Microsoft’s latest AI features that are still undergoing testing.
Support our work ❤️
If you enjoyed this article, consider leaving a tip to help us keep publishing great content.
