#Office – #Clippy is back in Office for Windows and Mac (powered by #AI)

Hi !

So, after my post yesterday, about the suggestions in Outlook based on an email content, somebody asked me why they don’t see this in Outlook.

I was sharing my experience in Outlook for Mac, in Windows we can find a [Suggested Meeting] option on top of the email content.

And then, when we expand the section, we may find the related meeting information

Happy coding!

Greetings @ Toronto

El Bruno

My posts

Advertisements

#Office – Clippy is back in Office (powered by #AI)

Hi !

I’ve already share some of the new AI features in Office, like Excel Ideas or real-time captions / subtitles in PowerPoint.

Today I’ll switch to Office editor, to share something amazing. I added Clippy to this post title and the idea is similar to the Clippy intents a long time ago:

An AI assistant will analyze the text while you are writing it or reading it, and it will suggest actions related to this text.

A single image is the best way to show this

I received this email last week and I notice that part of the text was automatically highlighted and show an amazing suggestion. It seems that the Word, Outlook editor is becoming more and more intelligent.

And I’m really looking forward to some extensibility SDK, so someone can really bring back Clippy at 100%

Happy coding!

Greetings @ Toronto

El Bruno

My posts

#Hololens – Developer Resources for #Hololens2

Hi !

Hololens 2 are on the way to some selected group of developers, so it’s time to start to collect and group some dev resources for the not so near future.

Let’s start with a couple of tweets

There is also a new Mixed Reality Toolkit, available as usual in GitHub https://microsoft.github.io/MixedRealityToolkit-Unity/README.html

What is the Mixed Reality Toolkit

MRTK is a Microsoft driven open source project.

MRTK-Unity provides a set of foundational components and features to accelerate MR app development in Unity. The latest Release of MRTK (V2) supports HoloLens/HoloLens 2, Windows Mixed Reality, and OpenVR platforms.

  • Provides the basic building blocks for unity development on HoloLens, Windows Mixed Reality, and OpenVR.
  • Showcases UX best practices with UI controls that match Windows Mixed Reality and HoloLens Shell.
  • Enables rapid prototyping via in-editor simulation that allows you to see changes immediately.
  • Is extensible. Provides devs ability to swap out core components and extend the framework.
  • Supports a wide range of platforms, including
    • Microsoft HoloLens
    • Microsoft HoloLens 2
    • Microsoft Immersive headsets (IHMD)
    • Windows Mixed Reality headsets
    • OpenVR headsets (HTC Vive / Oculus Rift)

Input Simulation Service

The Input Simulation Service emulates the behaviour of devices and platforms that may not be available in the Unity editor. Examples include:

  • HoloLens or VR device head tracking
  • HoloLens hand gestures
  • HoloLens 2 articulated hand tracking

As usual, a video is the best way to describe this

Unreal Engine 4.22 released

New: HoloLens Remote Streaming Support

Unreal Engine 4 now supports Holographic Remoting through the Windows Mixed Reality plugin! This allows Unreal applications to run on a Windows desktop PC and stream the rendered result wirelessly to HoloLens over a Wi-Fi connection in real time.

Happy coding!
Greetings @ Toronto

Resources

#Event – Resources used during the #GlobalAINight @metrotorontoUG

 

Hi  !

After an amazing event with my friends from Metro Toronto UG, it’s time to share some resources. It was initially supposed to be focused only on Azure Notebooks, but somehow we spend a lot of time talking about Cognitive Services and Custom Vision, that was great!

Let’s start with the 15 min Keynote video:

My Slides

And some interesting online resources

My posts on Custom Vision and ONNX

  1. Object recognition with Custom Vision and ONNX in Windows applications using WinML
  2. Object recognition with Custom Vision and ONNX in Windows applications using WinML
  3. Object recognition with Custom Vision and ONNX in Windows applications using Windows ML, drawing frames
  4. Object recognition with Custom Vision and ONNX in Windows applications using Windows ML, calculate FPS
  5. Can’t install Docker on Windows 10 Home, need Pro or Enterprise
  6. Running a Custom Vision project in a local Docker Container
  7. Analyzing images in a Console App using a Custom Vision project in a Docker Container
  8. Analyzing images using PostMan from a Custom Vision project hosted in a Docker Container
  9. Building the CustomVision.ai project in Docker in a RaspberryPi
  10. Container dies immediately upon successful start in a RaspberryPi. Of course, it’s all about TensorFlow dependencies
  11. About ports, IPs and more to access a container hosted in a Raspberry Pi
  12. Average response times using a CustomVision.ai docker container in a RaspberryPi and a PC

Windows 10 and YOLOV2 for Object Detection Series

Greetings @ Toronto

El Bruno

#Office – Ideas Tool for Microsoft Excel powered by AI (#Excel, #AI)

Hi !

Today I’ll switch to Excel to share some of the other amazing AI features embedded in Microsoft Office: Excel Ideas.

Excel Ideas is this new tool we have in Excel which will allow us to get some insights about the selected information in a worksheet. In order to use this tool, we need to select a set of data and click the [Ideas] button in the Ribbon.

Microsoft Excel Ideas.jpg

In order to write this post, I downloaded a sample set of spatial data from SpatialKey (see references). The sample insurance file contains 36,634 records in Florida for 2012 from a sample company that implemented an agressive growth plan in 2012. There are total insured value (TIV) columns containing TIV from 2011 and 2012, so this dataset is great for testing out the comparison feature. This file has address information that you can choose to geocode, or you can use the existing latitude/longitude in the file.

Once I selected the full set of Data, is nice to see the following insights

If you are a PowerBI user, this type of information and analysis will be familiar. To me is nice to see that we have this capabilities in a single click in a popular tool like Excel.

There are over +40 insights and it’s nice to browse them and find that in Miami Dade County, the site deductible is higher for Steel Frame and Reinforced Concrete constructions.

Microsoft Excel Ideas Sample 03

With 2 click we can analyze some Open Data related to traffic on Ontario and see how the traffic slowly increases in Hwy 69.

Microsoft Excel Ideas Sample 04

An amazing tool inside Excel to quickly get insights on our data.

Happy coding!

Greetings @ Toronto

El Bruno

References

My posts

#AI – CustomVision.ai project now can export directly toVision AI Developer Kit

Hi !

I was planning to write a couple of posts about Artificial Intelligence features in the Microsoft Suite, when I checked this feature available in CustomVision.ai.

Custom Vision export to Vision AI Dev Kit.jpg

Last year, Microsoft released a program named [Vision AI Developer Kit for IoT Solution Makers]

Integrated with Azure IoT Edge and working with the Microsoft Azure Machine Learning service (public preview), this Azure IoT Starter kit enables developers to build vision AI solution and run their AI models on the device.

vision ai dev kit camera.png

The device uses the Qualcomm vision intelligence platform for hardware acceleration of the AI model to deliver superior inferencing performance. And is specifically designed to deploy AI models built using Azure Machine Learning with Azure IoT Edge.

I just realize that you can also deploy to this camera, ONNX models from Azure AI Gallery, Azure ML models and of course, custom models created using CustomVision.ai. It’s all supported and managed using Azure IoT Edge.

So, now it’s time to check my delivery dates to see how much time I need to wait for my device to arrive and start to check the export option available in the CustomVision.ai portal!

Happy Coding!

Greetings @ Burlington

El Bruno

References

My posts on Custom Visopn

  1. Object recognition with Custom Vision and ONNX in Windows applications using WinML
  2. Object recognition with Custom Vision and ONNX in Windows applications using WinML
  3. Object recognition with Custom Vision and ONNX in Windows applications using Windows ML, drawing frames
  4. Object recognition with Custom Vision and ONNX in Windows applications using Windows ML, calculate FPS
  5. Can’t install Docker on Windows 10 Home, need Pro or Enterprise
  6. Running a Custom Vision project in a local Docker Container
  7. Analyzing images in a Console App using a Custom Vision project in a Docker Container
  8. Analyzing images using PostMan from a Custom Vision project hosted in a Docker Container
  9. Building the CustomVision.ai project in Docker in a RaspberryPi
  10. Container dies immediately upon successful start in a RaspberryPi. Of course, it’s all about TensorFlow dependencies
  11. About ports, IPs and more to access a container hosted in a Raspberry Pi
  12. Average response times using a CustomVision.ai docker container in a RaspberryPi and a PC

Windows 10 and YOLOV2 for Object Detection Series

 

#CognitiveServices – New service: Anomaly Detector

Hi !

So, I’m fully focused on have an amazing Canadian !nnovate Event in Avanade and I almost miss this new service, in the Cognitive Services Family: Anomaly Detector.

I was planning to run my 30K Around the Bay this weekend and also finish my session for the next Global AI Night (link), however I may play around with this service and add a quick reference on the next event.

After spending sometime today reading about the service, it seems that it works with time series of data and using specific models, it focus on anomalies of data on the series and .. magic! I think the official documentation explains this better:

The Anomaly Detector API enables you to monitor and detect abnormalities in your time series data with machine learning. The Anomaly Detector API adapts by automatically identifying and applying the best-fitting models to your data, regardless of industry, scenario, or data volume. Using your time series data, the API determines boundaries for anomaly detection, expected values, and which data points are anomalies.

Detect pattern changes in service requests

More information: https://azure.microsoft.com/en-us/services/cognitive-services/anomaly-detector/

Greetings @ Toronto

El Bruno

#Event – Disrupt AI: #Hackathon

disrupt ai banner

Hi !

DisruptAI is a two-day hackathon sponsored by Microsoft which challenges you to disrupt your industry using AI and data science. I’ll be learning and mentoring teams to hack and build amazing stuff !

More information and Register: https://www.eventbrite.ca/e/evoke-disruptai-hackathon-tickets-54971356808

Greetings @ Toronto

El Bruno