El Bruno

Hi !

The Windows App Team Blog team has released a month ago a nice sample of a Universal Windows App which uses most of the latest Microsoft technologies for Windows 10. This app allows the creation of notes, in sticky notes format, and to do this uses Windows Face Recognition with Cognitive Services to identify users, it also uses Cortana voice commands to start the app or create new notes, and much more.

There is also a nice set of blogs posts explaining the development process (see references) with all the explaining samples using C# and XAML. Also, there are some videos in Channel 9 related to the Family Notes development background (Using Ink, Voice, and Face Recognition in a UWP App)

All the source code is available in GitHub, so you can easily download the code and start to learn:

• Speech recognition and speech synthesis by using the SpeechRecognizer and SpeechSynthesizer classes.
• User detection using the MediaCapture and FaceDetectionEffect classes.
• User facial recognition using the Microsoft Face API.
• Activation through Cortana voice commands, defined in VoiceCommands.xml (a VCD file), using VoiceCommands andActivation classes.
• Pen input using the InkCanvas API
• JSON serialization using the DataContractJsonSerializer class.
• Setting the app wallpaper using the Bing image of the day task snippet.

*All this topics are described in the main GitHub page

Greetings @ Toronto

El Bruno

References

• Source Code, https://github.com/Microsoft/Windows-appsample-familynotes
• Windows App Team Blog
• Family Notes: Words and Pictures
• FamilyNotes: Introducing a Windows UWP sample using ink speech and face recognition
• FamilyNotes: Using the camera to detect a user
• Channel 9, Using Ink, Voice, and Face Recognition in a UWP App