Hi!
Yesterday the Windows Team announced the preview version of Windows Vision Skills. So today I was browsing the samples in Github and I’ve created a simplified version of the Skeleton tracker using a live feed from a webcam.

Here are some notes about my GitHub sample
- The UWP App must be Windows 10 version 1809
- I added the NuGet packages [Microsoft.AI.Skills.Vision.SkeletalDetectorPreview] and [Microsoft.Toolkit.Uwp.UI.Controls]

- The MainView uses the CameraPreview control from the [Microsoft.Toolkit.Uwp.UI.Controls] toolkit.
- Each frame is processed and I use a SkeletalBinding to detect Skeletons / bodies
- The core detection is performed here
private async Task RunSkillAsync(VideoFrame frame, bool isStream) { m_evalPerfStopwatch.Restart(); // Update input image and run the skill against it await m_skeletalDetectorBinding.SetInputImageAsync(frame); await m_skeletalDetectorSkill.EvaluateAsync(m_skeletalDetectorBinding); m_evalPerfStopwatch.Stop(); m_skeletalDetectionRunTime = m_evalPerfStopwatch.ElapsedMilliseconds; await Dispatcher.RunAsync(Windows.UI.Core.CoreDispatcherPriority.Normal, () => { m_bodyRenderer.Update(m_skeletalDetectorBinding.Bodies, !isStream); m_bodyRenderer.IsVisible = true; UISkillOutputDetails.Text = $"Found {m_skeletalDetectorBinding.Bodies.Count} bodies (took {m_skeletalDetectionRunTime} ms)"; }); }
- There is also a BodyRenderer.cs class used to draw the skeletons on top of the CameraPreview Image control. It draws lines in an empty canvas.
You can download the sample code from here https://github.com/elbruno/Blog/tree/master/20190501%20VisionSkills%20Skeleton%20Sample
Greetings @ Burlington
El Bruno
References
- Windows Blogs, Announcing Windows Vision Skills (Preview) https://blogs.windows.com/buildingapps/2019/04/30/announcing-windows-vision-skills-preview
- GitHub, Windows Vision Skills Preview https://github.com/Microsoft/WindowsVisionSkillsPreview