#Event – Resources used with @ivanatilca during the “Lessons Learned creating a multiplatform AI project for Azure Kinect and Hololens 2” for the Global XR Talks

Buy Me A Coffee

Hi !

We had an amazing time last week with Ivana at the Global XR Talks, sharing some of our lessons learned creating an Mixed Reality app to work in Hololens 2 and Azure Kinect.

As usual, now it’s time for slides and code

Slides

Code

The main scripts for Camera and Cognitive Services interaction are available here https://github.com/elbruno/events/tree/main/20200806%20Global%20XR%20HL2%20to%20Azure%20Kinect%20Lessons%20Learned

Session Recording

Resources

#Event – ML.Net in Spanish and back to XR with @ivanatilca to share some #Hololens2 and #AzureKinect dev experiences @globxrcommunity

Buy Me A Coffee

Hi !

Just a self reminder post of a couple of events in my calendar.

Introduction to Machine Learning.Net

31 July 2020

Machine Learning.Net 1.5.1 is already here, so that’s the perfect excuse to chat with my colleagues from the MUG Argentina about this. This session is designed for developers who wants to start in the Machine Learning world. Machine Learning.Net is an amazing framework for this!

Important: the session will be in Spanish.

More information https://mug-it.org.ar/event.aspx?event=530

XR Session – Lessons Learned creating a multiplatform AI project for Azure Kinect and Hololens 2

6 August 2020

It all started with a 10000 kms conversation between 2 friends about how easy is to port Mixed Reality projects between platforms. So, we choose Azure Kinect and Hololens 2 as the platforms to test this out. To make this more challenging, we also decided to place custom holograms in those different platforms based on some cool Image Recognition scenarios (custom Artificial Intelligence rocks!) During this session we will review how to use MRTK, Azure Kinect SDK, Computer Vision, and other cool technologies to make this happen. And, of course, be aware that this session is full of code, hardware and demos, do not expect a lot of slides. Let’s code / build this.
Speakers: Ivana Tilca & Bruno Capuano, Both Microsoft MVP

More information https://www.meetup.com/GlobalXRTalks/events/271140960/

Happy coding!

Greetings

El Bruno

#Event – How #ChatBots and #MixedReality can enhance your Field Maintenance Capabilities

Clipboard01.png

Hi!

At the time this post is published I’ll be testing the Wifi On the airplane. I have no high expectations in this. The last time I’ve try this, a simple task like try to load GMail was an almost impossible.

Well, for the next 2 days it’s my turn to share experiences related to ChatBots And Mixed Reality In the Operational Excellence In Energy, Chemicals & Resources event. These kinds of events are much more business than I am used to, and are an excellent opportunity to understand how to apply large-scale products like Dynamics 365 or as Artificial intelligence can improve some business processes in the energy area.

Note: The mere fact of being able to make predictions in models of Large-scale energy distribution grid is something that is kind of fascinating.

Agenda: https://opexsummit.iqpc.com/agenda/main-conference-day-one-june-5-2018

Greetings @ Calgary

El Bruno

#Event – Como utilizar #ChatBots y #MixedReality para mejorar Field Maintenance Capabilities

Clipboard01.png

Buenas !

Supongo que en el momento que se publique esta entrada estaré probando el WiFi en el avión. No tengo grandes esperanzas, ya que la última vez, solo intentar cargar Gmail era una tarea imposible.

Pues bien, durante los próximos 2 días me toca compartir experiencias relacionadas con ChatBots y Mixed Reality en el Operational Excellence in Energy, Chemicals & Resources event. Este tipo de eventos son mucho mas de negocio de los que estoy acostumbrado, y son una excelente oportunidad para comprender como aplicar a gran escala productos como Dynamics 365 o como la Inteligencia Artificial puede mejorar algunos procesos de negocio en el área de la energía.

Nota: el solo hecho de poder realizar predicciones en modelos de distrubucion de energía a gran escala es algo que es como poco fascinante.

Agenda: https://opexsummit.iqpc.com/agenda/main-conference-day-one-june-5-2018

Saludos @ Calgary

El Bruno

#Event – Mixed Reality Workshop

giphy

Hi !

Next March 17 I will be part of the team in the Mixed Reality Workshop. It is a full day of sessions to help understand how to create Mixed Reality Apps with Windows 10, Unity 2017.2 and Visual Studio 2017. The agenda is as follows

  • Intro to Windows Mixed Reality
  • Building a mixed reality experience
  • Placing a virtual object in a 3D space
  • Interacting with virtual objects
  • Handling user movement in a 3D space
  • Deploying and building a custom 3D launcher
  • Q&A/Wrap-up/Where to go from here

Happy Coding!

Greetings @ Toronto

El Bruno

References

#Event – Mixed Reality Workshop

giphy

Buenas!

Pues que el próximo 17 de Marzo seré parte del equipo en el Workshop de Mixed Reality. Es un dia completo de sesiones para ayudar a comprender como crear Mixed Reality Apps con Windows 10, Unity 2017.2 y Visual Studio 2017. La agenda es la siguiente

  • Intro to Windows Mixed Reality
  • Building a mixed reality experience
  • Placing a virtual object in a 3D space
  • Interacting with virtual objects
  • Handling user movement in a 3D space
  • Deploying and building a custom 3D launcher
  • Q&A/Wrap-up/Where to go from here

Happy Coding!

Saludos @ Toronto

El Bruno

References

#Podcast – NTN 36 – How a #AR SDK works (Augmented reality), a very simple way to understand this very complex technology

giphy

Hi !

Big episode today! After writing a little about Mixed Reality, Virtual Reality and Augmented Reality, I’ve realized that we have a lot of bluff and fake news anywhere about this, so I decided to spend some time talking about how really a AR kit works.

At the end, I’ve recorded 2 versions of the audio. In the 1st one somehow I got lost in a very deep technical details speech about maths and calculations, so I’ve put some guide in front of me and I recorded a 2nd one where I try to avoid deep technical topics. In the published version I explain how a basic AR works, how they perform spatial mapping, stereoscopic analysis synchronization issues and more. At the end, we also have Sergio Mabres news section.

As always, I hope you enjoy the episode and forgot the errors. Remember this is a Spanish podcast

Greetings @ Toronto

El Bruno

References

#Podcast – NTN 36 – Como funciona un kit de #AR (Realidad Aumentada), explicado para un niño de 5 años! (por uno que tampoco es mucho más grande)

giphy

Hola !

 

Episodion el de hoy! Después de comentar un poco noticias sobre Realidad Mixta, Virtual y Realidad Aumentada, y ver que hay mucho bluff y fake news por ahí, se me ha dado por intentar explicar cómo funciona un SDK de AR por dentro.

En realidad, he grabado una versión por donde me iba por las manos explicando detalles técnicos del mismo, y esta versión en la que explico cómo funcionan, como hacen un mapping del entorno, un poco de análisis estereoscópico, los problemas de sincronización y tracking y otros temas más.

Al final también tenemos la sección de noticias de Sergio Mabres, y recuerden que este resumen se realiza semana a semana, y el podcast cada 2 semanas, tenemos un problema de sincronización parecido al que hay entre las cámaras y los sensores de movimiento en un smartphone.

Como siempre, espero que lo disfruten, y que disculpen los errores (si es que hubo alguno).

 

Saludos @ Toronto

El Bruno

References

#Opinion – Your vacuum will be your #AR device ! Augmenting #ARKit, #ARCore and #MixedReality

Hi !

I have very good memories about the times when I used to speak in events about Microsoft Robotics. It was the year 2006 and my girl make give me the best present ever: Lego Mindstorm NXT. I’ve spend hours and hours with the Lego and also playing around with Visual Studio try to control my bot using C#. (During those days I really learn about the Microsoft approach to Bluetooth) Microsoft Robotics supported several types of bots, however the most popular ones were Lego Mindstorms and the popular  Roomba vacuum. Yes, roomba used to have a special model with Bluetooth connectivity and, you know, hack the bluetooth, hack the world! You can control the Roomba using Microsoft Robotics.

Of course, once you were there, the next step was to get a 2nd Roomba vacuum and prepare a Sumo fight between the 2 devices. I think it was in TechEd 2008 when it took place the final of Microsoft Robotics challenge, I was lucky enough to be there as an attendee.

giphy.gif

In this line, you are probably thinking: vacuums? bots? how this is related to Augmented Reality? Bruno finally lost it.

Let’s get back a little to the AR world. Most of the AR SDKs relies on some type of sensors to create a model of the surrounding environment. In ARKit and ARCore this is supported by the camera and the motion sensors, in other devices and SDKs you can also have depth sensors.

And what happens if we add information of external sensors into the process of the creation, analysis or exploration of the surrounding 3D model ? Why not use external sensors, whose who can make a Full scan of the indoors of a house? Take a look at this video.

If the SDK can somehow detect “where it is” and make a request to a 3rd party service for a 3D model of the current environment this will be a huge advance. The chance to use this information as an external capability to our mapping process will be a big advance. Today in the AR world, the tracking / mapping is one of the main challenges for all the players (Apple, Microsoft, Google, Facebook, etc …)

Note: Of course, once you have the map, you need to understand “where are you inside the map”, and this is not an easy task. Today we see this as the “lost tracking” scenario, but this is just an idea for the near future.

There are plenty of paths to take from here. In our Avanade TechVision 2017, we constantly suggest our clients to take advantage of the amazing ecosystem of services we have around. I’m sure we didn’t think about using information from a vacuum to be used in a Mixed Reality experience !

Happy Coding!

Greetings @ Burlington

El Bruno

References

#Opinion – Tu #ARKit, #ARCore y #MixedReality apoyados en … tu aspiradora!

Hola!

Siempre recuerdo con cariño los años en los que daba charlas sobre Microsoft Robotics. Allá por el año 2006 mi chica me regalo un Lego Mindstorm NTX y con el mismo recorrí casi toda España dando charlas de sobre esta tecnología. Si bien Microsoft Robotics permitía trabajar con diferentes robots, los más utilizados eran Lego Mindstorms y las aspiradoras Roomba. Éstas últimas poseían La capacidad de conectarse por Bluetooth con un ordenador y de esta forma era posible utilizar Microsoft Robotics.

Obviamente, una vez que tenías una aspiradora Roomba, lo siguiente era conseguir una segunda aspiradora y comenzar hacer lucha de Sumo entre ambas. Creo que fue en el TechEd 2008 donde se celebró la final mundial de luchas de sumo y tuve la suerte de verla en vivo.

giphy.gif

Y seguramente ahora piensas que al Bruno se le fue la cabeza, por qué tiene que ver esto con los kits de Realidad Aumentada de Apple, Android y Microsoft. Pues bien, Hoy por hoy, estos SDKs dependen de que el dispositivo sobre el que se están utilizando tenga algún tipo de sensor para realizar un Mapping del entorno. Pero qué pasaría si, además de la información de estos sensores, se pudiese agregar más información adicional desde otros Devices ¿Por qué no contar con sensores “externos” que puedan hacer un mapeo completo de una casa? Atención al siguiente vídeo.

Sí de alguna forma el SDK pudiese tener una idea de “dónde está” y con esto solicitar información a un servicio de 3ros, pues esto podría ser bastante útil. Porque no utilizar esta información adicional y también utilizar estos límites para tener un mejor modelo 3D del entorno donde posicionemos nuestros hologramas.

Como siempre, las posibilidades son infinitas y, siguiendo una de las premisas de nuestro Avanade TechVision 2017, todo pasa por saber cómo moverse y utilizar servicios en este nuevo ecosistema de servicios. En este caso, integrar información de una aspiradora en un SDK de Realidad Aumentada. ¡Ahí queda la idea para el fin de semana!

Happy Coding!

Saludos @ Burlington

El Bruno

References