-
Using Large Language Models with .NET: Generating Image Alt Text Automatically
Hi! The following post is generated using some super cool LLMs, and hey it’s also about LLMs 😁 Introduction In this blog post, we’ll explore a practical use case for LLMs: generating alt text for images automatically, ensuring your applications are more inclusive and accessible. By the end of this post, you’ll learn how to:… — read more
-
CPU vs GPU: Which Wins for Running LLMs Locally?
Introduction Running large language models (LLMs) locally has become increasingly accessible, thanks to advancements in hardware and model optimization. For .NET programmers, understanding the performance differences between CPUs and GPUs is crucial to selecting the best setup for their use case. In this blog post, we’ll explore these differences by benchmarking the Llama 3.2 Vision… — read more
-
#RaspberryPi – 1st setup no monitor 📺: Wifi 📶 auto connect, SSH, rename, update, docker 🐳, rust and more! Update 2024-Apr-30
Content Hi! Let’s start installing the latest Raspberry Pi OS image in an SD card. Next steps will be focus on how to access and control remotely your device you may want to follow this steps. This tutorial and tips works for Raspberry Pi 3, 4 and Zero. The version 1.6 of Raspberry Pi Imager… — read more
-
Build an AI Chat in .NET Aspire with Ollama. Quickstart Guide!
Hi! Here is a small intro to the .NET Aspire + Ollama scenario in this repo: https://aka.ms/netaiaspireollamachat. You can also learn more about this, in this 5-minutes overview video: Introduction to .NET Aspire and Ollama Have you ever thought, “Why can’t my .NET app have an AI chatbot that’s ridiculously easy to integrate?” Well, meet… — read more
-
Full Local RAG scenario using #Phi3, #SemanticKernel and TextMemory. Bonus: Test in CodeSpaces
Hi! Today’s scenario is once again, using Phi-3. You know, a groundbreaking Small Language Model (SLM) that is redefining the capabilities of AI for developers and businesses alike. In this blog post, we will explore the importance of leveraging Phi-3 for full-scale scenarios and how you can test these scenarios for free using the Ollama… — read more
-
Code Sample: Integrating Azure OpenAI Search with #SemanticKernel in .NET
Hi! Today I’ll try to expand a little the scenario described in this Semantic Kernel blog post: “Azure OpenAI On Your Data with Semantic Kernel“. The code below uses an GPT-4o model to support the chat and also is connected to Azure AI Search using SK. While runing this demo, you will notice the mentions… — read more
-
Sample Code using the new OpenAI library for .NET
Hi! The new OpenAI SDK for NET was officially announced, so today, let’s review the annoucement and show some sample code on how to use it. The current blog scenarios are Here is a sample output for the chat demo! And yes, with a funny system message and questions about France! OpenAI SDK for .NET… — read more
-
Powering Up #NET Apps with #Phi-3 and #SemanticKernel
Hi! Introducing the Phi-3 Small Language Model Hi! Phi-3 is an amazing Small Language Model. And hey, it’s also an easy one to use in C#. I already wrote how to use it with ollama, now it’s time to hit the ONNX version. Introduction to Phi-3 Small Language Model The Phi-3 Small Language Model (SLM)… — read more
-
#SemanticKernel and GPT-4o: Image analysis labs
Hi! Introduction to GPT-4o GPT-4o, developed by OpenAI, represents a significant leap forward in AI technology. Dubbed “omni” for its all-encompassing capabilities, GPT-4o is a multimodal model that can process and generate text, audio, and images. It’s designed to facilitate more natural human-computer interactions, responding to audio inputs in as little as 232 milliseconds. This model is… — read more
-
Demo – API Manifest Plugins for Semantic Kernel
Hi! Today, it’s time to share some insights into the world of API Manifest Plugins for Semantic Kernel, these are a cool way to work with OpenAI’s Large Language Models (LLMs). Introduction to API Manifest Plugins for Semantic Kernel Semantic Kernel is at the forefront of AI development, allowing developers to import plugins from OpenAPI… — read more
-
#SemanticKernel: Local LLMs Unleashed on #RaspberryPi 5
Hi! Welcome to the exciting world of local Large Language Models (LLMs) where we’re pushing the boundaries of what’s possible with AI. Today let’s talk about a cool topic: run models locally, especially on devices like the Raspberry Pi 5. Let’s dive into the future of AI, right in our own backyards. Ollama and using… — read more
-
#RaspberryPi – 1st setup no monitor 📺: Wifi 📶 auto connect, SSH, rename, update, docker 🐳, rust and more! Update 2024-Apr-30
Content Hi! Let’s start installing the latest Raspberry Pi OS image in an SD card. Next steps will be focus on how to access and control remotely your device you may want to follow this steps. This tutorial and tips works for Raspberry Pi 3, 4 and Zero. The version 1.6 of Raspberry Pi Imager… — read more
-
🦙 Harnessing Local AI: Unleashing the Power of .NET Smart Components and Llama2
Hi! .NET Smart Components are an amazing example of how to use AI to enhace the user experience in something as popular as a combobox. .NET Smart Components also support the use of local LLMs, so in this post I’ll show how to configure thse components to use a local Llama 2 inference server. The… — read more
-
📎 Extending #SemanticKernel using OllamaSharp for chat and text completion
Hi! In previous posts I shared how to host and chat with a Llama 2 model hosted locally with Ollama. (view post). And then I also found OllamaSharp (nuget package and repo). OllamaSharp is a .NET binding for the Ollama API, making it easy to interact with Ollama using your favorite .NET languages. So, I… — read more
-
Don’t miss the 2024 Azure Developers JavaScript Day!
Azure Developers JavaScript Day! Do you want to discover the latest services and features in Azure designed specifically for JavaScript developers? Are you looking for cutting-edge cloud development techniques that can save you time and money, while providing your customers with the best experience possible? Azure Developers JavaScript Day Event Banner If yes, join us next week… — read more
-
How to Use #SemanticKernel, Plugins – 2/N
Hi! In the previous posts we learned how to create a simple Semantic Kernel Chat Application Today we will switch a little the interaction with the AI Models, instead of a chat conversation, we will use Plugins. Plugins Let’s start with the PlugIn definition thanks to Microsoft Copilot: A plugin is a unit of functionality… — read more
-
How to Use #SemanticKernel with OpenAI and Azure OpenAI in C# – 1/N
Hi! Today I’m starting a series of posts to describe an “easy way to use” AI Services with Semantic Kernel. I’m a fan of code, so I’ll focus mostly on code samples. Semantic Kernel (via Copilot) Semantic Kernel is a powerful tool that allows developers to integrate cutting-edge language models into their applications with ease.… — read more
-
APIs in Action: Unlocking the Potential of APIs in Today’s Digital Landscape
Hi! In today’s world, APIs (Application Programming Interfaces) are essential for connecting applications and services, driving digital innovation. But with the rise of hybrid and multi-cloud setups, effective API management becomes essential for ensuring security and efficiency. That’s where APIs in Action, a virtual event dedicated to unlocking the full potential of APIs, comes in. Join… — read more
-
#SemanticKernel – 📎Chat Service demo running Llama2 LLM locally in Ubuntu
Hi! Today’s post is a demo on how to interact with a local LLM using Semantic Kernel. In my previous post, I wrote about how to use LM Studio to host a local server. Today we will use ollama in Ubuntu to host the LLM. Ollama Ollama is an open-source language model platform designed for… — read more
-
#SemanticKernel – 📎Chat Service demo running Phi-2 LLM locally with #LMStudio
Hi! It’s time to go back to AI and NET, so today’s post is a small demo on how to run a LLM (large language model, this demo using Phi-2) in local mode, and how to interact with the model using Semantic Kernel. LM Studio I’ve tested several products and libraries to run LLMs locally,… — read more