Zero to Hero - Develop your first app with Local LLMs on Windows | BRK142

In this session we will show Windows developers how to setup their dev box for AI development with WinGet and demonstrate the end to end workflow of working with and customizing local LLMs. We will show how to fine-tune an LLM with WSL, Python and the latest training tools, and we will show how to use a local LLM with your own data in a .NET Windows app.
𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀:
* Adam Braden
* Paulette Lee
* Craig Loewen
* Nikola Metulev
* Demitrius Nelon
* Alexandre Zollinger Chohfi
𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻:
This video is one of many sessions delivered for the Microsoft Build 2024 event. View the full session schedule and learn more about Microsoft Build at build.microsoft.com
BRK142 | English (US) | Copilot
#MSBuild

[@bomsbravo]

I created a project but I don't know how to run it. When I run it in the ubuntu run time that it creates, I can't see the model I trained in it. So I am lost here and thought this video would help. I don't see any tutorials anywhere on how to do this. Everyone is talking bout making a project and what to do with a project and how to actually fine-tune and run it is nowhere to be found. We need a step by step guide.

[@jorgepedraza1275]

It's fine with the latest generation PCs. It would be nice to have less code for trivial features.

[@FarzanaBanu-li8yo]

Can you provide code link

[@bikramjitkar8484]

I can't create a new project using AI Tools in VS Code as it requires an Nvidia GPU. Perhaps you guys should start the presentation with the hardware requirements first.

[@robinhalabicki8294]

AND that all Azure VMs with GPU do not support Nested Virtualization, so its not like you can "rent" one for testing.

[@Smart_Mak3R]

Can we do it with C#?

[@7th_CAV_Trooper]

There was a another cool video from Microsoft Developer where Stephen Toub demoed Microsoft.SemanticKernal in C#. I don't know if you can use it against local LLMs. The talk is called "Infusing your .NET Apps with AI: Practical Tools and Techniques | BRK187"

[@craigf987]

@@7th_CAV_Trooper SK works with local llms, but have fun finding one that lets you use functions/plugins

[@subhasismishra5001]

While it says Zero to Hero, the video is not. THere is a sudden jump and thus I am lost in between. It started so well, but disappointing at end.

[@bomsbravo]

Exactly! I was thinking the same! They came from zero up to creating a project and from there, they had a quantum leap to the unknown! I got so lost from there and came to the conclusion that there is no use in watching it anylonger.

[@antonm8860]

​@@bomsbravo same for me . I got lost mid video but I understood (like al of you I guess) the context and the tools used, so now I will install these tools, look for a simple sample and some doc. Nothing teaches as well as doing it yourself. C# should be in pairs with python now for AI so I hope to find enough for my needs

[@MusobarMedia]

source code ?
thank you

[@radek2944]

39:52

[@MusobarMedia]

@@radek2944 thank you man

[@fkxfkx]

Can you do it with Visual Basic or cobol? I don’t want to learn another language like pithon.

[@thedevmachine]

Its very nice but I dont want to learn yet another language like pyhton to able use this.

[@vaibhavsingh3617]

Average Programmers using Python.
Which language do you use right now?

[@thedevmachine]

@@vaibhavsingh3617 .net c#. For scripting JS/typescript etc.

[@MaxwellHay]

Try to be a real engineer

[@thedevmachine]

@@MaxwellHay definition of real engineer goes through python?

[@MaxwellHay]

@@thedevmachineit’s not about a language but eager to learn and adapt. I see too many .net developers only stay in the comfortable zone Microsoft created for them no matter senior or junior. Learn a new language and use it in some simple projects is not hard.