How do models like ChatGPT (LLM) work, can you hack them and run them offline?
02-16, 11:00–12:00 (Europe/Amsterdam), Mission Critical Room (Rembrandt)

What is an LLM? Can you run it yourself? Can you hack it?

This session will explain high-level how an LLM works, how you can run this yourself (maybe for privacy reasons), Coding with LLMs and the hacking possibilities of these AI systems. Expect many demos and hopefully useful tips and tricks, so you can directly try all this stuff out yourself.

Keyword: Supervised Learning and Reenforced Learning, Hugging Face, Quantization, Ollama, open-webui, Prompt Hacking, Tokens, Context Length


I will explain basics of Machine Learning concepts
How these ML concepts have created LLMs and how they somewhat work
What is needed to run LLMs (Inference) and how you can run it your self
how to test various LLMs
prompt hacking
using LLMs for coding
Many live demos


Language

English

Amateur maker, hacker and coder. Fan of OpenSCAD, python, AI / LLMs, Cloud, 3D Printing, CNC and making things old-school by hand.