Anykey
Amateur maker, hacker and coder. Fan of OpenSCAD, python, AI / LLMs, Cloud, 3D Printing, CNC and making things old-school by hand.
Sessions
02-16
11:00
60min
How do models like ChatGPT (LLM) work, can you hack them and run them offline?
Anykey
What is an LLM? Can you run it yourself? Can you hack it?
This session will explain high-level how an LLM works, how you can run this yourself (maybe for privacy reasons), Coding with LLMs and the hacking possibilities of these AI systems. Expect many demos and hopefully useful tips and tricks, so you can directly try all this stuff out yourself.
Keyword: Supervised Learning and Reenforced Learning, Hugging Face, Quantization, Ollama, open-webui, Prompt Hacking, Tokens, Context Length
Talks
Mission Critical Room (Rembrandt)