← All sessions
Lightning Talk · 7 min

A Practical Guide to Fast and Private LLMs

Time
12:20–12:27
Room
Millennium
Times and rooms can change at any time, also during the conference. This page always shows the current schedule, check it on the day.

A set of practical tips and tools for hobbyists and teams to run their own LLM in a private and sustainable setup. This talk gives people hands-on knowledge to decide on the right LLM architecture, how to optimize it, which hardware to run it on, and what software stack to go for. A whirlwind tour of how to roll your own AI for fun and profit.

Main tools & technology
Llama.cpp, Ollama, vLLM
Topics
Local AI, Inference & Open Models
Become a sponsor

Put your tools, products, and engineering work in front of builders working with agentic AI.

Sponsors & Partners
Main Sponsor
copebit — Main Sponsor
Gold
AWS TD SYNNEX Exasol
Silver
Atlassian Flagsmith LogicStar namespace re:cinq
Hands-On
OpenAI — Workshop Partner
End-User
Migros Online — End User Partner
Education
FHNW Hochschule für Informatik — Educational Partner
Bronze
adesso BI Concepts dihai Keera Noser Engineering Peak Scale Puzzle ITC Team Extension Trustsoft Your Sidekicks AG
Barista
BI Concepts, Barista Sponsor hagspihl.com, Barista Sponsor yardr.dev, Barista Sponsor
Community
AI & ML Events All Day AI CH Open dev.events Global AI Zurich Java User Group Switzerland Rocket Engineers SwissAIJob SwissDevJobs ZurichJS Conference