Beware! This is still work in progress – I’ll need to re-run all steps on a clean install to verify everything really works as expected! I also assume, that you’re familiar with DNS-based ACME and that the required infrastructure is already in place. Installation of cert-manager Based on this description. Check installation: Creating first ACME […]
Categories
Adding persistent storage to k3s
Basics Kubernetes/k3s is using the Container Storage Interface (short CSI) to provide persistent storage. More details about that can be found here. Options By default k3s/rancher ships with a storage class called “local-path“. According to k3s documentation an alternative is “longhorn” (see here). But there are plenty of other options based on NFS, Ceph (both […]
When trying to get first access to an OpenStack based kubernetes cluster, you’ll first need to create a correct ~/.kube/config file. OpenStack however only provides you with a collection of files you need to assemble yourself: However you’ll need all that components in the right place in a single file. Here’s a short version of […]
Categories
Traefik – template collection
Basic configuration While I had a hard time setting up traefik for the first time, once you got a hang to it, it really does a nice job. To save you some time, I recommend to understand the difference between the traefik.yml and config.yml file. As I found out (too) late, this is described here: […]
While experimenting with open-webui I was looking for options to use local LLM resources for image creation. Besides the commercial models, openwebui offers two alternatives : Automatic1111 and ComfyUI. As ComfyUI is mentioned in several other places I decided to have a look at it. Installation In order to install ComfyUI I was looking for […]
Categories
Proxmox PVE – first steps
Install updates See here. -> “Updates” -> “Repositories“ Disable these repositories: Instead add the PVE “No-Subscription” version, if needed also add “Ceph Squid No-Subscription“. Go back to “Updates” and press “Refresh“, then “>_ Upgrade“. Terminal will show – confirm updates when requested. When finished you may need to reboot the machine (press “Reboot” button in […]
First: Store credentials for future kcadm.sh calls: Now we can use kcadm.sh without entering passwords every time (at least for some time): Lessons learned For security reasons I had TOTP activated for my (master realm) admin account. When trying to add credentials for kcadm.sh usage I always got: So I had to dig a little […]
What is litellm? litellm is a proxy server you can add between your LLM app and the LLM service. Why use litellm? litellm can be used to configure access, load balancing, accounting and many other things you might be interested in once you’re getting into the LLM business. Installation Install litellm proxy as described here: […]
While ollama does handle multiple different LLMs quite nicely (loading/unloading on demand) there are situations where you may want to run multiple instances of the same model at the same time (e.g. to increase throughput). Here’s how you can do so with minimal changes to your zero effort ollama installation. Let’s assume you just did […]
While trying to get OAUTH2 working with thunderbird, I tried and documented some things that may still be of interest (even if they didn’t give me the solution for my problem). If you’re only interested in the solution, you’d better look here. Otherwise keep reading 😉 Enforce auth type (thunderbird) So I tried to enforce […]