While experimenting with open-webui I was looking for options to use local LLM resources for image creation. Besides the commercial models, openwebui offers two alternatives : Automatic1111 and ComfyUI. As ComfyUI is mentioned in several other places I decided to have a look at it. Installation In order to install ComfyUI I was looking for […]
Category: Linux
First: Store credentials for future kcadm.sh calls: Now we can use kcadm.sh without entering passwords every time (at least for some time): Lessons learned For security reasons I had TOTP activated for my (master realm) admin account. When trying to add credentials for kcadm.sh usage I always got: So I had to dig a little […]
What is litellm? litellm is a proxy server you can add between your LLM app and the LLM service. Why use litellm? litellm can be used to configure access, load balancing, accounting and many other things you might be interested in once you’re getting into the LLM business. Installation Install litellm proxy as described here: […]
While ollama does handle multiple different LLMs quite nicely (loading/unloading on demand) there are situations where you may want to run multiple instances of the same model at the same time (e.g. to increase throughput). Here’s how you can do so with minimal changes to your zero effort ollama installation. Let’s assume you just did […]
Where (and why) it all began While trying to join an Ubuntu client to my Samba domain, I got this error that most likely prevented a successful login. From the sssd’s log files I got this as a first hint: So it looks like we got a problem with my Samba domain not serving GPO […]
While creating new docker instances I recently often got the following error message: In the beginning it helped to prune old network configs: But now I’m at a point where this does no longer help. Maybe the number of subnets is limited? So I currently got 33 subnets configured for docker … sounds close enough […]
Currently I’m using Nextcloud with snappymail as mail client. While this works nicely, I do have a “comfort problem” since I switched my Nextcloud authentication to SAML/SSO: I can no longer use the Nextcloud credentials to log into my mail account (as Nextcloud does not know about my password when using SSO). There’s two things […]
Categories
Using yubikey with ssh
While playing with passkeys I asked myself whether my Yubikey could also be used for SSH authentication using passkeys/FIDO2. And it seems for OpenSSH 8.2 and newer this is indeed possible. Its basic setup is described in detail by Yubico. However following that description didn’t work for me. I always got some “sign_and_send_pubkey” error: According […]
I’ve been using Keycloak for quite some time now, and I was looking forward to the new 26.4.0 release – now with official passkey support. Till now I was experimenting with edumfa (a clone of privacyIDEA) in order to get my Yubikey supported for multi factor authentication (MFA). This however required an extra connector (and […]
Some time ago I tried to use my AMD iGPUs (not supported by AMDs ROCm) for LLMs. However I didn’t succeed. Now I read some benchmark for the newest AMD Strix Halo systems performing quite well in some LLM tasks using vulkan instead of ROCm. Building vulkan enabled llama.cpp (using docker) Building llama.cpp using docker […]