First: Store credentials for future kcadm.sh calls: Now we can use kcadm.sh without entering passwords every time (at least for some time): Lessons learned For security reasons I had TOTP activated for my (master realm) admin account. When trying to add credentials for kcadm.sh usage I always got: So I had to dig a little […]
Category: Linux
Basic config file Install and create postgres database Install postgres, create litellm user and database: Problems while setting up postgres See bug report: In case you get some error on litellm startup mentioning “prisma generate” (path to schema.prisma may vary on your installation): Creating API keys Once a database is configured and working, creating API […]
While ollama does handle multiple different LLMs quite nicely (loading/unloading on demand) there are situations where you may want to run multiple instances of the same model at the same time (e.g. to increase throughput). Here’s how you can do so with minimal changes to your zero effort ollama installation. Let’s assume you just did […]
Where (and why) it all began While trying to join an Ubuntu client to my Samba domain, I got this error that most likely prevented a successful login. From the sssd’s log files I got this as a first hint: So it looks like we got a problem with my Samba domain not serving GPO […]
While creating new docker instances I recently often got the following error message: In the beginning it helped to prune old network configs: But now I’m at a point where this does no longer help. Maybe the number of subnets is limited? So I currently got 33 subnets configured for docker … sounds close enough […]
Currently I’m using Nextcloud with snappymail as mail client. While this works nicely, I do have a “comfort problem” since I switched my Nextcloud authentication to SAML/SSO: I can no longer use the Nextcloud credentials to log into my mail account (as Nextcloud does not know about my password when using SSO). There’s two things […]
Categories
Using yubikey with ssh
While playing with passkeys I asked myself whether my Yubikey could also be used for SSH authentication using passkeys/FIDO2. And it seems for OpenSSH 8.2 and newer this is indeed possible. Its basic setup is described in detail by Yubico. However following that description didn’t work for me. I always got some “sign_and_send_pubkey” error: According […]
I’ve been using Keycloak for quite some time now, and I was looking forward to the new 26.4.0 release – now with official passkey support. Till now I was experimenting with edumfa (a clone of privacyIDEA) in order to get my Yubikey supported for multi factor authentication (MFA). This however required an extra connector (and […]
Some time ago I tried to use my AMD iGPUs (not supported by AMDs ROCm) for LLMs. However I didn’t succeed. Now I read some benchmark for the newest AMD Strix Halo systems performing quite well in some LLM tasks using vulkan instead of ROCm. Building vulkan enabled llama.cpp (using docker) Building llama.cpp using docker […]
Motivation I’m currently playing around with some LLMs for different projects. One project aims to add textual descriptions to a large image gallery. Those descriptions can be used both for better image organization or as alternative texts when publishing them on websites. My basic setup contains ollama for running the LLMs and some python code […]