I was going to bed, but ran into this model released by some German lab out of nowhere https://huggingface.co/Aleph-Alpha/Kolibri-1 with quants that will run locally (24gb vram in my case), trying this one first: https://huggingface.co/Eliasfpv28/Kolibri-1-Q3_K_S-GGUF