Today I finally learn about vim undofile/undodir and how to set the swap dir to somewhere else. Now it all nicely lives in ~/.cache/vim/ and with an mkdir -p call in there too, so I don't forget on my next machine those have to be created.