In potentially related news: huggingface.co/jadael/comma-v0… "Comma v0.1-2T is a 7 billion parameter language model trained exclusively on openly licensed and public domain text from the Common Pile v0.1 dataset. This model demonstrates that competitive performance can be achieved using only ethically sourced training data."