Are you aware of the Piefed API? It’s provided specifically to allow building front-ends and bots while avoiding scrapping.