But then you never see the “remember when John Brown burned down the slavers” memes