I had this issue too with stardew valley when i realized i can just not interact with all of them, i just remember the key ones and use the menu to view all characters names and faces if i need it for a quest