@emilymbender@dair-community.social
2026-02-21 16:45 UTC
Replies (3)
-
@emilymbender@dair-community.social 2026-02-21 16:45
What we argued in Stochastic Parrots, however, was that you can get those benefits of the transformer architecture without ammassing datasets too large to collect with care (meaning consentfully, intentionally, and with the ability to document what's in the data). >>
-
@emilymbender@dair-community.social 2026-02-21 16:45
And you can build and use language models without turning them into the synthetic text extruding machines that are despoiling our information ecosystem. And even if those are easily accessible, because OpenAI et al want to burn through cash with their demos, we can still refute and refuse the narrative that synthetic text is somehow a panacea to be used across social services (medicine, education) and in science, etc. >>
-
@1337@techhub.social 2026-02-21 21:40
@emilymbender@dair-community.social Somewhat off-topic: I think some grammatical errors and typos are fine. I really don't like things that are too polished. I work with someone whom English is a second language, and he obviously uses LLMs to write messages. I'd rather read his own broken English than to wonder if the LLM generated what he actually meant. Similarly, I like live music recordings with mistakes and improvisation. Gives things more character, IMO. Over-polishing everything can lead to a type of bland conformity.