Post #2329372 · Elektrine

2026-02-21 16:45 UTC

What we argued in Stochastic Parrots, however, was that you can get those benefits of the transformer architecture without ammassing datasets too large to collect with care (meaning consentfully, intentionally, and with the ability to document what's in the data). >>

Replies (3)

@stl8k@hci.social 2026-02-21 19:56

@emilymbender@dair-community.social "too large to collect with care" resonates strongly.

Open ##2329376
@gatesvp@mstdn.ca 2026-02-23 09:29

@emilymbender@dair-community.social "Datasets too large to collect with care" is a great line. Is there anyone actually doing this? I know Mozilla is trying this (CommonVoice) and they're incredibly unpopular right now. Could we have community support for such an organization?

Open ##2329377
@budududuroiu@hachyderm.io 2026-02-23 13:48

@emilymbender@dair-community.social > without ammassing datasets too large to collect with care I appreciate your post, and I'm a huge proponent for moving past the transformer. However, how is worrying about this not choosing "cooperate" every single time in the Prisoner's Dilemma when you know Meta & Co will always choose "defect"? This is worrying to me, because nefarious actors have no incentive to care about these issues (and actually have plenty of incentives to be hostile to these ideas). Also, they have institutional backing to do so.

Open ##2329380