Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
shakedown.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A community for live music fans with roots in the jam scene. Shakedown Social is run by a team of volunteers (led by @clifff and @sethadam1) and funded by donations.

Administered by:

Server stats:

293
active users

shakedown.social: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.4

#tokenwars

0 posts0 participants0 posts today
Kathy Reid<p>ICYMI: I'll be talking at the Melbourne <a href="https://aus.social/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ML</span></a> and <a href="https://aus.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> Meetup in a couple weeks' time about the <a href="https://aus.social/tags/TokenWars" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TokenWars</span></a> - the conflict for data to train LLMs and the fight by IP rights holders to protect their data from scrapers. </p><p>Come learn about how <a href="https://aus.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLMs</span></a> are trained on huge volumes of tokens with transformers, why those tokens are becoming more economically valuable, and what you can do to protect your token treasure. </p><p>You'll never look at ChatGPT or data the same way again. </p><p>Huge thanks to <span class="h-card" translate="no"><a href="https://mastodon.social/@jonoxer" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>jonoxer</span></a></span> for the recommend, and to Lizzie Silver for the behind the scenes wrangling.</p><p><a href="https://www.meetup.com/machine-learning-ai-meetup/events/306548300" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">meetup.com/machine-learning-ai</span><span class="invisible">-meetup/events/306548300</span></a></p>
Kathy Reid<p>If you weren't able to make <span class="h-card" translate="no"><a href="https://fosstodon.org/@everythingopen" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>everythingopen</span></a></span> in Adelaide in January but were still keen to catch my talk on the <a href="https://aus.social/tags/TokenWars" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TokenWars</span></a> in <a href="https://aus.social/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ML</span></a> - the hunt for real, human data amidst a sea of AI-generated slop - then don't despair! </p><p>I'm delighted to be giving this talk again at the Melbourne ML and AI meetup in mid-April - with thanks to Lizzie Silver for the behind the scenes organisation and to Jonathan Oxer for making the connection. </p><p>Seats are strictly limited - so sign up as soon as you can! </p><p>📅 Tuesday 15th April, 6pm to 8pm AEST<br>📍 Docklands Hub, next to Library at the Dock, 912 Collins Street, Melbourne</p><p>Talk Title: The Token Wars: why not all our content should be open</p><p>Abstract: In recent years, there has been an explosion in generative AI. Most of us are now familiar with tools like ChatGPT, Midjourney, Sora, and others. At the heart of generative AI is a machine learning architecture called the "transformer", which is fed by huge datasets - text, images and videos. Those datasets are "tokenised" - cut up into chunks which the transformer can ingest. Those actors who can obtain the most tokens can generally train the best models (for various values of "best").</p><p>We are now witnessing a battle between the creators of generative AI models - who seek to obtain as much data as possible for tokenisation - while their targets try to stop them. The social ramifications of this resource conflict are widespread, resulting in "alateral damage" - a term I am coining to point to the unforeseen, unintended, distal consequences of a seemingly innocuous technology.</p><p>These are the Token Wars.</p><p>And they're the reason not all our content should be openly available.</p><p>In this three-part talk, I first provide a technical grounding on transformers, tokens and how they're used to build text-based generative AI. In the second part, I draw on economics to ask, "why are tokens so valuable?", showing that as the internet becomes filled with AI slop, human-created data is becoming more scarce - and so more expensive. In the third part I explore how you might approach guarding your token treasure, from data poisoning to alternative licensing models and data sovereignty.</p><p>You'll leave this talk never looking at data or ChatGPT the same way again.</p><p><a href="https://www.meetup.com/machine-learning-ai-meetup/events/306548300/?utm_medium=referral&amp;utm_campaign=share-btn_savedevents_share_modal&amp;utm_source=link" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">meetup.com/machine-learning-ai</span><span class="invisible">-meetup/events/306548300/?utm_medium=referral&amp;utm_campaign=share-btn_savedevents_share_modal&amp;utm_source=link</span></a></p>
ExploreLive feeds
About