Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
shakedown.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A community for live music fans with roots in the jam scene. Shakedown Social is run by a team of volunteers (led by @clifff and @sethadam1) and funded by donations.

Administered by:

Server stats:

243
active users

shakedown.social: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

#localmodels

1 post1 participant0 posts today
Debby<p><span class="h-card" translate="no"><a href="https://wandering.shop/@Catvalente" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>Catvalente</span></a></span> </p><p>Or just use you AI locally 🦾 💻 🧠 </p><p>I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.</p><p>Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:</p><p> - Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.</p><p> - Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.</p><p> - Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.</p><p> - Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.</p><p> - Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.</p><p>For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.</p><p>It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.</p><p>In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.</p><p>CC: <span class="h-card" translate="no"><a href="https://wandering.shop/@Catvalente" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>Catvalente</span></a></span> <span class="h-card" translate="no"><a href="https://mastodon.social/@audubonballroon" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>audubonballroon</span></a></span> <br><span class="h-card" translate="no"><a href="https://universeodon.com/@calsnoboarder" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>calsnoboarder</span></a></span> <span class="h-card" translate="no"><a href="https://mastodon.au/@craigduncan" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>craigduncan</span></a></span> </p><p><a href="https://hear-me.social/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ArtificialIntelligence</span></a> <a href="https://hear-me.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenSource</span></a> <a href="https://hear-me.social/tags/LocalModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LocalModels</span></a> <a href="https://hear-me.social/tags/PrivacyLLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>PrivacyLLM</span></a> <a href="https://hear-me.social/tags/Customization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Customization</span></a> <a href="https://hear-me.social/tags/LocalAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LocalAI</span></a> <a href="https://hear-me.social/tags/Empowerment" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Empowerment</span></a> <a href="https://hear-me.social/tags/DigitalLiteracy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DigitalLiteracy</span></a> <a href="https://hear-me.social/tags/CriticalThinking" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CriticalThinking</span></a> <a href="https://hear-me.social/tags/EthicalAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EthicalAI</span></a> <a href="https://hear-me.social/tags/ResponsibleAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ResponsibleAI</span></a> <a href="https://hear-me.social/tags/Accessibility" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Accessibility</span></a> <a href="https://hear-me.social/tags/Inclusion" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Inclusion</span></a> <a href="https://hear-me.social/tags/Education" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Education</span></a></p>
Debby<p><span class="h-card" translate="no"><a href="https://fosstodon.org/@system76" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>system76</span></a></span> <br>I love <a href="https://hear-me.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a>, or as they're often called, <a href="https://hear-me.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a>, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.</p><p>However, if I wanted to be fully transparent to <a href="https://hear-me.social/tags/bigtech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigtech</span></a>, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.</p><p>So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?</p><p>I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻 <br><a href="https://hear-me.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenSource</span></a> <a href="https://hear-me.social/tags/Privacy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Privacy</span></a> <a href="https://hear-me.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://hear-me.social/tags/LocalModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LocalModels</span></a> <a href="https://hear-me.social/tags/SelfHosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SelfHosted</span></a> <a href="https://hear-me.social/tags/LinuxAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LinuxAI</span></a> <a href="https://hear-me.social/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LocalLLM</span></a> <a href="https://hear-me.social/tags/LocalAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LocalAI</span></a></p>
ExploreLive feeds
About