shakedown.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A community for live music fans with roots in the jam scene. Shakedown Social is run by a team of volunteers (led by @clifff and @sethadam1) and funded by donations.

Administered by:

Server stats:

268
active users

#reproducibility

5 posts3 participants0 posts today
petersuber<p>Retractions and failures to replicate are signs of weak research. But they're also signs of laudable and necessary efforts to identify weak research and improve future research. The <a href="https://fediscience.org/tags/Trump" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Trump</span></a> admin is systematically weaponizing these efforts to cast doubt on science as such. </p><p>"Research-integrity sleuths say their work is being ‘twisted’ to undermine science."<br><a href="https://www.nature.com/articles/d41586-025-02163-z" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">nature.com/articles/d41586-025</span><span class="invisible">-02163-z</span></a> </p><p><a href="https://fediscience.org/tags/DefendResearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DefendResearch</span></a> <a href="https://fediscience.org/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a> <a href="https://fediscience.org/tags/Retractions" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Retractions</span></a> <a href="https://fediscience.org/tags/Trump" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Trump</span></a> <a href="https://fediscience.org/tags/TrumpVResearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TrumpVResearch</span></a> <a href="https://fediscience.org/tags/USPol" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>USPol</span></a> <a href="https://fediscience.org/tags/USPolitics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>USPolitics</span></a></p>
bladderbot<p><span class="h-card" translate="no"><a href="https://neuromatch.social/@elduvelle" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>elduvelle</span></a></span> Sure - let’s add to the problem of reproducibility (retraction rates are already much higher for high-impact journals, incl. Nature – Brembs et al 2013 "Deep impact: unintended consequences of journal rank." Frontiers in human Neuroscience) by adding AI peer reviewers and watch academic publishing enshittify further. <a href="https://mastodon.online/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> <a href="https://mastodon.online/tags/impactfactor" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>impactfactor</span></a> <a href="https://mastodon.online/tags/ScientificJournals" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ScientificJournals</span></a></p>
Björn Brembs<p>The killer quote! Prestigious institutions and prestigious journals drive irreproducibility in the life sciences - well, at least in this particular sample.</p><p><a href="https://www.biorxiv.org/content/10.1101/2025.07.07.663460v2" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">biorxiv.org/content/10.1101/20</span><span class="invisible">25.07.07.663460v2</span></a></p><p><a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> <a href="https://mastodon.social/tags/impactfactor" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>impactfactor</span></a></p>
Björn Brembs<p>And yet another one in the ever increasing list of analyses showing that top journals are bad for science:</p><p>"Thus, our analysis show major claims published in low-impact journals are significantly more likely to be reproducible than major claims published in trophy journals. "</p><p><a href="https://www.biorxiv.org/content/10.1101/2025.07.07.663460v2" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">biorxiv.org/content/10.1101/20</span><span class="invisible">25.07.07.663460v2</span></a></p><p><a href="https://mastodon.social/tags/publishing" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>publishing</span></a> <a href="https://mastodon.social/tags/openscience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>openscience</span></a> <a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a></p>
Björn Brembs<p>To my knowledge, first time that not only prestigious journals, but also prestigious institutions are implicated as major drivers of irreproducibility:</p><p>"Higher representation of challenged claims in trophy journals and from top universities"</p><p><a href="https://www.biorxiv.org/content/10.1101/2025.07.07.663460v2" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">biorxiv.org/content/10.1101/20</span><span class="invisible">25.07.07.663460v2</span></a></p><p><a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> <a href="https://mastodon.social/tags/openscience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>openscience</span></a></p>
Pete Bachant<p>Tips for using Jupyter notebooks as part of a reproducible workflow (one that goes from raw data to research article with a single command): <a href="https://docs.calkit.org/notebooks" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">docs.calkit.org/notebooks</span><span class="invisible"></span></a></p><p><a href="https://fediscience.org/tags/openscience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>openscience</span></a> <a href="https://fediscience.org/tags/jupyter" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>jupyter</span></a> <a href="https://fediscience.org/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a></p>
UniversityofGroningenLibrary<p>We invite staff and students at the University of <a href="https://social.edu.nl/tags/Groningen" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Groningen</span></a> to share how they are making <a href="https://social.edu.nl/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>research</span></a> or <a href="https://social.edu.nl/tags/teaching" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>teaching</span></a> more open, accessible, transparent, or reproducible, for the 6th annual <a href="https://social.edu.nl/tags/OpenResearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenResearch</span></a> Award. </p><p>Looking for inspiration?<br>Explore the case studies submitted in previous years:<br>🔗 <a href="https://www.rug.nl/research/openscience/open-research-award/previous-events" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">rug.nl/research/openscience/op</span><span class="invisible">en-research-award/previous-events</span></a></p><p>More info:<br>🔗 <a href="https://www.rug.nl/research/openscience/open-research-award/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">rug.nl/research/openscience/op</span><span class="invisible">en-research-award/</span></a></p><p><a href="https://social.edu.nl/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenScience</span></a> <a href="https://social.edu.nl/tags/OpenEducation" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenEducation</span></a> <a href="https://social.edu.nl/tags/OpenAccess" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenAccess</span></a> <a href="https://social.edu.nl/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a> <br><span class="h-card" translate="no"><a href="https://mastodon.social/@oscgroningen" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>oscgroningen</span></a></span></p>
eLife<p>7/ Wei Mun Chan, Research Integrity Manager</p><p>With 10+ years in publishing and data curation, Wei Mun ensures every paper meets our high standards for ethics and <a href="https://fediscience.org/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a>. From image checks to data policies, he’s the quiet force keeping the scientific record trustworthy.</p>
Peer Community In<p>Here is how PCI is elevating the standards for open and reproducible science: introducing 4 already-existing and 2 new features 🧵👇<br><a href="https://ecoevo.social/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenScience</span></a> <a href="https://ecoevo.social/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a></p>
UniversityofGroningenLibrary<p>🎙"<a href="https://social.edu.nl/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a> isn’t just about repeating results, it’s about making the <a href="https://social.edu.nl/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>research</span></a> process transparent, so others can follow the path you took and understand how you got there."</p><p>🎧Listen to our new OpenScience podcast with Sarahanne Field <span class="h-card" translate="no"><a href="https://akademienl.social/@smirandafield" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>smirandafield</span></a></span> </p><p>🔗 <a href="https://www.rug.nl/research/openscience/podcast/#Field" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">rug.nl/research/openscience/po</span><span class="invisible">dcast/#Field</span></a></p><p>⏳ In this 10 min episode, Sarahanne reimagines reproducibility for <a href="https://social.edu.nl/tags/qualitative" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>qualitative</span></a> research.<br>She addresses challenges in ethical <a href="https://social.edu.nl/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>data</span></a> sharing of transcripts, and the importance of clear methodological reporting.</p>
OpenScienceCommunityGroningen<p>🫖 Reproducibili HIGH Tea with Don van Ravenzwaaij<br>📅 Tue, May 20 | 🕑 2–3 PM CET<br>📍 H.0431 (Heijmans) &amp; <a href="https://osc-international.us4.list-manage.com/track/click?u=fa279e9b279d77a612c19105f&amp;id=c54b2c5758&amp;e=c7c7b4acc0" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">osc-international.us4.list-man</span><span class="invisible">age.com/track/click?u=fa279e9b279d77a612c19105f&amp;id=c54b2c5758&amp;e=c7c7b4acc0</span></a> <br>🔍 Learn how to de-identify data for open sharing!<br>👉 Don’t miss it! <br><a href="https://mastodon.social/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenScience</span></a> <a href="https://mastodon.social/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a> <a href="https://mastodon.social/tags/DataPrivacy" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataPrivacy</span></a></p>
petersuber<p>New study: <a href="https://fediscience.org/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ChatGPT</span></a> is not very good at predicting the <a href="https://fediscience.org/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> of a research article from its methods section. <br><a href="https://link.springer.com/article/10.1007/s10115-025-02428-z" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">link.springer.com/article/10.1</span><span class="invisible">007/s10115-025-02428-z</span></a></p><p>PS: Five years ago, I asked this question on Twitter/X: "If a successful replication boosts the credibility a research article, then does a prediction of a successful replication, from an honest prediction market, do the same, even to a small degree?"<br><a href="https://x.com/petersuber/status/1259521012196167681" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">x.com/petersuber/status/125952</span><span class="invisible">1012196167681</span></a></p><p>What if <a href="https://fediscience.org/tags/LLMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLMs</span></a> eventually make these predictions better than prediction markets? Will research <a href="https://fediscience.org/tags/assessment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>assessment</span></a> committees (notoriously inclined to resort to simplistic <a href="https://fediscience.org/tags/metrics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>metrics</span></a>) start to rely on LLM replication or reproducibility predictions? </p><p><a href="https://fediscience.org/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://fediscience.org/tags/ScholComm" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ScholComm</span></a></p>
Center for Open Science<p>🚨 New RFP Open! COS is funding open source developers to build or enhance tools that integrate with the Open Science Framework (OSF).</p><p>Got an idea to make open science more powerful? We want to hear it.</p><p> 🔗<a href="http://cos.io/pose" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">http://</span><span class="">cos.io/pose</span><span class="invisible"></span></a></p><p> <a href="https://fosstodon.org/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenScience</span></a> <a href="https://fosstodon.org/tags/OSS" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OSS</span></a> <a href="https://fosstodon.org/tags/Grants" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Grants</span></a> <a href="https://fosstodon.org/tags/DevCommunity" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DevCommunity</span></a> <a href="https://fosstodon.org/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a></p>
Björn Brembs<p>A propos of nothing in particular 😇 a rough estimate of the size of the papermill problem in the scientific literature:</p><p><a href="https://bjoern.brembs.net/2024/02/how-reliable-is-the-scholarly-literature/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">bjoern.brembs.net/2024/02/how-</span><span class="invisible">reliable-is-the-scholarly-literature/</span></a></p><p>(from last year)</p><p><a href="https://mastodon.social/tags/acadmicchatter" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>acadmicchatter</span></a> <a href="https://mastodon.social/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>science</span></a> <a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a></p>
PLOS Biology<p>Reproducibility in <a href="https://fediscience.org/tags/insect" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>insect</span></a> studies. Using a 3x3 experimental design, 3 labs, 3 species &amp; 3 experiments, this study reveals cases of both sufficient &amp; poor <a href="https://fediscience.org/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a>, highlighting opportunities for improving rigor in insect research <span class="h-card" translate="no"><a href="https://fediscience.org/@PLOSBiology" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>PLOSBiology</span></a></span> <a href="https://plos.io/3EzuIxj" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">plos.io/3EzuIxj</span><span class="invisible"></span></a></p>
UniversityofGroningenLibrary<p>🎙️"<a href="https://social.edu.nl/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reproducibility</span></a> should be a key factor in all your <a href="https://social.edu.nl/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>research</span></a>, in all your projects. It costs time, but it's also shifting the time, and in the end it can save time again."</p><p>🎧Listen to the latest episode of our <a href="https://social.edu.nl/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenScience</span></a> Bites podcast with Michiel de Boer of the <span class="h-card" translate="no"><a href="https://mastodon.social/@Dutch_Reproducibility_Network" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>Dutch_Reproducibility_Network</span></a></span> <br>🔗 <a href="https://www.rug.nl/research/openscience/podcast/#de-boer" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">rug.nl/research/openscience/po</span><span class="invisible">dcast/#de-boer</span></a> </p><p>⏳Open Science Bites is a series of short <a href="https://social.edu.nl/tags/podcast" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>podcast</span></a> episodes - each around 10 minutes long - focusing on one specific open science practice.</p><p><a href="https://www.rug.nl/opensciencebites" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">rug.nl/opensciencebites</span><span class="invisible"></span></a></p>
Johann Dr.EO<p>Recently, I got several opportunities to discuss the reproducibility crisis in science. To help discuss that complex topic, we need to agree on a vocabulary.</p><p>My favorite one has been published by Manuel López-Ibáñez, Juergen Branke and Luis Paquete, and is summarized in the attached diagram, which you can also find here: <a href="http://nojhan.net/tfd/vocabulary-of-reproducibility.html" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">http://</span><span class="ellipsis">nojhan.net/tfd/vocabulary-of-r</span><span class="invisible">eproducibility.html</span></a></p><p>It's good that this topic is not fading away, but is gaining traction. "Slowly, but surely", as we say in French.</p><p>If you want a high resolution suitable for impression, do not hesitate to ask!</p><p><a href="https://social.sciences.re/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> <a href="https://social.sciences.re/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>science</span></a> <a href="https://social.sciences.re/tags/epistemology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>epistemology</span></a></p>
Preston Maness ☭<p><span class="h-card" translate="no"><a href="https://bsd.network/@lcheylus" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>lcheylus</span></a></span> That is a monumental achievement! Congrats <a href="https://tenforward.social/tags/debian" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>debian</span></a>! <a href="https://tenforward.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> <a href="https://tenforward.social/tags/reproducible" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducible</span></a></p>
Björn Brembs<p>It's been known for quite some time that more prestigious journals publish less reliable <a href="https://mastodon.social/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>science</span></a>. Now two papers provide compelling empirical evidence as to potential underlying mechanisms:</p><p><a href="https://www.journals.uchicago.edu/doi/10.1086/733398" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">journals.uchicago.edu/doi/10.1</span><span class="invisible">086/733398</span></a><br><a href="https://academic.oup.com/qje/advance-article/doi/10.1093/qje/qjaf010/7997678" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">academic.oup.com/qje/advance-a</span><span class="invisible">rticle/doi/10.1093/qje/qjaf010/7997678</span></a></p><p>The gist of the story is that scientists are so afraid of being scooped that they cut corners. Corner-cutting is rewarded by hi-ranking journal publications and the successful authors then teach their students how to get ahead in science.</p><p><a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a></p>
Björn Brembs<p>These 2 papers provide compelling empirical evidence that competition in <a href="https://mastodon.social/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>science</span></a> leads to sloppy work being preferentially published in hi-ranking journals:<br><a href="https://www.journals.uchicago.edu/doi/10.1086/733398" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">journals.uchicago.edu/doi/10.1</span><span class="invisible">086/733398</span></a><br><a href="https://academic.oup.com/qje/advance-article/doi/10.1093/qje/qjaf010/7997678" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">academic.oup.com/qje/advance-a</span><span class="invisible">rticle/doi/10.1093/qje/qjaf010/7997678</span></a><br>Using the example of structural <a href="https://mastodon.social/tags/biology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>biology</span></a> , the authors report that scientists overestimate the damage of being scooped, leading to corner-cutting and sloppy work in the race to be first. Faster scientists then end up publishing sloppier work in higher-ranking journals.</p><p><a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a></p>