Need a #free tool to handle messy #data?
@OpenRefine runs locally and is trusted by journalists, researchers, & contributors worldwide.
See how this #opensource tool empowers a global community: https://lpi.org/0f1n
#LPI #FOSS #OpenRefine #opensource #datacleaning #dataprivacy #BSD #Wikidata @wikidata
The {emend} R package leverages large language models to clean and standardize data:
Fix typos Map inconsistent entries Translate + reorder factors Clean addresses & dates
Install via CRAN: install.packages("emend")
https://anuopensci.github.io/emend/
Reproducibility may vary across systems. Validate before use.
#rstats #AI #DataCleaning #LLM #OpenSource #DataScience
Need to clean messy data with typos, abbreviations, or inconsistent labels? The {emend} R package uses LLMs to standardize categories, fix addresses & more – perfect for bioinformatics, business, or any data project.
https://cran.r-project.org/web/packages/emend/index.html
#rstats #DataCleaning #LLM #AI #OpenSource
Conseil de lecture : "Data Cleaning (Pocket Primer), Oswald Campesato".
#Data #DataCleaning #DataEngineer #Bash #Shell #VendrediLecture ... (sed, grep, awk et autres !)
Commandes basiques et bien plus pour le traitement de données !
Hello Fediverse, we are #OpenRefine, an open source power tool for working with messy data! We finally have an account here and will be sharing news about what is happening in the project and the broader community.
− @pintoch
Wondering whether anyone is interested in an ongoing thread about the process of #DataCleaning and #PaperWriting in our project about #NewsCoverage of #BlackProtest in mainstream newswires and Black newspapers. Lots of data to clean (~10K articles & ~10K events), so looking for ways to get papers along the way. We clean data by issue cluster, so I reviewed the #MillionManMarch articles & decided to see if there is a paper about that. I think I saw some interesting patterns.
