FYI, If you run a pixelfed instance: If you have PF_MEDIA_FAST_PROCESS set to False, be aware that the posts probably aren't federating properly. You can take my patch if you want, or just set the setting to true for now. (The downside of true is that the federated images won't hit your s3 bucket/CDN). Check your horizon logs for NewStatusPipeline failures to confirm
@dansup
Nope, applied it, didn't change anything.
So the issue is clearly isolated : it's the scheduled task eating all memory every 6 hours before getting oom killed: /usr/bin/php8.4 artisan app:account-post-count-stat-update
Since it eats up 28+ GB of RAM, adding more is not the solution.
Is there a way to limit the memory used by this job without blocking subsequent php processes?
Why did this suddenly occur despite not changing anything on my side? Pixelfed is at 0.12.4 version and was not updated recently on my side.
Thanks! Am I the only one to experience this issue?
Message for #Pixelfed admins
Do any of you encounter the following? Every 6 hours and consistently, my pixelfed server goes into a high memory usage, process is php-fpm triggered by pixelfed, before being killed by oom. Clearly a bot, never happened before.
Now I changed server with a full fresh install and new IP but it still goes on (even changed OS from 22.04 to 24.04, bumped RAM from 16 to 32 GB and php8.3 version to 8.4).
Do you administrators see similar behavior? See attached Grafana/Prometheus dashboard for illustration on a 24-hours period.
Any clue on how to mitigate such DoS attacks?
Okay we appear to back to fully normal now. That was a rough one!
Apologies to homestead.social and pix.lgbt folks for the downtime! Will be gathering my thoughts and post a post-incident report as a reply to this post soon.
@honze_net I absolutely agree.
I haven't posted publicly about this yet (I plan to do a write-up soon) but pix.lgbt and homestead.social are built on a cluster (all on Raspberry Pis) that I built to be fully mobile (literally has a handle on it), with a solar powered battery backup, and dual mobile WANs (fully encrypted over Wireguard VPN) in case we need to flee.
We're not going anywhere!
And now it's time for your semi-regular reminder that the fediverse is ran by volunteers usually paying for hosting costs out of their own pockets.
Please consider donating to the admin(s) of your local instance! Every bit helps!
Here's mine for homestead.social and pix.lgbt 
Well cascading outages are fun! 
/sarcasm
Sorry for the downtime to the homestead.social and pix.lgbt folks! ...But everything appears to be coming back to normal. And on a positive note, we are now more resilient with a multi-wan setup for better resiliency / uptime.
I dumped my Mastodon hashtag table from the database and of the hundreds of thousands of hashtags, there were 274 that had the phrase #Pixelfed in it and there was a #PixelFedAdmin tag, but it just not very active.
Thank goodness Mastodon will soon get Hashtag Admin searchability because my days of dumping the tags to csv to find the tag ID for editing is almost over. LOL
Updated Pixelfed on my #selfhost for the first time in forever! (went from 0.11.? to 0.12.3). It had been so long that I had to do a bunch of other updates to php which hadn't kept up since I had updated to php 8.3 in the meantime. @chris@pixelfed.chrisalemany.ca
https://pixelfed.chrisalemany.ca/i/web/post/716693698672783361
I'm discontinuing NixOrigin.one ..
Please migrate your account to another instance.
If you need any help with the migration don't hesitate to contact me.
I didn't want to do this. But I don't have any other option at this moment.
I'm really sad to say that I'm considering shutting down NixOrigin.one, my 1.5-year-old Pixelfed instance. I've been unable to resolve some issues for over a month, and I recently missed a storage bill, causing photo uploads and local photo viewing to stop working. Avatars aren't displaying either. I feel terrible that people have reached out to me on email and Twitter, and one person even deleted their account after I said it might take a few more days. The root of the problem is my empty wallet, and I'm determined to set up my own earning methods, but it will take time. I have some business ideas in mind.
We're changing the nameserver of nixorigin.one ..
DNS Propotation might take a while.
Parental Controls are now available on nixorigin.one ..
You can add upto 20 (?) children
Thanks @dansup for adding this feature on Pixelfed ..
If you want to enable this on your instance, add the following configuration in .env:
INSTANCE_PARENTAL_CONTROLS=true
INSTANCE_PARENTAL_CONTROLS_MAX_CHILDREN=1
Anyone else having issues with Profile Picture on @pixelfed ?
Nothing in the logs, no failed horizon jobs .. Uploaded profile picture is not being shown..
by Eli Burdette
Now I feel guilty that I haven't posted from my pixelfed @chris@pixelfed.chrisalemany.ca account for over a month. (see linked stats
) The reason why is it turned out there was no fix for the issue of not being able to see mstdn and pxlf accounts from one another becauee they are on the same physical box. 
https://mastodont.cat/@fediverse/111486523331045613
#stats #mastodon #fediverse #pixelfed #selfhost #mastoadmin #pixelfedAdmin
BarbaPulpe 
ᴹᵃˢᵗᵒᵈᵒⁿ 
