Incidents and maintenance reported on status page for Fedecan https://status.fedecan.ca/ en https://status.fedecan.ca/maintenance/928370 Fri, 19 Jun 2026 02:58:04 -0000 https://status.fedecan.ca/incident/928370#666106c34b6af109bbc67a6b6bc0887dc08f7423b91671eb57cf6fcfad9a078a Maintenance All services will be unavailable while we apply OS patches https://status.fedecan.ca/maintenance/855012 Sun, 22 Mar 2026 21:04:50 -0000 https://status.fedecan.ca/incident/855012#a1e4e6c1ded9b601cb383cf89735edb909e67d27656a866f0fd03a07564a0b96 Maintenance We're moving away from Cloudflare. No impact is expected, but you may see some brief errors as we update configs. https://status.fedecan.ca/maintenance/826639 Mon, 16 Feb 2026 16:24:26 -0000 https://status.fedecan.ca/incident/826639#95c6e838a98827f6e26908ab73c7412148729321f31a991f96e42f3518e999d6 Maintenance Pixelfed.ca is currently being migrated off Cloudflare. https://status.fedecan.ca/maintenance/816460 Sun, 01 Feb 2026 22:58:00 -0000 https://status.fedecan.ca/incident/816460#7741b77b62860b7c3ce480d90865fc55ba41110a6295ababfc75495573b78006 Maintenance Unfortunately upgrading to the latest piefed revealed an encoding issue with our database, that requires a dump + restore of the database. This should take under an hour, expect us back online before 4pm PST. https://status.fedecan.ca/maintenance/816438 Sun, 01 Feb 2026 21:25:00 -0000 https://status.fedecan.ca/incident/816438#5cfb234667e1d48e03b82641c3713f91eae303043214b9bec7810c136193b28f Maintenance Upgrading to the latest piefed, back in a few mins! https://status.fedecan.ca/maintenance/793369 Wed, 24 Dec 2025 04:00:00 -0000 https://status.fedecan.ca/incident/793369#441279275cfed818f34cc4cc97030dceee49a2dcbc81ca777b1396cd065279fb Maintenance Upgrading us to the latest piefed 1.4 https://status.fedecan.ca/maintenance/541995 Tue, 08 Apr 2025 16:30:09 -0000 https://status.fedecan.ca/incident/541995#509305b82f70c551b6804a38bb5cbb95048ad0953788081099f0f0b671327230 Maintenance Upgrading to 0.19.11 https://status.fedecan.ca/maintenance/502669 Mon, 27 Jan 2025 18:08:15 -0000 https://status.fedecan.ca/incident/502669#2662c3f20e877017c24e24c9410a5ec4b37cdb9bf3a1a0d20b40f7cb1f5b5334 Maintenance We'll be offline for about 2 hours as we migrate pictrs from it's internal sled database, over to our postgres deployment https://status.fedecan.ca/maintenance/502668 Mon, 27 Jan 2025 18:07:27 -0000 https://status.fedecan.ca/incident/502668#c927c18c0c838323b9ef0fa5333ab14b5f79dd59e73d466bd952e9c8803b088b Maintenance We'll be offline while we migrate from OVH to our new dedicated hardware. https://status.fedecan.ca/maintenance/492702 Wed, 08 Jan 2025 17:34:53 -0000 https://status.fedecan.ca/incident/492702#e8ea47190cb6725d6b2931dc29fa625ed208b6d153518cc1eda1cadc476b59fe Maintenance Taking the site down for about 5 minutes, so that we can get a consistent copy of our databases (postgres + pict-rs sled). https://status.fedecan.ca/incident/492083 Tue, 07 Jan 2025 16:42:00 -0000 https://status.fedecan.ca/incident/492083#31c0260d5d385312faeec86b3b5cfea4c1cf2229beec7737c131d39a87fe988a Incident We're back again.... https://status.fedecan.ca/incident/492083 Tue, 07 Jan 2025 16:36:00 -0000 https://status.fedecan.ca/incident/492083#37572d7a6db7a7bc4f40e8abd7b8e4412ab1fa1e7e5e6fb071fa4bd4ca4856df Incident They seem to be replacing our power supply again https://status.fedecan.ca/incident/492083 Tue, 07 Jan 2025 16:11:00 -0000 https://status.fedecan.ca/incident/492083#21fa02250e03b9f526535b689e357646c88dfcaadc6c1f2c1af56fa76a05deaa Incident Ahhhh the server is down again. Talking to OVH to get us back up ASAP. https://status.fedecan.ca/incident/491086 Mon, 06 Jan 2025 20:21:00 -0000 https://status.fedecan.ca/incident/491086#a96b5510f6d9228eea378143b3926ef84af0199b1b138e9707ad1ba247dc20d4 Incident We're back! https://lemmy.ca/post/36540245 https://status.fedecan.ca/incident/491086 Mon, 06 Jan 2025 19:18:00 -0000 https://status.fedecan.ca/incident/491086#c720b921cfd70034c56fcc2a7e80b703e26245e8fd8199878ee76adb0038e034 Incident We're still waiting on OVH to repair the hardware, the datacenter tech has been working on it for about 3 hours now. Hopefully back soon! https://status.fedecan.ca/incident/491086 Sun, 05 Jan 2025 18:19:00 -0000 https://status.fedecan.ca/incident/491086#cae41b10df14806c503c9c5990f7580d72d27ccbced0a234ba6e45eacc8a2a7c Incident Jan 5th 10:19am PST - Our server appears to have had a physical hardware failure. We have a support ticket open with OVH, but no ETA on repairs at this time. Jan 5th 12:07pm PST - No sign that OVH has looked at our ticket yet, and no way to contact them until business hours tomorrow. This might be a while unfortunately. Jan 6th 08:05am PST - OVH is finally investigating, hopefully back up soon. https://status.fedecan.ca/maintenance/466638 Sat, 23 Nov 2024 20:57:05 -0000 https://status.fedecan.ca/incident/466638#62b944c877e97c9940b9accb1a31674779d992e85bf18d689b71592c715bee1d Maintenance Upgrading to the latest lemmy release https://status.fedecan.ca/maintenance/467019 Tue, 05 Nov 2024 16:00:00 -0000 https://status.fedecan.ca/incident/467019#7ac288c15860751d36835fa0057c2e430c526bee1c66431ea9e2c04da144217a Maintenance One of our NVMe drives has failed and our service provider requires a 2 hour maintenance window to replace it. Hopefully the actual outage will be significantly shorter. https://status.fedecan.ca/maintenance/393710 Thu, 04 Jul 2024 19:25:55 -0000 https://status.fedecan.ca/incident/393710#4018ac3d0e8eb912ca0aa730e5797164c2fa5f7cf73f85c2b3c558d40d10381c Maintenance We'll be performing some tuning and upgrades to improve performance and hopefully resolve the recent instability isssues. https://status.fedecan.ca/maintenance/381205 Fri, 07 Jun 2024 22:50:00 -0000 https://status.fedecan.ca/incident/381205#01d9b5c2b28f12cd4c0339faeea2f4166b2ac7c6bf4906fbc0be654e941c77d9 Maintenance Currently upgrading to 0.19.4, see https://lemmy.ca/post/22742132 for more details https://status.fedecan.ca/maintenance/327868 Fri, 16 Feb 2024 21:43:32 -0000 https://status.fedecan.ca/incident/327868#5c8fa21fa2ce275066dffe7979d243c924c5a6c123cae6ad283d7a6b7b9b7dda Maintenance Applying the latest ubuntu updates, and migrating us to use multiple lemmy / lemmy-ui containers for better resiliency. See https://lemmy.ca/post/15548660 https://status.fedecan.ca/maintenance/301024 Fri, 15 Dec 2023 16:19:00 -0000 https://status.fedecan.ca/incident/301024#2a7353372e933213254def3b5a988897c227fd43ba83c7925009df8db368f5c5 Maintenance Site will be down for a bit while we upgade to 0.19 https://status.fedecan.ca/incident/266253 Sat, 30 Sep 2023 02:32:00 -0000 https://status.fedecan.ca/incident/266253#e9f92ebbcf8d8a89ac055f3e050c34df46e530ab4f0c90843dc39daa960d4527 Incident Back online https://status.fedecan.ca/incident/266253 Sat, 30 Sep 2023 02:30:00 -0000 https://status.fedecan.ca/incident/266253#ab05b1222b544c6b7bad7234129f00169951c9a9bca070b829fbd8c8fe7df65b Incident Tried to do a quick update to 0.18.5 but had a kernel lockup on shutting down an old container. Had to hard power cycle the server, should be back up in a few minutes. https://status.fedecan.ca/maintenance/257501 Sun, 10 Sep 2023 16:40:51 -0000 https://status.fedecan.ca/incident/257501#42a05cca8f2d1f97b521f56ff33cb3c5978a95b3c5c1bf173219c37849620d94 Maintenance We're finally running low on disk space so we need to migrate our image uploads over to object storage. This will require some brief downtime at the start, then hopefully I should be able to bring the site back online while the images migrate. https://status.fedecan.ca/incident/239732 Mon, 31 Jul 2023 16:19:00 -0000 https://status.fedecan.ca/incident/239732#f5bfabc978d6c4bd597acadbea9e65b5dab3d563edeecfae8051cc1325000b9f Incident Looking into what happened overnight that knocked us offline for a while. We lost network link on the server, so we're following up with OVH. Update: It was an OVH billing issue, even though we had auto-renew enabled they didn't renew properly :( https://status.fedecan.ca/incident/238592 Fri, 28 Jul 2023 15:14:00 -0000 https://status.fedecan.ca/incident/238592#d8873f92274c75add1d8b0c2602c65a2d40d070f3fdf61839538db7df3cd4631 Incident 08:14 - Went to upgrade to lemmy 0.18.3 and it triggered a kernel panic. System is rebooting now. 08:20 - System is back up but DB upgrades are currently running for 0.18.3, should be back online shortly. 08:30 - All sorted out and online with 0.18.3, enjoy! https://status.fedecan.ca/incident/236558 Mon, 24 Jul 2023 03:13:00 -0000 https://status.fedecan.ca/incident/236558#769a090cd46e63a805e35b1325633f4d9dc07714773c465f81ed14dd2d682aa9 Incident Something strange is going on with the memory in our server, currently investigating but things should be back online and stable for now. Edit: Fixed fully now, was a hugepages misconfig. https://status.fedecan.ca/maintenance/235791 Fri, 21 Jul 2023 18:20:55 -0000 https://status.fedecan.ca/incident/235791#76d53e8ce640b59781d4ac5acb6c1e44dd88b7719d48eda6c8f9010ec6d9e7af Maintenance We'll be taking things down for a bit to apply OS updates and do some kernel/network tuning. https://status.fedecan.ca/incident/235750 Fri, 21 Jul 2023 15:41:00 -0000 https://status.fedecan.ca/incident/235750#bcb2f2256f2f6aacd32d74c68ea16dca9b51e95b03afd357a3b954667cc761de Incident Seeing more database locks again, have killed off the offending queries while we dig more. Update: This mornings slow delete query came in from the fediverse and impacted multiple lemmy sites at the same time. The core issue is https://github.com/LemmyNet/lemmy/issues/3165 https://status.fedecan.ca/incident/234523 Tue, 18 Jul 2023 20:57:00 -0000 https://status.fedecan.ca/incident/234523#5f76fc2dbaeb097b271dd18186aeccf821d7fbef250adc9df533d6ca03b43d5e Incident Just restarted services quickly to fix the Hot feed - https://lemmy.ca/post/1685851?scrollToComments=true https://status.fedecan.ca/incident/234064 Mon, 17 Jul 2023 22:37:00 -0000 https://status.fedecan.ca/incident/234064#4ea7a35aec24903c533f0df06f5ba8202b40e58b12b5f3373af1dc001483ce2b Incident We're hitting a lemmy bug triggered when someone deletes their account, that is locking the database. I'm disabling account removal temporarily until we can identify the fix. https://status.fedecan.ca/incident/234023 Mon, 17 Jul 2023 20:18:00 -0000 https://status.fedecan.ca/incident/234023#b686314943e25d4d989cac6902e40c56b03ae0f0e0fb5e4cc5b83f538c603e14 Incident Saw some database locking that took things down, restarted postgres and investigating further. https://status.fedecan.ca/incident/233677 Sun, 16 Jul 2023 23:07:00 -0000 https://status.fedecan.ca/incident/233677#cae87b3913eeb39331eca853b0445ab5e76dabcde534e03738306ceff588fde6 Incident Restarted services to do some memory tuning, we've been seeing pictrs crashing recently due to high memory consumption.