• 0 Posts
  • 10 Comments
Joined 3 years ago
cake
Cake day: August 3rd, 2023

help-circle






  • My team made the “mistake” that all new projects need to be built and approved on our dev clusters before we allow them to be deployed to the prod clusters. We’re very explicit that dev is ephemeral, and that everything should be as code, so everything heals itself…

    Despite this, whenever we reprovision the dev env, we always get emails from several different people saying that we wiped their prod databases and such. It’s crazy.


  • I agree, though my biggest headache has been with systemd handling mounts. You have to modify a ton of units to add After and Required to make sure the NFS shares you have in fstab get mounted before starting services that depend on them. And then if the package maintainer updates their unit files, all your changes disappear!

    Such a huge headache compared to the classic init.d that mounted everything very early – with just the occasional “boot delayed a couple seconds because your share was offline” or such.