All of our data is GONE!

Video for those interested: link to this video Actually a pretty good telling of a story all too common for those tasked with handling precious data.

I really like the idea behind storing error-correction codes at the application level. Disks should just store and retrieve a chunk of bits and it should be pushed up to the application level to decide whether or not those bits were what we wrote. From there, we can make the right decisions about how durable we really want a file to be. Instead, people seem to have invested a lot of effort in going the other direction; let the application have less control and let many magic layers in the middle figure out the details. We have had filesystems for decades, which pretend to map names to a list of durable block numbers. Of course, the blocks are not so durable (nor is the database), so people l…

I'm not sure if you're referring to link to this video ("All of our data is gone"), but in any case, I've heard references to ZFS in later videos so yeah, the situation's probably not quite that insane now. That video is technically hilarious though, it TL;DRs as "download Ubuntu-based USB image provided random RAID recovery company, boot USB and provide said company headless SSH to broken system"... at one point in the video I remember Linus talks to another recovery company about the process and the guy pretty much went "...O.o..." which IMO sums my own opinion up, lol

…link] ), the Gamers Nexus video on LTT's production process link and the coverage LTT regularly lavishes on its own production setup and process, from a nearly-12m video about the awkwardness of ingesting video from their new 12K cameras link to seemingly quite genuine fly-on-the-wall coverage of temporarily losing their data to a RAID failure link to this video . Obviously you always have to take anyone's self-presentation with a grain of salt. But they're certainly not hiding the fact that there's a more grounded reality behind the "on" personas.…