A client recently suffered a hard drive failure in their primary NAS device. Fortunately for them, I had the foresight to setup a secondary NAS with an identical configuration, along with a nightly rsync script to replicate their data in case of such a situation. As a second level of redundancy, I wrote an additional script that replicated the data to an external 500GB USB drive for offsite storage. You'd think this would have covered all the bases?

Fucktool: Our network drive is down, and nobody can access their files.

Me: VPN in and check shit out...yup dead drive. Clickity click, flip over to backup NAS, change IP address....there you go, you should be able to access now.

Fucktool: Great just let me check.... Hmmm....we seem to be missing some files here??? This data is from June?!?!? OMG!! WTF?!?

Me: WTF? The NAS drives are supposed to be sync'ed every night? At most you should only be missing the changes from the past 12 hrs? I can check the external USB drive?

Fucktool: Can you restore them for us?

Me: Sure...I'll just VNC into the machine that runs the backup scripts and... [Connection Timed out] WTF?!?! Ping the backup machine.... Request timed out.  Uhm, is the backup server on?

Fucktool: Oh...I'll have to go turn the server on for you.

Me: Why is it off in the first place? Did you guys have a power failue or something?

Fucktool: No No.....that machine keeps beeping all the time, so we just turn it off?

Me: You what?!? How long has it been doing that?

Fucktool: Since May or June? I dunno...it was annoying so we just unplugged it.  

Clickity click....sure enough, backup files on both drives current as of June. You fucking retards!!!

Fucktool: Did you find our files yet?

Me: Yeah...sure. Go jump in front of a bus and maybe you'll see your files again in the netherworld!!!

ASS....