(10-08-2018, 11:30 AM)Nightowl Wrote: My job is Serverhardware (selling, buying, repairing,...).
Can i help?
What you can do to help is donate to the Patreon located here in case this runs us some extra cash. Beyond that, there's nothing anyone else can do but be patient.
(10-08-2018, 12:19 PM)Laz Wrote: They had a catastrophic server failure at one of their datacenters and we lost about 5 months of forum/gameplay data. We one of thousands affected. This happened in 2013, I think?
JFC we left a host because we didn't keep backups?
IIRC our backups were corrupted, irrecoverable or otherwise unreachable. It was a combination of very unfortunate events. Their service was quite terrible too, as far as I gathered.
(10-08-2018, 12:44 PM)Piombo65 Wrote: some daily/monthly backups in the meanwhile?
I pulled the last week of dailies off our storage and locked them up in multiple offsites I have control of, one of which is literally attached to my car keys.
We're good this time.
e: I've considered setting up a server in my home to tide us over until we can properly sort this out but I'm not sure that the 150 ms ping from Europe would be appreciated.
So will we be f*cked if someone will steal your car? XD
(10-08-2018, 01:27 PM)Ramke Wrote: IIRC our backups were corrupted, irrecoverable or otherwise unreachable. It was a combination of very unfortunate events. Their service was quite terrible too, as far as I gathered.
iirc it was a raid array failure, a few raid controllers kicled the bucket and it took a while for people to notice.
(10-08-2018, 01:27 PM)Ramke Wrote: IIRC our backups were corrupted, irrecoverable or otherwise unreachable. It was a combination of very unfortunate events. Their service was quite terrible too, as far as I gathered.
iirc it was a raid array failure, a few raid controllers kicled the bucket and it took a while for people to notice.
It was a combination of things, but the overall reason we left OVH (and we should never return there) is their awful support. The server was offline for 14 days due to hardware issues. But they still billed us these 14 days and pretty much told us to go screw ourselves over it. Backups for the game server always worked, we never lost data in that regard.
The backup problem you're referring to is the Web Server incident, in which a server operator had accidentally changed something in a script that caused offsite backups to never work after it was moved. The most recent backup of that server turned out to be a months old copy I had on my PC to debug a few issues. The system has been significantly improved since then on all ends, but all of this always was more or less due to a lack of qualified developers with professional knowledge. It's something very difficult to come by in gaming communities and the few people capable of doing it are usually overworked and things pile up faster than they can be cleared.