Jump to content
SiouxSports.com Forum

Downtime / restore / missing content


administrator

Recommended Posts

In short... a reasonably catastrophic hard drive failure led to about a day of downtime (18 or so hours). There are very good technical reasons that a single hard drive failure should not affect the site, and unfortunate reasons that in this instance it did.

The current site is a restore of my last complete personal backup of it all, made a few weeks ago, hence the age of the messages and missing interim messages.

Unfortunately, the service provider of the server has not been able to provide intermediate daily backups. If such prove available, I will insert that data as soon as it is available. However, I'm not particularly optimistic, so wanted to get things up and running as soon as possible with what we have.

Sorry for the inconvenience -

Jim

Link to comment
Share on other sites

Jim,

I'd like to add my thanks for your efforts in maintaining this great site. I've run a server myself in the past and I know it can be a real pain. SiouxSports.com is important to me. Add me to the list of those who would be most pleased to contribute financially to this site.

Link to comment
Share on other sites

Now that I've gotten a few hours sleep, let me give a little additional info for those interested.

The majority of web sites use something called "shared hosting", where you provide content or pay your provider to develop content and the provider hosts that content on a big web server that's actually shared with other sites. The owner of the server keeps up the all the software, you just manage your own content. However, sites that have a lot traffic and custom programming, like this one, use too many resources so don't play well with others so we quit using shared hosting quite a few years ago.

In between shared hosting and having your own staffed datacenter is paying a big data center to keep a server in a rack (or provide a "virtual" server in a larger server) and supply it with power and network connectivity. You may just pay them to make sure its up, or you can pay them to help maintain the operating system and server software. As various faults have happened in the past, I've taken over more of those tasks myself, so now I'm managing pretty much everything (the OS, server software) because I've felt like they weren't providing the level of service I wanted. (Economists might have something to say about comparative vs. absolute advantage at this point, bluntly meaning my time is probably better spent managing the content, regardless).

The one real aspect I haven't been able to take over is daily backups. Dumping the entire database from a remote server in a data center to a machine of mine would involve moving hundreds of megabytes over the Internet to my home. Doing that with high frequency isn't particularly practical, rather you want to perform high frequency backups on a device close to the server. Needless to say, the one part I don't directly control proved the weak link that let us down in this failure. That's why I find it so frustrating.

Link to comment
Share on other sites

Now that I've gotten a few hours sleep, let me give a little additional info for those interested.

The majority of web sites use something called "shared hosting", where you provide content or pay your provider to develop content and the provider hosts that content on a big web server that's actually shared with other sites. The owner of the server keeps up the all the software, you just manage your own content. However, sites that have a lot traffic and custom programming, like this one, use too many resources so don't play well with others so we quit using shared hosting quite a few years ago.

In between shared hosting and having your own staffed datacenter is paying a big data center to keep a server in a rack (or provide a "virtual" server in a larger server) and supply it with power and network connectivity. You may just pay them to make sure its up, or you can pay them to help maintain the operating system and server software. As various faults have happened in the past, I've taken over more of those tasks myself, so now I'm managing pretty much everything (the OS, server software) because I've felt like they weren't providing the level of service I wanted. (Economists might have something to say about comparative vs. absolute advantage at this point, bluntly meaning my time is probably better spent managing the content, regardless).

The one real aspect I haven't been able to take over is daily backups. Dumping the entire database from a remote server in a data center to a machine of mine would involve moving hundreds of megabytes over the Internet to my home. Doing that with high frequency isn't particularly practical, rather you want to perform high frequency backups on a device close to the server. Needless to say, the one part I don't directly control proved the weak link that let us down in this failure. That's why I find it so frustrating.

Hmm, ok? ??? Thanks for the service. I too didn't realize how much SiouxSports.com is part of my day. Went through a little withdrawal there for a bit. OK, now. Thanks again. Some of the members made a good suggestion, after not getting my SiouxSports fix yesterday, I too am ready to make a donation to this site.

Link to comment
Share on other sites

I must say that I'm a bit disappointed to find that my recent post- which analyzed in great detail the statistics and intangibles of the Sioux hockey season thus far, and then extrapolated with a high degree of accuracy, the outcomes and particulars of upcoming contests- was lost in this unfortunate event. I will look to see if I saved a local copy on my machine...

Nope.

taz

Link to comment
Share on other sites

  • 2 weeks later...

Update for the techies (others may want to stop reading now):

I just finished setting up a second database which contains a clone of the SiouxSports.com database. The secondary one (hosted on a different machine in a different site) maintains a continuous connection to SiouxSports.com, replicating real-time changes (e.g., your posts!).

If it works well, this means that even if SiouxSports.com died completely, I should be able to retrieve almost perfectly current data from the secondary server. I'll have to monitor the performance of this setup over the next few weeks to determine its long-term viability. Though the preceding step will protect against data loss, I was also somewhat displeased with the length of the downtime. I'm next going to look into ways to provide additional redundancy for the web site itself.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...