Here's what happened:
At around 6pm on Friday the forum crashed right after some automatic maintenance. I attempted to do typical repairs available through CPANEL and smf repair guides. These were not successful. After some more digging around info seemed to point at a server problem and not something I could fix. I contacted the host to ask for help. They advised to restore either a local backup or their last automatic backup. I asked them to restore their backup since it was only 24 hours old. Then, they did nothing. Nada. I asked them two more times for updates and it turns out that they waited too long. The automatic backup was overwritten. The entire messages table was lost. Luckily, I had a backup for them to restore. Now the bad news: It's from May 2015. This means everything since May is lost forever.
I'm pretty well livid. Obviously, I f'd up by not doing more regular backups. But, this should not have happened. If they had done what I asked when I asked it we would have lost at most 24 hours of the forum. Now, we've lost 7 months. So, we'll just have to move forward. Obviously, I'm going to be backing this thing up a lot more regularly and if it happens again I know exactly what to do. In the meantime, I am very sorry to all the members. There's no way of knowing just how much we've lost here and it is devastating, but it could have been worse.
For now, any member that registered in the last seven months will have to re-register. We will also need to re-create Freppo's sub-forum. And, worst of all, we lost the entire BOTY contest. In fact, I was coming on the forum right around the time it crashed on Friday expressly to announce all the winners. I do know that Leevibe won the grand prize, so if anyone else can tell me the order of the runner's up please let me know and we'll get it sorted!
If anyone encounters issues as we start to use the forum again, please post it here. I'm going to keep a hawk's eye on this for the next few days.
:( :(
Heartbreaker, I can feel your ire!
Very sorry to hear this...
dave
Sorry to hear about it, there sure was a lot of fun and good things happening in the last 7 months. But hey, we just make even more awesome stuff in 2016!
As far as the contest goes, I think that chuckbuick came in second, the floidian slip was third, cortexturizers aqualung fourth and then (I'm more guessing now) the fuzz saw. I hope someone can confirm this.
Wow major suckage.
Sent from my SPH-L710 using Tapatalk
Wow major suckage.
Sent from my SPH-L710 using Tapatalk
Oof, I know that has to hurt man, and I'm sorry for your troubles. It's pretty inexcusable they didn't act when you asked them to. If you ask me that is some lousy customer service.
Anyway, there probably won't be too many "regulars" around here not affected by this in some way. I suggest everyone just take a deep breath and accept it, because it doesn't sound like there's anything anyone can do about it.
Oh man. Sorry to hear that Brian. I would be livid too! Oh well, this is what we call a first world problem.
Just a crazy thought, but do they back up every 24 hrs? If so what about the back up that happened thurs? Probably not what you want to think about...
Anyway sorry to hear of all the trouble. Crappy service on the host end for sure.
Tough loss there. But at least we didn't lose everything. *That* would have been devastating.
Incidentally, I get an error when I post, but it looks like the posts are actually hitting the database properly.
Very sorry Brian. What an unfortunate situation.
The community will carry on...
Nooooo! It's gone! All of the amazing resources from the super helpful and knowledgable contributors here, gone! It's super sad but... Now I can ask dumb questions again without being sent to the link that answers it. We can rebuild.
I bet the stress of this ordeal is insane Brian. Being in the IT field, this kind of disaster happens at some point. I have had a similar problem but I had a current back up but...7zip compression actually corrupted the compressed files so ALL my backups were useless. I learned a valuable lesson and moved on. Its all you can do.
If there is anything I can do Brian, don't hesitate to ask.
We shall rebuild and rise again!
Cody
Epic bummer. Sounds like a real stressmare. :(
Quote from: selfdestroyer on January 18, 2016, 03:31:31 PM
I bet the stress of this ordeal is insane Brian. Being in the IT field, this kind of disaster happens at some point. I have had a similar problem but I had a current back up but...7zip compression actually corrupted the compressed files so ALL my backups were useless. I learned a valuable lesson and moved on. Its all you can do.
If there is anything I can do Brian, don't hesitate to ask.
We shall rebuild and rise again!
Cody
And this time we'll be bionic!
In the words of Scooby Doo. Ruh roh.
Quote from: m-Kresol on January 18, 2016, 03:15:15 PM
As far as the contest goes, I think that chuckbuick came in second, the floidian slip was third, cortexturizers aqualung fourth and then (I'm more guessing now) the fuzz saw. I hope someone can confirm this.
These were the top ones and the floydian slip was lumpyliptons and the fuzz saw mine. I think it may have been lee, chucbuick, cortex, lumpy, myself. I think there were 6 prizes total? Boards for a year, $30 to 1776, THCustom, and lectricfx, and them two of $25 to jmk? If so I think Facegrinder's time machine was 6.
That sucks though Brian.
Quote from: wgc on January 18, 2016, 03:27:24 PM
Just a crazy thought, but do they back up every 24 hrs? If so what about the back up that happened thurs? Probably not what you want to think about...
Anyway sorry to hear of all the trouble. Crappy service on the host end for sure.
They do an automatic back every 24-36 hours. I contacted them well within that timeframe. But, the restore never happened and they just let the backup get over-written the following day. I asked for any other back (tape, whatever). Nope.
It sounds like you've done everything you can, but if you want a second (or third, or fourth) pair of eyes to look at things, I've been doing php/mysql web development for about 20 years and would be more than happy to help however I can.
One thought: do you have the corrupt backup that overwrote the non-corrupt one? We might be able to pull that data into MySQL and do some repairs on it and re-import it.
Quote from: culturejam on January 18, 2016, 03:29:43 PM
Incidentally, I get an error when I post, but it looks like the posts are actually hitting the database properly.
I think that is Tapatalk. I've deleted it for now so let's see if that stops the error.
Quote from: echobret on January 18, 2016, 03:42:28 PM
One thought: do you have the corrupt backup that overwrote the non-corrupt one? We might be able to pull that data into MySQL and do some repairs on it and re-import it.
No, i could never access it. From what I gathered, it was some kind of disk read error on the server or something. The table kept showing up as "in use" and I could not export it or anything. Thanks for the offer, though.
As much as this sucks, it feels good to be able to have the MB forum back. Losing data is bad, but I've made a lot of friends here and I wouldn't know how to keep in contact otherwise. It's good to be back.
The amount of posts within the couple of minutes the forum is back online speaks for itself. We've all missed this place dearly! We'll get it back on track in no time. Just let us know, how we can help.
I just posted a 2015-mashup-build-report (http://www.madbeanpedals.com/forum/index.php?topic=21402.0) that sums up my builds since may. I thought it was a good idea and hope some of you will follow my lead. There would be to much awesome stuff lost forever. I learned a bit about my builds too: a) I built quite a few b) In retrospect, I don't care that much about little imperfections and c) I'm actually really proud of some of them
Quote from: madbean on January 18, 2016, 03:42:54 PM
Quote from: culturejam on January 18, 2016, 03:29:43 PM
Incidentally, I get an error when I post, but it looks like the posts are actually hitting the database properly.
I think that is Tapatalk. I've deleted it for now so let's see if that stops the error.
I also got an error two times now, not using tapatalk
Quote from: madbean on January 18, 2016, 03:45:42 PM
Quote from: echobret on January 18, 2016, 03:42:28 PM
One thought: do you have the corrupt backup that overwrote the non-corrupt one? We might be able to pull that data into MySQL and do some repairs on it and re-import it.
No, i could never access it. From what I gathered, it was some kind of disk read error on the server or something. The table kept showing up as "in use" and I could not export it or anything. Thanks for the offer, though.
Is there a current automated backup that you can access now that took place before they did this restore? Even if it's the corrupt data, it might be fixable. I don't mean to question your skills or abilities or insinuate that you haven't tried everything, just want to be able to help if at all possible. :)
As to what these guys said ^
I'm fairly new and I missed you guys already. :'( Thanks for getting it back up and running. All the data loss sucks, but its not impossible for it to all come back. Pretty easy to remake any important threads!
Quote from: m-Kresol on January 18, 2016, 03:48:36 PM
I also got an error two times now, not using tapatalk
Keep trying. I just deleted the folder from the server so the callback there should not happen. But, please let me know if you see it again.
Quote from: madbean on January 18, 2016, 03:42:54 PM
Quote from: culturejam on January 18, 2016, 03:29:43 PM
Incidentally, I get an error when I post, but it looks like the posts are actually hitting the database properly.
I think that is Tapatalk. I've deleted it for now so let's see if that stops the error.
I can't log on from Taptalk. Sucks to loose the data but lucky it's not all :)
Hey welcome back, I felt like my best friend was on vacation with no way to get in touch. Sucks, but there are a lot worse things happening around the world.
Quote from: mojah63 on January 18, 2016, 04:06:00 PM
I can't log on from Taptalk. Sucks to loose the data but lucky it's not all :)
i will re-install TT soon. For now I want to see if things stay stable for a day or two before making any changes. Then I'll get it back on here.
Someone won my PIF and never contacted me, I don't remember who it is but if you see this send me a PM.
Good to be back, I was gettin' the shakes man!
What others have said, just glad to be back and everyone's in one piece because you never know!
The forumites will soon fill the holes back up again!
dave
Sorry to hear about the troubles, Brian. Glad we're back in working order.
I think I'll also do a little summary build report eventually, but I'll focus on re-updating the couple of new projects.
Also, very big sorry to our supported shop members, too. I realize this puts a burden on you guys to have to re-create some posts, etc. Actually, I'm more cheesed off at that than losing any of my dumb posts!
Madbean now has its very own Black Friday
I realized how addicted I am to this forum once it was gone. I was checking far to often to see if it was back up. I resorted even resorted to other forums, yucky! Blatt! Blatt!
time to unleash fury on the host
(http://i746.photobucket.com/albums/xx105/leevibe1/madbean%20pics/Mad%20Bean%20-%20Imgur_zpsslpy8ehw.jpg) (http://s746.photobucket.com/user/leevibe1/media/madbean%20pics/Mad%20Bean%20-%20Imgur_zpsslpy8ehw.jpg.html)
Hahaha, one of the first things I thought. "What about the shop contest!"
This definitely sucks, I'm going to miss all the BOTY build posts, drooling over Lee's wiring, seeing those crazy cut off fingers on the Buzzsaw....
I think folks have posted the correct order for the winners...congrats to Lee, well deserved, and thanks for everyone that voted for my Floydian Slip. So many great builds.
Here's to a great 2016 of DIY, and restoring the lost knowledge, one post at a time.
Warren
Sorry to hear that Brian.
Brian: Max file size for attachments is back to default of 1000K, FYI.
Thank you for all your hard work :)
+1.
Its good to be back on line, thanks for all the hard work.
Peter
Glad it's working again, thanks a lot for all the work! I'm sure the 7 month loss cut will be very quickly forgotten! :)
wow. Then I guess all (or almost all) of my posts went to the dogs, since I'm a new-bee here. :D
And oh, irony... I read this the morning when I take an exam of SQL/Database, which I truly hate and never wanted to be involved in...
I'm sorry for the data loss, but don't worry, it's not something you could control.
Wow. First time ever something like this makes me genuinely sad. So much great information and discussion lost forever. :(
Also, during these few days I realized how much time I spent on this forum nowadays and it kind of makes me scared. ;D
So sorry to hear this. But glad to have the forum back.
Edit: why does it always show "0 posts, 0 topics" in the hosted subforums section? It has always done that, so maybe that can be changed now?
And there could be a link to Freppo's site at the top of this forum, next to the other shop links.
Edit 2: And most of what I contributed in 2015 was either "that looks great" or "Thanks".
I was one of the noobs that had to re--register. I got on and was like, 'Did I do something to be kicked?". Sucks there was so much lost. Glad to still be apart of it though!
Sorry to hear about your troubles Brian.
It sucks... but it could be a whole lot worse.
Onwards and Upwards!
Quote from: gylsmrk on January 18, 2016, 11:47:47 PM
wow. Then I guess all (or almost all) of my posts went to the dogs, since I'm a new-bee here. :D
And oh, irony... I read this the morning when I take an exam of SQL/Database, which I truly hate and never wanted to be involved in...
I'm sorry for the data loss, but don't worry, it's not something you could control.
I know right? I had finally broken in the 100 posts barrier! lol
Quote from: Tremster on January 19, 2016, 12:46:55 AM
So sorry to hear this. But glad to have the forum back.
Edit: why does it always show "0 posts, 0 topics" in the hosted subforums section? It has always done that, so maybe that can be changed now?
That's normal. The HSF are organized as subs under a category (which itself has no posts). There's no way to change that without re-organizing the subs themselves, AFAIK.
Sorry to hear about the data losses. I guess that's just one of the inevitable disadvantages of the modern digital world. What's nice is that the forum won't lose any of it's personality because of this. We're all still out here in 'net land, somewhat eager to fill the digital voids. :)
...all messages on 2015 were also lost...some important link and infos were there...but i can live with that..and we're glad the forum is back...
Yeah, I saw the error message up there, hoped you had some backups.
What a bunch of dicks not getting on to it pronto.
People talk about data loss like its some homogenous commodity, but the truth is, losing stuff we care about is really hard. Think about this... When is the last time you rummaged through your garbage. It was most likely because you were looking for your keys or some other really important document. That feeling of relief when you find them is priceless.
I'm really happy the forum is back up. It's confusing as hell though. I almost responded to an ancient thread. I wish we could just draw a line in the topic list and start fresh. Super bummed about all that we lost, though. And my post count... Fuuuuuuuuck... Baxter to destroying diodes? Weak sauce!
Also bummed about the build of the year. I entered knowing full-well I wouldn't win. After LeeVibe posted his work of perfection, I wondered if I'd made a massive newbie mistake. But I entered 1) for the fun of it, 2) as a historical mark of my progress. That's gone, and so is my accomplishment of winning the Mr. Irrelevant title. But whatever, I know I won and that's all that matters. lol
In all seriousness, it's so great that we're back! Sadly, this happens all the time. Let's get back to business, and before you know it, well barely even remember this happened.
Cheers!
Sorry about the loss, but i'm glad that the forum is back!
For some reason I could not log in (my usual password didn't work), so I tried to sign up again but my name was already taken. Then it finally occured that a password recovery/reset might do the trick, and it did. :) It sucks alittle bit that I had just gone through most of my projects and posted the working voltages and currect consumption (like the day before the crash) and now I can't find the notes. Oh well.. Lesson learned. I just made backups of all my DIY related stuff. :P
Onwards and upwards!
cheers
Quote from: Gainzilla on January 20, 2016, 06:06:11 PM
People talk about data loss like its some homogenous commodity, but the truth is, losing stuff we care about is really hard. Think about this... When is the last time you rummaged through your garbage. It was most likely because you were looking for your keys or some other really important document. That feeling of relief when you find them is priceless.
I'm really happy the forum is back up. It's confusing as hell though. I almost responded to an ancient thread. I wish we could just draw a line in the topic list and start fresh. Super bummed about all that we lost, though. And my post count... Fuuuuuuuuck... Baxter to destroying diodes? Weak sauce!
Also bummed about the build of the year. I entered knowing full-well I wouldn't win. After LeeVibe posted his work of perfection, I wondered if I'd made a massive newbie mistake. But I entered 1) for the fun of it, 2) as a historical mark of my progress. That's gone, and so is my accomplishment of winning the Mr. Irrelevant title. But whatever, I know I won and that's all that matters. lol
In all seriousness, it's so great that we're back! Sadly, this happens all the time. Let's get back to business, and before you know it, well barely even remember this happened.
Cheers!
In the grand scheme of things, I agree. There was a lot of really valuable information that was lost that will never be recovered, both for troubleshooting and general knowledge. The other stuff was probably noise, but for those that have been here for a while, funny or tragic moments and memories. Like I said, in the grand scheme of things l, it doesn't matter. I felt like I couldn't talk to my best friends, it is what it is. I'm glad to see you all again.
Si I gather that our messages are lost for ever 😅 ?
Is it just me or was the forum down again?
It was but I was able to bring it back without any data loss. I am convinced now the automated maintenance is causing the problem. So I have eliminated the non-essential ones and re-scheduled the important ones for non-peak times. I think there is some kind of bug where the message table crashes when optimizing while people are using the forum or something. I wish I understood this stuff a little better. I'll check on the smf forums and see if anyone else has this problem.
not sure if this is useful info or just noise, but:
just before the server issue, the "notify" function for threads didn't work. It returned some kind of "database not found" or similar error.
Wish I could remember more specifically but I remember thinking it was odd.
Quote from: wgc on January 25, 2016, 01:15:20 PM
not sure if this is useful info or just noise, but:
just before the server issue, the "notify" function for threads didn't work. It returned some kind of "database not found" or similar error.
Wish I could remember more specifically but I remember thinking it was odd.
I was seeing this as well, but i would get the notifications in the end even though been told the action had failed.
Currently i'm not getting notifications on new threads i've posted to or any of the old ones it would seem.
dave
dave
That's why I had to register again. I thought I just forgot my username or password, but thought it was weird that none of my email addresses would work to recover. Oh well, I hadn't contributed much yet. Still new at this. Sorry for the loss of the other data though. That sucks.