72 replies to this topic

[NJ_STORM]

Hi,
Last night I had a very big suprise. I could not get to the forums at all. My site www.echo-of-thunder.trap17.com was still working then but not today. Today I could not even log in to anything. Site was down also. this is why the new account and name.
Not sure what is happending here. If it is me or a Data base problem or worse hacked. I did get a notice that I had a PM, last night and that is when I noticed all of these.

Anyone know what is going on or when if it can be fixed?
TY

John AKA Echo_of_thunder

P.S.
After looking around the forum, I also got a IPS Driver Error
a few times

Edited by NJ_STORM, 22 June 2008 - 09:03 PM.

[-MRA-]

Yeah this is SM, I had to create a new account just to what was going on since that IPS Driver error yesterday, and from what I could surmise is that the databases suffered a huge crash yesterday and selective databases are corrupted or at least crashed.

These include the following

-member databases have crashed, except for any new accounts that have been created,
-profile database is crashed
-trap17 manage databases
-all trap17 hosting accounts are down
-selective IPS Driver errors across the forum, now

So that is all I have found in error so far with this problem.

[mbaa24]

Hey SM, since this is a very serious issue, it should be posted in the Alerts and Notices section. And any update on when it'll be back up?

[-MRA-]

No idea, I got in contact with OpaQue last night when this happen and all I know is that he is aware of the situation, but I make sure ot pass another message along if I see him to what kind of status we are at.

[NJ_STORM]

mbaa24, on Jun 22 2008, 07:48 PM, said:

Hey SM, since this is a very serious issue, it should be posted in the Alerts and Notices section. And any update on when it'll be back up?

I do have to agree it needs and should be added there. Just hope that this all can be fixed somehow

[-MRA-]

For those who created an account just to see whats going, don't get with tech support and let them know your website is down, they will reset it on you so bear with this downtime till we get answer as to what is going on.

[midnightvamp]

Well, just to let you know... I'm pretty sure that they have a back up of things, so it should all get back to normal once they can get things sorted out. I think that they can fix it all because I ended up going to support last night a few hours after my site went down, when I couldn't log into the forums, and they worked with me to get it set up again. They created the accounts, and transfered their back up files so that my site was back up and running within an hour of my contacting them. I was very thankful for all the work they did for me. My hats off to them. The only thing they were unable to fix was my forum account, but that's working now too

Edited by midnightvamp, 23 June 2008 - 06:22 AM.

[Carson]

I have just managed to fix my computer and get online again to discover my site is either down, or gone altogether. I still have a positive credit count.

I don't have any idea what has happened. My sub-domain is rmxp.trap17.com, and my domain is rmxpunlimited.net. The domain doesn't work at all, but the sub-domain shows a page that is shown after an account is created, i think.

I also cannot login to CPanel. I would like to get my site back up as soon as possible. I had also recently made a topic about an automated database back-up with no success. I really hope my database has not been deleted as it contains a lot of valuable data from the last back-up which is not at all recent.

[rvalkass]

It would appear there have been some problems with the server. There is already a discussion about it here. I assume Support are working to fix the problem, and your account should be working again soon. Thank you for your patience.

[Bluebear]

I got really nervous! At first I thought I had forgotten my password, so I clicked the "I've forgotten my password"-thingy. Neither of the options listed on the email I got worked, it said that they could not find my member ID. How fun. I desperately tried to find some staff member's email so someone could help me, but no. The one I found did not work. I could not post in the guest forum. Horrible.

I really hope everything works out! I have not got anything of matter on my site, so I do not really care too much about that right now. Just happy that the forums seems okey.

I do not now if anyone managed to post a topic about this problem? If they someone did I missed it. Never really pay attention to such things.^^

[dwolters]

Crap! I got with tech support already! So I think my site was reset. But I still can't log in to cpanel. At least I can now log in to trap17. Please keep us posted

[A200]

I came home yesterday from being away from internet connection for 3 days and found my site didn't work, and then I tried to login here and it said my username didn't exist so I became concerned as I thought someone had hacked my account and got the name changed, but then this evening it is now up so I was glad I can login.

My site is still down though

[hitmanblood]

yep my site doesn't work also. However now I am able to get to trap I hope that they will fix this serious issue very soon. Because this server transfer and all the things are just making so many bad things. I hope that they will get it in order soon.

[Saint_Michael]

I give a unofficial timeline of events now that the forums are back up and pople can log in normally.


Around 5-6 PM (-5:00 GMT) There was a IPS Drive failure on the forums, about 30 minutes -to hour later the forums came back up and that is where the problems begin.

The forums could not accept login in for for all active accounts before Saturday and the Trap17 hosting was down in two ways:

People who visited ther own site got the Cpanel splash screen, anyone visiting another trap17 was got a 404 error. Through out hte day their were many IPS Driver errors through the forums, however, like me and a few hours, we discovered we could make a new logins and see what was going on. So I was poking around just to see what was affect and came to the conclusion that every single account disappeared. So I quickly figured out that something happen to the MySQL tables so most trap17 services were completely down.

So I went through the tech support and sadly they never new what was going on, because they reset my account to "try and fix the problem", which never worked. SO WHATEVER YOU DO PEOPLE, DO NOT I REPEAT DO NOT CONTACT SUPPORT ABOUT YOUR DOWN WEBSITE and I tell you why.

I was able to get a hold of OpaQue and was starting to re upload the back up of all the account, and this was at 0030 GMT and so it will take awhile, and as for the reason what happen, I was correct. One of the Big MySQL databases got corrupted and it pretty much had everything in it. That is as much as I know and that he has told me about this and so most likely he will make a response to what has happen. So I beg everyone to have patience and pray that you also have backups of your websites as a secondary precaution.

Edited by Saint_Michael, 23 June 2008 - 11:35 AM.

[Wolfpack]

I was about to create an account in here, but I've got my doubts about the seriousness of the admins.

IE in Saint Michael's case I don't know how it can "take a while" to restore a MySQL dump. I mean, I'd understand if they had a major server failure or something, but it was just corrupted data, nothing that an older dump cannot recover.

[jlhaslip]

Okay, this is an improvement, at least I can log-in now with my usual name... and I have received a PM from a member, so all is not lost.
Patience will be required here. I'm certain that Opaque and the Server tech's are all working towards getting everything up and running fine.

Thanks.

[rvalkass]

It would appear our data is back, and sites are back online. However, parked and addon domains are not yet working, along with FTP access or cPanel.

Wolfpack, on Jun 23 2008, 01:08 PM, said:

I was about to create an account in here, but I've got my doubts about the seriousness of the admins.

IE in Saint Michael's case I don't know how it can "take a while" to restore a MySQL dump. I mean, I'd understand if they had a major server failure or something, but it was just corrupted data, nothing that an older dump cannot recover.

Restoring a single MySQL dump of one or two small tables doesn't take long. Restoring lots of data, like these forums, takes much longer. Restoring an entire server is a daunting prospect, and is a task that cannot be completed without a lot of careful planning.

Events like this are rare, and the server admins are doing their best to get everything up and running as quickly and safely as possible.

[jlhaslip]

My main site is available, but it uses html/css only. A sub-domain which requires Database access can not find the database still.

I trust the Server Crew and the Admins are working towards a correct repair as we speak.

[OpaQue]

Alright.

The Update.

All accounts have been restored physically. Which means the CPAnel and your "CONTROL" has been restored.
The /home/USERNAME/DATA has been restored.
MySQL DBs - 1 Week Old BackUp Restored.

LOSSES - Sub-Domain, Addon Domain Settings and data about a week old.

WHY IT HAPPENED?
============

1. User Table DB gets curropted.
2. SQL queries continue to execute returning value 0.
3. CreditSystem Script checked through the status of accounts with 0 credits and VOILA all deleted!
4. I got a message of account deleted but as usual being with 100's of tickets with "My account got deleted", I thought this was the same old thing.
5. I see Jlhaslip message asking his account data. THINGS get very SERIOUS now because its impossible JLs account lacking credits.
6. I run a scan with Logs and find all accounts deleted.
7. I disable Credit System Script.
8. I made a list of accounts that need to be restored after termination and their blank CPanel accounts were added to server with random passes.
9. My support team dumped the DATA and MYSQL in these accounts.
10. Finally I m writing you this post explaining everything.

TASKS PENDING:
===============

Re-Activating Credit System script and making sure, no DAMAGE happens.

ACTION TAKEN TO SOLVE THIS ERROR
===============

The CreditSystem will lose its privledge to delete accounts and it will be done Manually Henceforth.

ACTION FOR MEMBERS
===============

UN-PARK and PARK back all addon and parked domains.
CPanel Password can be reset by logging to Credit System. (http://www.trap17.com/manage/ )

[Forbez]

Yes, I've just managed to regain access to my account. I have exactly the same issues as you, about 3 days it started for me. At first, I thought it was only something small and minor. But the next day, I noticed a few things.

1, no notice of any problems with Trap17
2, all forums accounts couldn't be accessed
3, only new accounts could be viewed and had posted
4, the post legacy of members did not show any information of the poster.

Someone from Trap really has to make an announcement sometime soon.

[Forbez]

Thank you OpaQue, but could you make a duplicate post as a new topic in the announcements section, if it wasn't for rvalkass, I wouldn't of know where to look. This is a very serious issue which needs to be announced correctly.

[sheepdog]

You sound just like me, only nervous doesn't cover it, I was about in a panic! I did exactly the same thing with the lost password thing, tried that 3 times even. I was sure it had to be something I was doing wrong. And I didn't have any email addresses for anyone here, thought maybe I had one and dug threw several 100 sent messages hoping to find it but no such luck. I was just about to see if I could start a new account just to get in to find out what is going on, but fortunatly I'm back here now and my site is back up.

[Saint_Michael]

Isn't really necessary to do so, it would just be duplicating what is already know and for the most part is fixed minus the db problems here and there. Also just in case someone else is running into this problem, I can't see my site through normal means, and it is being worked on at the moment, but I think my situation is a bit unique because of what happen with mine . As for wolfpack post, rvalkass pretty much answered it, hese are very large databases with lots of data and so yeah hours would be correct.

[kudmus]

This morningI tried visiting my site but I got the default page("If u can see this page it means..."). I refreshed got the same thing. refreshed again site not found. Refreshed again it started loading slowly. I just pray this wont happpen again coz I dont want my visitors seeing that page. I'm sure these guys don't enjoy letting us down so I beleave they are working on it. My advice though is they should create another page to display when our sites are down. Not that Apache thing.

[arnz]

I would also suggest a mirror site at an alternate address in case of the main site being down. Perhaps provide a backup forum in the case of the main site crashing and/or being hijacked into.