Page 1 of 2

Recent server latency

Posted: 02 Jun 2011 01:49
by ragabash
Hey, all. We've been having some technical issues lately. Specifically, large and crippling latency spikes. When the site suddenly becomes sluggish and nonresponsive out of nowhere. What's been happening is that large queries have been slowing the database server down. When this happens, all the other open requests start stacking up, and the server slows to a crawl.

Has anyone been running large searches of any of the sites, or running searches with incredibly common terms? This could be it.

Re: Recent server latency

Posted: 02 Jun 2011 02:33
by Omphalos
I just remembered that this search feature wont let us search common terms. It wont even let us search something like "Paul" because we use that word so much. Could it be something else bro?

Re: Recent server latency

Posted: 02 Jun 2011 21:36
by ragabash
As you guys can tell, the server went down again. I examined the logs after bringing it back up. About 10 minutes before it went all pear shaped, a type of system called an open relay attempted own the server. I'm still examining things, but I think we're ok. This may happen a few more times before whoever is trying moves on. Sorry for the downtime.

Re: Recent server latency

Posted: 09 Jun 2011 15:20
by ragabash
All,

I've been monitoring the server lately, and I've noticed that the MSN crawler has been making a lot of regular connections. about twice an hour, with multiple simultaneous connections. I've read up on it, and a lot of webmasters complain that MSN doesn't respect the general rules of etiquette for search engine bots, in that it spams the ever living shit out of servers. It seems to be doing it to us as well.

I'd like to block all MSN bots. There is a downside to this; the site will eventually not be listed in the Bing search engine. I know you guys pride yourself on being first in Frank Herbert and Dune searches on various engines, so I figure I'd see how you felt about this idea. It's a real damned if you do/damned if you don't kind of deal. Please respond to this thread with any thoughts or ideas.

On a side note, we're also getting spammed by Ukranian botnet as well. This also may be causing latency, so MSN might not be the only culprit. Unfortunately, this botnet doesn't use a known pool of source addresses, so blocking it will be problematic, to say the least.

Re: Recent server latency

Posted: 09 Jun 2011 15:59
by Freakzilla
I don't care much about Bing. I don't think they're going to dethrone Google any time soon.

Re: Recent server latency

Posted: 09 Jun 2011 17:21
by Nekhrun
Freakzilla wrote:I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
Agreed. F 'em. Maybe that's what happened to DN and they took themselves off the grid completely! :lol:

As long as we still come up on Dogpile and Netscape we should be okay.

Re: Recent server latency

Posted: 09 Jun 2011 18:54
by Omphalos
Ban the fuckers. Goddam Gatesian way of thinking will get them in trouble.

Re: Recent server latency

Posted: 09 Jun 2011 20:14
by D Pope
Smite them!
Take their water!

I tried bing a time or two, looking to see what the comercials were about. When google proved bing was using their stuff, I had to laugh- & haven't been back.

Dispatch them with ragabash force!

:violence-smack:

Re: Recent server latency

Posted: 09 Jun 2011 22:15
by Freakzilla
First we tattoo him, then we hang him, THEN we kill him!

Re: Recent server latency

Posted: 10 Jun 2011 03:18
by Serkanner
Never have used Bing ... never will. Fuck 'm.

Re: Recent server latency

Posted: 10 Jun 2011 09:35
by SandChigger
Fuck Bing.

Fuck Anderson.

Fuck the Herberritts.

Fuck them, fuck them ALL!!! :angry-screaming:

:shock:

Re: Recent server latency

Posted: 10 Jun 2011 13:05
by ragabash
SandChigger wrote:
Fuck them, fuck them ALL!!! :angry-screaming:

:shock:
:shock:

Well. Uh.

Re: Recent server latency

Posted: 10 Jun 2011 13:06
by ragabash
I took the first step today and disabled guest searches for Jacurutu.

Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495

Could you do the same for Tau? It's all done in the ACP.

Re: Recent server latency

Posted: 10 Jun 2011 13:40
by ragabash
...aaaaand I just blocked the MSN spider at the firewall.

I think. :D

Re: Recent server latency

Posted: 10 Jun 2011 13:54
by Freakzilla
...and there was much rejoicing. :dance:

Re: Recent server latency

Posted: 10 Jun 2011 17:41
by Omphalos
ragabash wrote:I took the first step today and disabled guest searches for Jacurutu.

Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495

Could you do the same for Tau? It's all done in the ACP.
did you block the bing bot on the control panel too? If not I can take care of it tonight.

Re: Recent server latency

Posted: 13 Jun 2011 16:51
by Eyes High
SandChigger wrote:Fuck Bing.

Fuck Anderson.

Fuck the Herberritts.

Fuck them, fuck them ALL!!! :angry-screaming:

:shock:
Don't forget your protection. :shifty: :whistle:

Re: Recent server latency

Posted: 14 Jun 2011 10:13
by SandChigger
Oh, I won't.

What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

THAT's the kind of protection I'm thinking. :twisted:

(Yeah, I slipped and fell into a dark place last night. :shock: )

Re: Recent server latency

Posted: 14 Jun 2011 12:51
by Omphalos
SandChigger wrote:Oh, I won't.

What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

THAT's the kind of protection I'm thinking. :twisted:

(Yeah, I slipped and fell into a dark place last night. :shock: )
Been a while since I've seen it, but that sounds like American Psycho.

Re: Recent server latency

Posted: 14 Jun 2011 16:12
by ragabash
That would be 'Se7en'. with the ironcially rotated 'v' as the '7'. IT'S SO META

Re: Recent server latency

Posted: 15 Jun 2011 00:14
by SandChigger
Thanks, Ragabash! :D

(I think I've only seen a few minutes of American Psycho, Omph, so I was pretty sure that wasn't it...)

Re: Recent server latency

Posted: 20 Jun 2011 18:10
by ragabash
Update:

I have had the server's ram upgraded from 1gb to 4gb. Reason: 1gb is how much ram a freakin' phone has.

Hopefully this will help speed us up.

Re: Recent server latency

Posted: 21 Jun 2011 11:24
by Freakzilla
Seems to be doing great! :D

:auto-layrubber:

Re: Recent server latency

Posted: 21 Jun 2011 11:27
by inhuien
This was a triumph.
I'm making a note here: HUGE SUCCESS.

Re: Recent server latency

Posted: 21 Jun 2011 11:51
by Apjak
It's hard to overstate my satifaction.