Recent server latency


Moderators: Omphalos, Freakzilla, ᴶᵛᵀᴬ

User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Recent server latency

Post by ragabash »

Hey, all. We've been having some technical issues lately. Specifically, large and crippling latency spikes. When the site suddenly becomes sluggish and nonresponsive out of nowhere. What's been happening is that large queries have been slowing the database server down. When this happens, all the other open requests start stacking up, and the server slows to a crawl.

Has anyone been running large searches of any of the sites, or running searches with incredibly common terms? This could be it.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
Omphalos
Inglorious Bastard
Posts: 6677
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Post by Omphalos »

I just remembered that this search feature wont let us search common terms. It wont even let us search something like "Paul" because we use that word so much. Could it be something else bro?
Image

The New & Improved Book Review Blog

Goodnight Golden Path!
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

As you guys can tell, the server went down again. I examined the logs after bringing it back up. About 10 minutes before it went all pear shaped, a type of system called an open relay attempted own the server. I'm still examining things, but I think we're ok. This may happen a few more times before whoever is trying moves on. Sorry for the downtime.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

All,

I've been monitoring the server lately, and I've noticed that the MSN crawler has been making a lot of regular connections. about twice an hour, with multiple simultaneous connections. I've read up on it, and a lot of webmasters complain that MSN doesn't respect the general rules of etiquette for search engine bots, in that it spams the ever living shit out of servers. It seems to be doing it to us as well.

I'd like to block all MSN bots. There is a downside to this; the site will eventually not be listed in the Bing search engine. I know you guys pride yourself on being first in Frank Herbert and Dune searches on various engines, so I figure I'd see how you felt about this idea. It's a real damned if you do/damned if you don't kind of deal. Please respond to this thread with any thoughts or ideas.

On a side note, we're also getting spammed by Ukranian botnet as well. This also may be causing latency, so MSN might not be the only culprit. Unfortunately, this botnet doesn't use a known pool of source addresses, so blocking it will be problematic, to say the least.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18449
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Post by Freakzilla »

I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
User avatar
Nekhrun
Icelandic Wiener
Posts: 3298
Joined: 10 Feb 2008 16:27

Re: Recent server latency

Post by Nekhrun »

Freakzilla wrote:I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
Agreed. F 'em. Maybe that's what happened to DN and they took themselves off the grid completely! :lol:

As long as we still come up on Dogpile and Netscape we should be okay.
"If he was here to discuss Dune, he sure as hell picked a dumb way to do it." -Omphalos :character-cookiemonster:

Happy Memorial Day everyone! -James C. Harwood

"Three of my videos have over 100 views."
"Over 500 views for my 'Open Question' video." -Nebiros
User avatar
Omphalos
Inglorious Bastard
Posts: 6677
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Post by Omphalos »

Ban the fuckers. Goddam Gatesian way of thinking will get them in trouble.
Image

The New & Improved Book Review Blog

Goodnight Golden Path!
D Pope
Posts: 1504
Joined: 14 May 2010 14:11
Location: Grubville

Re: Recent server latency

Post by D Pope »

Smite them!
Take their water!

I tried bing a time or two, looking to see what the comercials were about. When google proved bing was using their stuff, I had to laugh- & haven't been back.

Dispatch them with ragabash force!

:violence-smack:
Leto II is gone for good, except for OM. The "pearl" was just that; a miniscule portion of what Leto was, and not a compressed version of the whole. The pearl that the worms have do not make them Leto, or in any way similar to him.
-Omphalos
User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18449
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Post by Freakzilla »

First we tattoo him, then we hang him, THEN we kill him!
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
Serkanner
Administrator
Posts: 2974
Joined: 17 Feb 2008 18:44
Location: Den Haag - The Netherlands

Re: Recent server latency

Post by Serkanner »

Never have used Bing ... never will. Fuck 'm.
"... the mystery of life isn't a problem to solve but a reality to experience."

“There is no escape—we pay for the violence of our ancestors.”

Sandrider: "Keith went to Bobo's for a weekend of drinking, watched some DVDs,
and wrote a Dune Novel."
User avatar
SandChigger
KJASF Ground Zero
Posts: 14492
Joined: 08 Feb 2008 22:29
Location: A continuing state of irritation
Contact:

Re: Recent server latency

Post by SandChigger »

Fuck Bing.

Fuck Anderson.

Fuck the Herberritts.

Fuck them, fuck them ALL!!! :angry-screaming:

:shock:
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

SandChigger wrote:
Fuck them, fuck them ALL!!! :angry-screaming:

:shock:
:shock:

Well. Uh.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

I took the first step today and disabled guest searches for Jacurutu.

Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495

Could you do the same for Tau? It's all done in the ACP.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

...aaaaand I just blocked the MSN spider at the firewall.

I think. :D
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18449
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Post by Freakzilla »

...and there was much rejoicing. :dance:
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
User avatar
Omphalos
Inglorious Bastard
Posts: 6677
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Post by Omphalos »

ragabash wrote:I took the first step today and disabled guest searches for Jacurutu.

Omph, the instructions are here:
http://www.phpbb.com/community/viewtopi ... 6&t=725495

Could you do the same for Tau? It's all done in the ACP.
did you block the bing bot on the control panel too? If not I can take care of it tonight.
Image

The New & Improved Book Review Blog

Goodnight Golden Path!
User avatar
Eyes High
Patience Personified
Posts: 2322
Joined: 22 Jul 2008 15:32
Location: between the worlds of men and make believe

Re: Recent server latency

Post by Eyes High »

SandChigger wrote:Fuck Bing.

Fuck Anderson.

Fuck the Herberritts.

Fuck them, fuck them ALL!!! :angry-screaming:

:shock:
Don't forget your protection. :shifty: :whistle:
What fear is there in the night?
Nothing, but that which is in our own imaginations.
User avatar
SandChigger
KJASF Ground Zero
Posts: 14492
Joined: 08 Feb 2008 22:29
Location: A continuing state of irritation
Contact:

Re: Recent server latency

Post by SandChigger »

Oh, I won't.

What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

THAT's the kind of protection I'm thinking. :twisted:

(Yeah, I slipped and fell into a dark place last night. :shock: )
User avatar
Omphalos
Inglorious Bastard
Posts: 6677
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Post by Omphalos »

SandChigger wrote:Oh, I won't.

What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

THAT's the kind of protection I'm thinking. :twisted:

(Yeah, I slipped and fell into a dark place last night. :shock: )
Been a while since I've seen it, but that sounds like American Psycho.
Image

The New & Improved Book Review Blog

Goodnight Golden Path!
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

That would be 'Se7en'. with the ironcially rotated 'v' as the '7'. IT'S SO META
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
SandChigger
KJASF Ground Zero
Posts: 14492
Joined: 08 Feb 2008 22:29
Location: A continuing state of irritation
Contact:

Re: Recent server latency

Post by SandChigger »

Thanks, Ragabash! :D

(I think I've only seen a few minutes of American Psycho, Omph, so I was pretty sure that wasn't it...)
User avatar
ragabash
The Benefactor
Posts: 78
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Post by ragabash »

Update:

I have had the server's ram upgraded from 1gb to 4gb. Reason: 1gb is how much ram a freakin' phone has.

Hopefully this will help speed us up.
GLaDOS wrote: This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18449
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Post by Freakzilla »

Seems to be doing great! :D

:auto-layrubber:
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman
User avatar
inhuien
Posts: 3638
Joined: 09 Feb 2008 05:03

Re: Recent server latency

Post by inhuien »

This was a triumph.
I'm making a note here: HUGE SUCCESS.
User avatar
Apjak
Posts: 519
Joined: 30 Jun 2008 12:06
Location: Kansas City

Re: Recent server latency

Post by Apjak »

It's hard to overstate my satifaction.
I don't think the author should make the reader do that much work - Kevin J. Anderson
We think we've updated 'Dune' for a modern readership without dumbing it down.- Brian Herbert
There’s an unwritten compact between you and the reader. If someone enters a bookstore and sets down hard earned money(energy) for your book, you owe that person some entertainment and as much more as you can give. - Frank Herbert
Post Reply