Recent server latency

Image
    What's New

Moderators: ᴶᵛᵀᴬ, Omphalos, Freakzilla

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Recent server latency

Postby ragabash » 02 Jun 2011 01:49

Hey, all. We've been having some technical issues lately. Specifically, large and crippling latency spikes. When the site suddenly becomes sluggish and nonresponsive out of nowhere. What's been happening is that large queries have been slowing the database server down. When this happens, all the other open requests start stacking up, and the server slows to a crawl.

Has anyone been running large searches of any of the sites, or running searches with incredibly common terms? This could be it.
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
Omphalos
Inglorious Bastard
Posts: 6621
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Postby Omphalos » 02 Jun 2011 02:33

I just remembered that this search feature wont let us search common terms. It wont even let us search something like "Paul" because we use that word so much. Could it be something else bro?

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 02 Jun 2011 21:36

As you guys can tell, the server went down again. I examined the logs after bringing it back up. About 10 minutes before it went all pear shaped, a type of system called an open relay attempted own the server. I'm still examining things, but I think we're ok. This may happen a few more times before whoever is trying moves on. Sorry for the downtime.
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 09 Jun 2011 15:20

All,

I've been monitoring the server lately, and I've noticed that the MSN crawler has been making a lot of regular connections. about twice an hour, with multiple simultaneous connections. I've read up on it, and a lot of webmasters complain that MSN doesn't respect the general rules of etiquette for search engine bots, in that it spams the ever living shit out of servers. It seems to be doing it to us as well.

I'd like to block all MSN bots. There is a downside to this; the site will eventually not be listed in the Bing search engine. I know you guys pride yourself on being first in Frank Herbert and Dune searches on various engines, so I figure I'd see how you felt about this idea. It's a real damned if you do/damned if you don't kind of deal. Please respond to this thread with any thoughts or ideas.

On a side note, we're also getting spammed by Ukranian botnet as well. This also may be causing latency, so MSN might not be the only culprit. Unfortunately, this botnet doesn't use a known pool of source addresses, so blocking it will be problematic, to say the least.
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18147
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Postby Freakzilla » 09 Jun 2011 15:59

I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman

User avatar
Nekhrun
Icelandic Wiener
Posts: 3288
Joined: 10 Feb 2008 16:27

Re: Recent server latency

Postby Nekhrun » 09 Jun 2011 17:21

Freakzilla wrote:I don't care much about Bing. I don't think they're going to dethrone Google any time soon.

Agreed. F 'em. Maybe that's what happened to DN and they took themselves off the grid completely! :lol:

As long as we still come up on Dogpile and Netscape we should be okay.
"If he was here to discuss Dune, he sure as hell picked a dumb way to do it." -Omphalos :character-cookiemonster:

Happy Memorial Day everyone! -James C. Harwood

"Three of my videos have over 100 views."
"Over 500 views for my 'Open Question' video." -Nebiros

User avatar
Omphalos
Inglorious Bastard
Posts: 6621
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Postby Omphalos » 09 Jun 2011 18:54

Ban the fuckers. Goddam Gatesian way of thinking will get them in trouble.

D Pope
Posts: 1500
Joined: 14 May 2010 14:11
Location: Grubville

Re: Recent server latency

Postby D Pope » 09 Jun 2011 20:14

Smite them!
Take their water!

I tried bing a time or two, looking to see what the comercials were about. When google proved bing was using their stuff, I had to laugh- & haven't been back.

Dispatch them with ragabash force!

:violence-smack:
Leto II is gone for good, except for OM. The "pearl" was just that; a miniscule portion of what Leto was, and not a compressed version of the whole. The pearl that the worms have do not make them Leto, or in any way similar to him.
-Omphalos

User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18147
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Postby Freakzilla » 09 Jun 2011 22:15

First we tattoo him, then we hang him, THEN we kill him!
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman

User avatar
Serkanner
Posts: 2828
Joined: 17 Feb 2008 18:44
Location: Den Haag - The Netherlands

Re: Recent server latency

Postby Serkanner » 10 Jun 2011 03:18

Never have used Bing ... never will. Fuck 'm.
"... the mystery of life isn't a problem to solve but a reality to experience."

“There is no escape—we pay for the violence of our ancestors.”

Sandrider: "Keith went to Bobo's for a weekend of drinking, watched some DVDs,
and wrote a Dune Novel."

User avatar
SandChigger
KJASF Ground Zero
Posts: 14490
Joined: 08 Feb 2008 22:29
Location: "Whatcha having, shoog? Hurry up and order now, I ain't got all day!"
Contact:

Re: Recent server latency

Postby SandChigger » 10 Jun 2011 09:35

Fuck Bing.

Fuck Anderson.

Fuck the Herberritts.

Fuck them, fuck them ALL!!! :angry-screaming:

:shock:

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 10 Jun 2011 13:05

SandChigger wrote:
Fuck them, fuck them ALL!!! :angry-screaming:

:shock:


:shock:

Well. Uh.
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 10 Jun 2011 13:06

I took the first step today and disabled guest searches for Jacurutu.

Omph, the instructions are here:
http://www.phpbb.com/community/viewtopic.php?f=46&t=725495

Could you do the same for Tau? It's all done in the ACP.
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 10 Jun 2011 13:40

...aaaaand I just blocked the MSN spider at the firewall.

I think. :D
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18147
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Postby Freakzilla » 10 Jun 2011 13:54

...and there was much rejoicing. :dance:
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman

User avatar
Omphalos
Inglorious Bastard
Posts: 6621
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Postby Omphalos » 10 Jun 2011 17:41

ragabash wrote:I took the first step today and disabled guest searches for Jacurutu.

Omph, the instructions are here:
http://www.phpbb.com/community/viewtopic.php?f=46&t=725495

Could you do the same for Tau? It's all done in the ACP.


did you block the bing bot on the control panel too? If not I can take care of it tonight.

User avatar
Eyes High
Patience Personified
Posts: 2321
Joined: 22 Jul 2008 15:32
Location: between the worlds of men and make believe

Re: Recent server latency

Postby Eyes High » 13 Jun 2011 16:51

SandChigger wrote:Fuck Bing.

Fuck Anderson.

Fuck the Herberritts.

Fuck them, fuck them ALL!!! :angry-screaming:

:shock:


Don't forget your protection. :shifty: :whistle:
What fear is there in the night?
Nothing, but that which is in our own imaginations.

User avatar
SandChigger
KJASF Ground Zero
Posts: 14490
Joined: 08 Feb 2008 22:29
Location: "Whatcha having, shoog? Hurry up and order now, I ain't got all day!"
Contact:

Re: Recent server latency

Postby SandChigger » 14 Jun 2011 10:13

Oh, I won't.

What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

THAT's the kind of protection I'm thinking. :twisted:

(Yeah, I slipped and fell into a dark place last night. :shock: )

User avatar
Omphalos
Inglorious Bastard
Posts: 6621
Joined: 05 Feb 2008 11:07
Location: The Mighty Central Valley of California
Contact:

Re: Recent server latency

Postby Omphalos » 14 Jun 2011 12:51

SandChigger wrote:Oh, I won't.

What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

THAT's the kind of protection I'm thinking. :twisted:

(Yeah, I slipped and fell into a dark place last night. :shock: )


Been a while since I've seen it, but that sounds like American Psycho.

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 14 Jun 2011 16:12

That would be 'Se7en'. with the ironcially rotated 'v' as the '7'. IT'S SO META
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
SandChigger
KJASF Ground Zero
Posts: 14490
Joined: 08 Feb 2008 22:29
Location: "Whatcha having, shoog? Hurry up and order now, I ain't got all day!"
Contact:

Re: Recent server latency

Postby SandChigger » 15 Jun 2011 00:14

Thanks, Ragabash! :D

(I think I've only seen a few minutes of American Psycho, Omph, so I was pretty sure that wasn't it...)

User avatar
ragabash
The Benefactor
Posts: 69
Joined: 05 Feb 2008 01:45
Location: Sacramento, CA

Re: Recent server latency

Postby ragabash » 20 Jun 2011 18:10

Update:

I have had the server's ram upgraded from 1gb to 4gb. Reason: 1gb is how much ram a freakin' phone has.

Hopefully this will help speed us up.
GLaDOS wrote:This was a triumph.
I'm making a note here: HUGE SUCCESS.

User avatar
Freakzilla
Lead Singer and Driver of the Winnebego
Posts: 18147
Joined: 05 Feb 2008 01:27
Location: Atlanta, Georgia, USA
Contact:

Re: Recent server latency

Postby Freakzilla » 21 Jun 2011 11:24

Seems to be doing great! :D

:auto-layrubber:
Image
Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
~Pink Snowman

User avatar
inhuien
Posts: 3629
Joined: 09 Feb 2008 05:03
Location: right here as in not (all) there

Re: Recent server latency

Postby inhuien » 21 Jun 2011 11:27

This was a triumph.
I'm making a note here: HUGE SUCCESS.
Image

User avatar
Apjak
Posts: 518
Joined: 30 Jun 2008 12:06
Location: Kansas City

Re: Recent server latency

Postby Apjak » 21 Jun 2011 11:51

It's hard to overstate my satifaction.
I don't think the author should make the reader do that much work - Kevin J. Anderson
We think we've updated 'Dune' for a modern readership without dumbing it down.- Brian Herbert
There’s an unwritten compact between you and the reader. If someone enters a bookstore and sets down hard earned money(energy) for your book, you owe that person some entertainment and as much more as you can give. - Frank Herbert


Return to “˲”