• Register
  • Login
  •          

    Recent server latency

    Image
      What's New

    Moderators: Omphalos, Freakzilla, ᴶᵛᵀᴬ

    Recent server latency

    Postby ragabash » 02 Jun 2011 01:49

    Hey, all. We've been having some technical issues lately. Specifically, large and crippling latency spikes. When the site suddenly becomes sluggish and nonresponsive out of nowhere. What's been happening is that large queries have been slowing the database server down. When this happens, all the other open requests start stacking up, and the server slows to a crawl.

    Has anyone been running large searches of any of the sites, or running searches with incredibly common terms? This could be it.
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby Omphalos » 02 Jun 2011 02:33

    I just remembered that this search feature wont let us search common terms. It wont even let us search something like "Paul" because we use that word so much. Could it be something else bro?
    User avatar
    Omphalos
    Inglorious Bastard
     
    Posts: 6537
    Joined: 05 Feb 2008 11:07
    Location: The Mighty Central Valley of California

    Re: Recent server latency

    Postby ragabash » 02 Jun 2011 21:36

    As you guys can tell, the server went down again. I examined the logs after bringing it back up. About 10 minutes before it went all pear shaped, a type of system called an open relay attempted own the server. I'm still examining things, but I think we're ok. This may happen a few more times before whoever is trying moves on. Sorry for the downtime.
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby ragabash » 09 Jun 2011 15:20

    All,

    I've been monitoring the server lately, and I've noticed that the MSN crawler has been making a lot of regular connections. about twice an hour, with multiple simultaneous connections. I've read up on it, and a lot of webmasters complain that MSN doesn't respect the general rules of etiquette for search engine bots, in that it spams the ever living shit out of servers. It seems to be doing it to us as well.

    I'd like to block all MSN bots. There is a downside to this; the site will eventually not be listed in the Bing search engine. I know you guys pride yourself on being first in Frank Herbert and Dune searches on various engines, so I figure I'd see how you felt about this idea. It's a real damned if you do/damned if you don't kind of deal. Please respond to this thread with any thoughts or ideas.

    On a side note, we're also getting spammed by Ukranian botnet as well. This also may be causing latency, so MSN might not be the only culprit. Unfortunately, this botnet doesn't use a known pool of source addresses, so blocking it will be problematic, to say the least.
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby Freakzilla » 09 Jun 2011 15:59

    I don't care much about Bing. I don't think they're going to dethrone Google any time soon.
    Image
    Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
    ~Pink Snowman
    User avatar
    Freakzilla
    Lead Singer and Driver of the Winnebego
     
    Posts: 17977
    Joined: 05 Feb 2008 01:27
    Location: Atlanta, Georgia, USA

    Re: Recent server latency

    Postby Nekhrun » 09 Jun 2011 17:21

    Freakzilla wrote:I don't care much about Bing. I don't think they're going to dethrone Google any time soon.

    Agreed. F 'em. Maybe that's what happened to DN and they took themselves off the grid completely! :lol:

    As long as we still come up on Dogpile and Netscape we should be okay.
    "If he was here to discuss Dune, he sure as hell picked a dumb way to do it." -Omphalos :character-cookiemonster:

    Happy Memorial Day everyone! -James C. Harwood

    "Three of my videos have over 100 views."
    "Over 500 views for my 'Open Question' video." -Nebiros
    User avatar
    Nekhrun
    Icelandic Wiener
     
    Posts: 3287
    Joined: 10 Feb 2008 16:27

    Re: Recent server latency

    Postby Omphalos » 09 Jun 2011 18:54

    Ban the fuckers. Goddam Gatesian way of thinking will get them in trouble.
    User avatar
    Omphalos
    Inglorious Bastard
     
    Posts: 6537
    Joined: 05 Feb 2008 11:07
    Location: The Mighty Central Valley of California

    Re: Recent server latency

    Postby D Pope » 09 Jun 2011 20:14

    Smite them!
    Take their water!

    I tried bing a time or two, looking to see what the comercials were about. When google proved bing was using their stuff, I had to laugh- & haven't been back.

    Dispatch them with ragabash force!

    :violence-smack:
    Leto II is gone for good, except for OM. The "pearl" was just that; a miniscule portion of what Leto was, and not a compressed version of the whole. The pearl that the worms have do not make them Leto, or in any way similar to him.
    -Omphalos
    D Pope
     
    Posts: 1500
    Joined: 14 May 2010 14:11
    Location: Grubville

    Re: Recent server latency

    Postby Freakzilla » 09 Jun 2011 22:15

    First we tattoo him, then we hang him, THEN we kill him!
    Image
    Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
    ~Pink Snowman
    User avatar
    Freakzilla
    Lead Singer and Driver of the Winnebego
     
    Posts: 17977
    Joined: 05 Feb 2008 01:27
    Location: Atlanta, Georgia, USA

    Re: Recent server latency

    Postby Serkanner » 10 Jun 2011 03:18

    Never have used Bing ... never will. Fuck 'm.
    "... the mystery of life isn't a problem to solve but a reality to experience."

    “There is no escape—we pay for the violence of our ancestors.”

    Sandrider: "Keith went to Bobo's for a weekend of drinking, watched some DVDs,
    and wrote a Dune Novel."
    User avatar
    Serkanner
     
    Posts: 2781
    Joined: 17 Feb 2008 18:44
    Location: Den Haag - The Netherlands

    Re: Recent server latency

    Postby SandChigger » 10 Jun 2011 09:35

    Fuck Bing.

    Fuck Anderson.

    Fuck the Herberritts.

    Fuck them, fuck them ALL!!! :angry-screaming:

    :shock:
    User avatar
    SandChigger
    KJASF Ground Zero
     
    Posts: 14490
    Joined: 08 Feb 2008 22:29
    Location: "Whatcha having, shoog? Hurry up and order now, I ain't got all day!"

    Re: Recent server latency

    Postby ragabash » 10 Jun 2011 13:05

    SandChigger wrote:
    Fuck them, fuck them ALL!!! :angry-screaming:

    :shock:


    :shock:

    Well. Uh.
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby ragabash » 10 Jun 2011 13:06

    I took the first step today and disabled guest searches for Jacurutu.

    Omph, the instructions are here:
    http://www.phpbb.com/community/viewtopic.php?f=46&t=725495

    Could you do the same for Tau? It's all done in the ACP.
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby ragabash » 10 Jun 2011 13:40

    ...aaaaand I just blocked the MSN spider at the firewall.

    I think. :D
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby Freakzilla » 10 Jun 2011 13:54

    ...and there was much rejoicing. :dance:
    Image
    Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
    ~Pink Snowman
    User avatar
    Freakzilla
    Lead Singer and Driver of the Winnebego
     
    Posts: 17977
    Joined: 05 Feb 2008 01:27
    Location: Atlanta, Georgia, USA

    Re: Recent server latency

    Postby Omphalos » 10 Jun 2011 17:41

    ragabash wrote:I took the first step today and disabled guest searches for Jacurutu.

    Omph, the instructions are here:
    http://www.phpbb.com/community/viewtopic.php?f=46&t=725495

    Could you do the same for Tau? It's all done in the ACP.


    did you block the bing bot on the control panel too? If not I can take care of it tonight.
    User avatar
    Omphalos
    Inglorious Bastard
     
    Posts: 6537
    Joined: 05 Feb 2008 11:07
    Location: The Mighty Central Valley of California

    Re: Recent server latency

    Postby Eyes High » 13 Jun 2011 16:51

    SandChigger wrote:Fuck Bing.

    Fuck Anderson.

    Fuck the Herberritts.

    Fuck them, fuck them ALL!!! :angry-screaming:

    :shock:


    Don't forget your protection. :shifty: :whistle:
    Image

    What fear is there in the night?
    Nothing, but that which is in our own imaginations.
    User avatar
    Eyes High
    Patience Personified
     
    Posts: 2316
    Joined: 22 Jul 2008 15:32
    Location: between the worlds of men and make believe

    Re: Recent server latency

    Postby SandChigger » 14 Jun 2011 10:13

    Oh, I won't.

    What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

    THAT's the kind of protection I'm thinking. :twisted:

    (Yeah, I slipped and fell into a dark place last night. :shock: )
    User avatar
    SandChigger
    KJASF Ground Zero
     
    Posts: 14490
    Joined: 08 Feb 2008 22:29
    Location: "Whatcha having, shoog? Hurry up and order now, I ain't got all day!"

    Re: Recent server latency

    Postby Omphalos » 14 Jun 2011 12:51

    SandChigger wrote:Oh, I won't.

    What movie was it where the serial killer made some guy strap on a razor dildo contraption and screw a whore to death? Was that Seven or something else?

    THAT's the kind of protection I'm thinking. :twisted:

    (Yeah, I slipped and fell into a dark place last night. :shock: )


    Been a while since I've seen it, but that sounds like American Psycho.
    User avatar
    Omphalos
    Inglorious Bastard
     
    Posts: 6537
    Joined: 05 Feb 2008 11:07
    Location: The Mighty Central Valley of California

    Re: Recent server latency

    Postby ragabash » 14 Jun 2011 16:12

    That would be 'Se7en'. with the ironcially rotated 'v' as the '7'. IT'S SO META
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby SandChigger » 15 Jun 2011 00:14

    Thanks, Ragabash! :D

    (I think I've only seen a few minutes of American Psycho, Omph, so I was pretty sure that wasn't it...)
    User avatar
    SandChigger
    KJASF Ground Zero
     
    Posts: 14490
    Joined: 08 Feb 2008 22:29
    Location: "Whatcha having, shoog? Hurry up and order now, I ain't got all day!"

    Re: Recent server latency

    Postby ragabash » 20 Jun 2011 18:10

    Update:

    I have had the server's ram upgraded from 1gb to 4gb. Reason: 1gb is how much ram a freakin' phone has.

    Hopefully this will help speed us up.
    GLaDOS wrote:This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    User avatar
    ragabash
    The Benefactor
     
    Posts: 50
    Joined: 05 Feb 2008 01:45
    Location: Sacramento, CA

    Re: Recent server latency

    Postby Freakzilla » 21 Jun 2011 11:24

    Seems to be doing great! :D

    :auto-layrubber:
    Image
    Paul of Dune was so bad it gave me a seizure that dislocated both of my shoulders and prolapsed my anus.
    ~Pink Snowman
    User avatar
    Freakzilla
    Lead Singer and Driver of the Winnebego
     
    Posts: 17977
    Joined: 05 Feb 2008 01:27
    Location: Atlanta, Georgia, USA

    Re: Recent server latency

    Postby inhuien » 21 Jun 2011 11:27

    This was a triumph.
    I'm making a note here: HUGE SUCCESS.
    Image
    User avatar
    inhuien
     
    Posts: 3629
    Joined: 09 Feb 2008 05:03
    Location: right here as in not (all) there

    Re: Recent server latency

    Postby Apjak » 21 Jun 2011 11:51

    It's hard to overstate my satifaction.
    I don't think the author should make the reader do that much work - Kevin J. Anderson
    We think we've updated 'Dune' for a modern readership without dumbing it down.- Brian Herbert
    There’s an unwritten compact between you and the reader. If someone enters a bookstore and sets down hard earned money(energy) for your book, you owe that person some entertainment and as much more as you can give. - Frank Herbert
    User avatar
    Apjak
     
    Posts: 518
    Joined: 30 Jun 2008 12:06
    Location: Kansas City

    Next

    Return to ˲

    Who is online

    Users browsing this forum: No registered users and 2 guests