Penny Arcade Forums› H.Q. Reception Desk
Open call for Board Member and Moderator positions in Coin Return. More information here.
Sign up to win MNC Dover's voice! Details here.

Searching temporarily disabled

RamiusRamius Joined: July 19, 2000Administrator, ClubPA admin
edited March 2008 in H.Q. Reception Desk
FYI

We're having some pretty major system stability problems, and I haven't heard back from alphamonkey, and search is one of our greatest consumers of processing power, so I've temporarily disabled it.

1zxt8dhasaon.png
Ramius on
«13

Posts

  • ASimPersonASimPerson Cold... ... and hard.Registered User regular
    edited January 2008
    Seems to have worked, at least for the time being.

    ASimPerson on
    redoctober2.pngSE++ Forum Battle Archive
  • the wookthe wook Registered User regular
    edited January 2008
    but Ramius, how will i shamelessly validate my ego now?

    the wook on
  • MKRMKR Registered User regular
    edited January 2008
    Looks like boardreader is still indexing PA.

    MKR on
  • Satan.Satan. __BANNED USERS regular
    edited January 2008
    MKR wrote: »
    Looks like boardreader is still indexing PA.

    Yeah, is this part of the problem?

    Satan. on
    [SIGPIC][/SIGPIC]
  • MKRMKR Registered User regular
    edited January 2008
    I doubt it. I was just pointing to that for search addicts. :)

    MKR on
  • chromdomchromdom Who? Where?Registered User regular
    edited January 2008
    Any idea when search will be back on line? I was reviewing Caturday in SE++ and was going to look this morning for something I think I remember reading about Vista in H/A. So yeah, demand for Search has not gone away. How's the supply coming? Thanks!

    chromdom on
  • MKRMKR Registered User regular
    edited January 2008
    I would say use boardreader (and link you to it), but I still don't know the official word on whether or not the staff approves of the service.

    MKR on
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    I still don't know why they ignore our robots.txt, but I've kept an eye on them and they generally have only 2 threads spidering us at a time, at a moderate pace, so I've allowed them.

    Ramius on
    1zxt8dhasaon.png
  • SueveSueve Registered User regular
    edited January 2008
    noooooooooooooooooooooooooooooooooooo

    i need to find my indy games thread, and i don't want to search myself!

    Sueve on
    www.flickr.com/andreismith
  • Goose!Goose! That's me, honey Show me the way home, honeyRegistered User regular
    edited January 2008
    Sueve wrote: »
    noooooooooooooooooooooooooooooooooooo

    i need to find my indy games thread, and i don't want to search myself!

    Suck it up? (edited for my stupidity)

    Goose! on
  • Satan.Satan. __BANNED USERS regular
    edited January 2008
    It's simple: We either have search turned on and have dog-ass slow forums with timeouts OR search turned off and have snappy forums.

    I'll take the later, especially since BoardReader still works until alpha comes around.

    Satan. on
    [SIGPIC][/SIGPIC]
  • DeswaDeswa Registered User regular
    edited January 2008
    You could also just subscribe to the thread.

    Deswa on
    gobassgo wrote:
    "It ain't rape, it's surprise sex!"
    wii : 3788 3264 2419 8070
  • LewiePLewieP Registered User regular
    edited January 2008
    Could we have searching disabled for everyone except me?

    I use it all the time...

    LewieP on
    SavyGamer.co.uk / Twitter
  • Satan.Satan. __BANNED USERS regular
    edited January 2008
    LewieP wrote: »
    Could we have searching disabled for everyone except me?

    I use it all the time...
    http://boardreader.com/sp/Penny_Arcade_Forums_43380.html

    Since you're all so damn lazy. That's essentially a mirror of our forums, now with searching!

    Satan. on
    [SIGPIC][/SIGPIC]
  • LewiePLewieP Registered User regular
    edited January 2008
    Wow, that's useful, thanks!

    LewieP on
    SavyGamer.co.uk / Twitter
  • LewieP's MummyLewieP's Mummy Registered User regular
    edited January 2008
    Lazy boy.

    LewieP's Mummy on
    For all the top UK Gaming Bargains, check out SavyGamer

    For paintings in progress, check out canvas and paints

    "The power of the weirdness compels me."
  • HenroidHenroid Mexican kicked from Immigration Thread Centrism is Racism :3Registered User regular
    edited January 2008
    LewiePs Mummy wrote: »
    Lazy boy.

    I believe it!

    Henroid on
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    I've got it back on...for now.

    No guarantees how long it will be up. We'll have to wait and see what tomorrow's traffic brings.

    Ramius on
    1zxt8dhasaon.png
  • LaOsLaOs SaskatoonRegistered User regular
    edited January 2008
    Well, that would explain the great slowness in the latter part of the evening here.

    LaOs on
  • MKRMKR Registered User regular
    edited January 2008
    Oh look, a gateway timeout.

    :D

    MKR on
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    yeah, that failed spectacularly.

    I'll see if I hardcode the bugger to only search recent history if it will work better. Otherwise, we will probably have to go without search until we can get some hardware upgrades in here.

    Ramius on
    1zxt8dhasaon.png
  • SmasherSmasher Starting to get dizzy Registered User regular
    edited January 2008
    Out of curiosity, is it individual searches that cause the slowness or are there just a lot of them?

    Smasher on
  • EvilBadmanEvilBadman DO NOT TRUST THIS MAN Registered User regular
    edited January 2008
    Eh, it's pretty much the same reason the Something Awful forums* have searching disabled for basic accounts. The servers can't handle X people searching Y threads at once.

    *Yes, I am well aware that, "Lol I pay to use a forum, and can pay more to search said forums."

    EvilBadman on
    FyreWulff wrote: »
    I should note that Badman is fucking awesome
    XBL- Evil Badman; Steam- EvilBadman; Twitter - EvilBadman
  • victor_c26victor_c26 Chicago, ILRegistered User regular
    edited January 2008
    Satan Himself wrote: »
    LewieP wrote: »
    Could we have searching disabled for everyone except me?

    I use it all the time...
    http://boardreader.com/sp/Penny_Arcade_Forums_43380.html

    Since you're all so damn lazy. That's essentially a mirror of our forums, now with searching!

    I always thought that was a shady site, good to know it's trustworthy.

    victor_c26 on
    It's been so long since I've posted here, I've removed my signature since most of what I had here were broken links. Shows over, you can carry on to the next post.
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    I still think it is a little shady. Last I checked, the url their spider reports for getting info about their spidering policies is 404 not found, and they've been ignoring our robots.txt all along.

    Ramius on
    1zxt8dhasaon.png
  • MKRMKR Registered User regular
    edited January 2008
    Ramius, their FAQ indicates that the service is opt-in. I think that means someone added PA without permission.

    Might want to send BR an e-mail. :P

    Edit: Looks like PA has been removed from the site. D:

    Edit2: No, there it is again. Weird.

    MKR on
  • AldoAldo Hippo Hooray Registered User regular
    edited January 2008
    Just wanted to point out that the site is still rather slow, despite searching being disabled. I don't think I want to know how bad it would be with searching enabled.

    Aldo on
  • MeizMeiz Registered User regular
    edited January 2008
    There some sort of indexing service that runs every X minutes or so?

    Meiz on
  • Satan.Satan. __BANNED USERS regular
    edited January 2008
    Back to gateway timeouts and slow load times. Everyone is egosearching at once it seems.

    Satan. on
    [SIGPIC][/SIGPIC]
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    Aldo, Meiz, and SH: thanks for the reports. I've not been able to monitor things as closely today as I did on Fri so that is good info to know.

    Everyone is egosearching at once it seems
    Nobody can egosearch when searching is off.

    Ramius on
    1zxt8dhasaon.png
  • AldoAldo Hippo Hooray Registered User regular
    edited January 2008
    It appears to have speeded up considerably now, not sure if I'm just lucky now or that something changed. o_O

    Aldo on
  • Satan.Satan. __BANNED USERS regular
    edited January 2008
    Ramius wrote: »
    Aldo, Meiz, and SH: thanks for the reports. I've not been able to monitor things as closely today as I did on Fri so that is good info to know.

    Everyone is egosearching at once it seems
    Nobody can egosearch when searching is off.
    It appeared to be on earlier when I made that post (being turned off just prior to said post). I figured it was you trying to hard code the search history limit you talked about.

    Satan. on
    [SIGPIC][/SIGPIC]
  • MeizMeiz Registered User regular
    edited January 2008
    I'm just trying to think of what I know and see if it applies to the current situation. I know when the XP search indexer decides to start up, I have to tell it to shut up a few times. Considering when it's operational, the search is rather quick, I was wondering if such a system was in place for the board. Hell, I'm not even sure what the core guts are. Having heard from Khoo during that time we upgraded it was something more then decent.

    If you need a hand monitoring, that is if the learning curve isn't beyond my fragile little mind, I'm usually around mon-fri 8:30am-5pm EST.

    Meiz on
  • Satan.Satan. __BANNED USERS regular
    edited January 2008
    Slow load times now. 10-30s. No gateway errors/timeouts though.

    Satan. on
    [SIGPIC][/SIGPIC]
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    I just tweaked the slave_db setting, and although I'm seeing very high load averages and this is our busiest time of day, most all pages are loading for me in 3 secs or less.

    If anyone sees 8-10 sec pageloads or higher, please report it here, thanks.

    Ramius on
    1zxt8dhasaon.png
  • tuggatugga Makin' movies Makin' songsRegistered User regular
    edited January 2008
    could the amount of posts the search function be looking through be a problem?

    because there are a little less than 4 million posts on the entire board, and i recall that in the past every once in awhile old threads would be deleted forever, and im not sure that we absolutely need threads from august of 2006 like we have now, so i dont think many people would contest a trim, especially if it might improve the quality of the forum

    tugga on
    66OoDuJ.jpg
    STEAM!
  • RamiusRamius Joined: July 19, 2000 Administrator, ClubPA admin
    edited January 2008
    pruning the old posts is my "last resort" option. Once it is done, it cannot be undone.

    There are a number of options which can be employed before that, but they are unfortunately not the "quick fix" that pruning would be.


    My preference was to archive all the old posts to disk and serve that to google/yahoo/msn to allow those sorts of searches for now, and then eventually get some dedicated search software which would allow us to do higher-fidelity searches of those archives (google searches would not allow you to search by subforum or by username or by a date range).

    But as it turns out, there is some scheduled hardware changes coming up, so alpha's thought has been to try and tweak things to make them "get by" until the hardware changes come, and then re-evaluate the situation after that. So that's what we're doing now.

    Ramius on
    1zxt8dhasaon.png
  • JavenJaven Registered User regular
    edited January 2008
    So now that we know what we're waiting for, is there an ETA to all this? Or is it just 'whenever we get around to it?'

    Javen on
  • AegisAegis Fear My Dance Overshot Toronto, Landed in OttawaRegistered User regular
    edited January 2008
    Getting frequent 30+ second page loads here Ramius.

    Aegis on
    We'll see how long this blog lasts
    Currently DMing: None :(
    Characters
    [5e] Dural Melairkyn - AC 18 | HP 40 | Melee +5/1d8+3 | Spell +4/DC 12
  • BobCescaBobCesca Is a girl Birmingham, UKRegistered User regular
    edited January 2008
    same here.

    BobCesca on
Sign In or Register to comment.
Penny Arcade Forums› H.Q. Reception Desk