UnrealSP.org

sana wrote:So, did anybody experience any issues since my last post in this thread? I banned the Baiduspider from crawling the site, which seems to have reduced site activity something fierce. I haven't personally encountered any problems since. Anyone else?

Right after I write this, the site stops responding and after school I find that, for some reason, a MySQL table has broken and requires repairing. Urrrrrrghhhh.

Yeah man, baidu spiders (and some other chinese ones) can eat up all the bandwidth. They do NOT listen to robots.txt and the like. You should check out articles about how to block spiders through the .htaccess file. It isn't that difficult actually, just make sure that you use the .htaccess file in the root (or http_docs or whatever folder you have your regular index.html in). From what I've seen that's the only way you can stop them.

I tried to go from page 2 to page 1 in heirloom (dont ask me why.. but I wanted to know if there was anything serious in there after reading page 2) and got this:

SQL ERROR [ mysqli ]

Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) [2002]

An sql error occurred while fetching this page. Please contact an administrator if this problem persists.

Well, I blocked the Baiduspiders and strongly reduced crawler presence on the website, and the errors keep on coming... I'm fairly sure this means that the issues come from other websites hosted on the same webspace, meaning it's outside of my control. Meh. So much for cheap web hosting!
On the upside it DOES cost a mere fraction of what Hellscrag used to pay... and thankfully USP is enough of a niche website that access to it is not vital 24/7..

Do you still get a lot of spiders? And how did you block the Baidu ones? (through .htaccess I hope?)

I followed the instructions on Baidu's website and added

User-agent: *
Allow: /

User-agent: Baiduspider
Disallow: /

to a robots.txt file in the website root directory. I haven't seen Baiduspiders in the "Who is online?" forums section since then. (Before that they'd be there by the dozens)

sana wrote:I followed the instructions on Baidu's website and added

User-agent: *
Allow: /

User-agent: Baiduspider
Disallow: /

to a robots.txt file in the website root directory. I haven't seen Baiduspiders in the "Who is online?" forums section since then. (Before that they'd be there by the dozens)

That's interesting, because Baidu normally doesn't go by the robots.txt rules.. Or maybe that was Yandex spider..

For some reason, I'm getting alot of slowness and errors on Unrealsp on my dads laptop. Here is a error that happend recently when I was trying to check the new map of the week (If it came out, I don't know yet.).

Lots of downtime today. What can I say? Arvixe.

Still it's not that bad, it works most of a time. Myself I'm testing AcuGIS (needed PostgreSQL) dunno about stability but they have kick ass customer service.

Had that too, but it's okay now.

I've been having problems getting into chat though. With Mozilla and IE.

Isn't the chat completely unrelated to the website? I can join it just fine though.

Well I can't. It must be me then.

Since the chat is IRC-based, I advise that you try alternate means to enter it. ChatZilla, Mibbit's main site, mIRC etc.

The chat can be found at:

irc.synirc.net
#unrealsp

Seriously though, I have no clue why the embedded Mibbit client doesn't work for you. Hmph. Will have to investigate.