Our new Indie Games subforum is now open for business in G&T. Go and check it out, you might land a code for a free game. If you're developing an indie game and want to post about it, follow these directions. If you don't, he'll break your legs! Hahaha! Seriously though.
Our rules have been updated and given their own forum. Go and look at them! They are nice, and there may be new ones that you didn't know about! Hooray for rules! Hooray for The System! Hooray for Conforming!
Programmatically iterating over a database via basic HTTP requests
SaerisChronogestaltistTrinity, New MexicoRegistered Userregular
Let me be more specific: I'm going to be parsing a database based solely on an incrementing integer in a URL, such as site.com/?entry=1 -> site.com/?entry=2 -> site.com/?entry=3, and so on. I just need to know how to send the request, and how to receive the resulting HTML page. I'm looking for the least intrusive way to do this, since I don't want to take up much of the site's bandwidth. This is a one-time parsing, so it doesn't exactly have to be elegant or maintainable or even in any specific language, but I would prefer it to be in a language which has powerful string manipulation facilities.
I don't know much about this type of programming, so I am looking for as simplistic a solution as possible. I'm fairly sure I've even seen Perl scripts that can do this sort of thing with a few lines, but Google has failed me so far. Thank you.