Comments on: Steal this idea: Portable scraping

By: Portable scraping with ScraperWiki – Pie Palace

Portable scraping with ScraperWiki – Pie Palace — Wed, 10 Nov 2010 17:15:54 +0000

[...] couple of years back I floated the idea of portable website scrapers that would be able to programmatically pull information off of websites regardless of language and [...]

By: Erigami Scholey-Fuller

Erigami Scholey-Fuller — Wed, 21 May 2008 03:05:24 +0000

@gawp: Good idea. One way to do that would be to force outputs to conform to a regex.

@cath: sorry. =)

By: Cath

Cath — Tue, 20 May 2008 16:51:05 +0000

wow. obviously I am not the target audience for this post.

*waves at e*

By: gawp

gawp — Tue, 20 May 2008 12:55:33 +0000

As this is glorified screen scraping, very rigorous type checking for the return values would be helpful so that changes in the page don’t start returning unusable goo. They should return meaning full errors, for example if your balance doesn’t appear to be a money value, etc.