
Webbots, spiders, and screen scrapers
2mentions
1recommended by
2HN commenters
2010first – last mentioned
50% recommend50% neutral
Affiliate links. As an Amazon Associate I earn from qualifying purchases.

50% recommend50% neutral
Affiliate links. As an Amazon Associate I earn from qualifying purchases.
In the book "Webbots, Spiders and Screen Scrapers" by Michael Schrenk, there's a topic that deals with automatic procurement and 'sniping' for those who are interested in reading further. See #19 on the section list for a description: http://www.schrenk.com/nostarch/webbots/DSP_inside.php…
on “Implementing the auto-buying bot from xkcd #576” ↗…out. I've been writing modest little web bots/crawlers in shell script for quite a few years now. I think it was a comment on HN just yesterday that prompted an impulse purchase of Michael Schrenk's Webbots, Spiders, and Screen Scrapers (ebooks at nostarch.com currently 1/2 the dead-tree version price). Even though I knew the platform going in (PHP w/ the CURL lib), at every page I can't help but gasp at what an awkward platform this…
on “Mining the Web with Clojure” ↗