bew: A primitive, if not effective, webcrawler

bew comes from the same mind that created album, which you might remember from early this year.

2013-08-15-v5-122p-bew

bew is tiny, but packs a punch. It does an admirable job following links through a site and pulling data down.

Webcrawlers are like hex editors to me though: It’s exceedingly rare that I should need one, and usually by the time I get one and get it working, whatever I wanted is no longer really necessary.

Regardless, to find a lightweight, small and effective one like bew … well, it’s always good to have around.

4 thoughts on “bew: A primitive, if not effective, webcrawler

  1. Pingback: Bonus: D is for Debian | Inconsolation

  2. Pingback: hexedit: You can guess what it does | Inconsolation

  3. Pingback: mulk: As in, the incredible mulk | Inconsolation

  4. Pingback: httrack: The website copier | Inconsolation

Comments are closed.