[Coco] Site downloader help

Joshua Harper allencoco at yahoo.com
Wed Jan 25 01:21:47 EST 2023


The owner of the archive knows I was going to do this. He is the one that suggested HT track to try to use to download the website. Thanks for all your guises help.

> On Jan 24, 2023, at 9:41 PM, Rob Rosenbrock via Coco <coco at maltedmedia.com> wrote:
> 
> 
>> On Jan 24, 2023, at 4:18 PM, Andrew via Coco <coco at maltedmedia.com> wrote:
>> 
>> I usually use a custom script I wrote for wget that will usually grab everything from a site - and sometimes a bit more. Then it does some post-cleanup, and a couple of other tidbits. It ain't perfect, but usually will get the job done (provided there ain't a rate-limiter monitor on the site that boots me off and bans my access - if I suspect such a thing, I'll put in a randomized grab and rate-limit to better simulate a human which will usually get around that - but takes forever to pull down a large site).
> 
> Yeah… I got banned from one site after I copied the url. JDownloader took it and before it could finish grabbing the directory of one page I lost access. I didn’t get one file. I had to go through the wayback machine as a workaround
> 
> -- 
> Coco mailing list
> Coco at maltedmedia.com
> https://pairlist5.pair.net/mailman/listinfo/coco



More information about the Coco mailing list