[Coco] Site downloader help

[Rob Rosenbrock]

> On Jan 24, 2023, at 4:18 PM, Andrew via Coco <coco at maltedmedia.com> wrote:
> 
> I usually use a custom script I wrote for wget that will usually grab everything from a site - and sometimes a bit more. Then it does some post-cleanup, and a couple of other tidbits. It ain't perfect, but usually will get the job done (provided there ain't a rate-limiter monitor on the site that boots me off and bans my access - if I suspect such a thing, I'll put in a randomized grab and rate-limit to better simulate a human which will usually get around that - but takes forever to pull down a large site).

Yeah… I got banned from one site after I copied the url. JDownloader took it and before it could finish grabbing the directory of one page I lost access. I didn’t get one file. I had to go through the wayback machine as a workaround