41.7 Wget Multiple Files Repeatedly

20210211

This script will download a collection of PDF documents, continuing from where we got up to previously if the process was interrupted and so only downloading files that have changed on the server (-c), placing the downloaded files into the a specific folder (-P), and identifying the agent as a browser (-U):

for f in 4925 4844 4761 4737 4704; do
  wget -c -P downloads \
       -U "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" \
       https://example.com/pdf/$f.pdf;
done

---

Your donation will support ongoing availability and give you access to the PDF version of this book. Desktop Survival Guides include Data Science, GNU/Linux, and MLHub. Books available on Amazon include Data Mining with Rattle and Essentials of Data Science. Popular open source software includes rattle, wajig, and mlhub. Hosted by Togaware, a pioneer of free and open source software since 1984. Copyright © 1995-2022 Graham.Williams@togaware.com Creative Commons Attribution-ShareAlike 4.0