Does anyone know a website downloader that works?

dj11k

I have used my friend google and the search engine on sanet trying to find something that will download either of the two (identical in content) websites so that I can access them offline. I remember long in the past that I was able to download other websites with something, but all of the programs online/offline which purport to do it now fail. Most of them report some kind of error message, others just output junk. It seems to be a very simple website only 2 layers deep and no protection (just an archive of an old newspaper column), but after spending many hours trying to find something that would work, I have given up.
If there is someone in the sanet community who has experience with this sort of thing, please recommend a program (standalone or online) that can do the job. Many thanks in advance!
[Login to see the link]
which seems to be equivalent to
[Login to see the link]

planetlife

dj11k You can use the following downloaders:
1.Cyotek Website Copy
2.Httrack
3.Offline Explorer Pro

Ferdyfred004

dj11k this one download in single html file for offline use case
[Login to see the link]

MIZANing

dj11k
Here are 6 Free Tools To Download Entire Websites:
[Login to see the link]

PS. Some of these are listed by [Login to see the link], and I myself used HTTrack over a decade ago. I remember using it in 2012 to download a website, which required me to leave my PC running non-stop for three days. In the end, the total folder size was about 10 GB.

I hope this help🙂

myaddibqizac

dj11k I had a good experience with Metaproducts Offline Browser (thanks to sanet for the demo version, 😉 ), so I can only recommend it. I tried HTTrack and other console-based, but I found their interface less friendly and couldn't grasp them.

Maybe you can use this software comparison table and you can choose what suits you:
docs.google.com/spreadsheets/d/1FqxwaZnIhhQ7jDCC-W64NMRf5rDeh2Shx3u01MsBmTQ/
Author of the table:
[Login to see the link]

P.S. The table was able to embed into my answer even with navigation on it, but I don't know if that's right, so I decided to fix the link so it wouldn't automatically load the Google table into my message. If this is wrong, let the moderators correct it and return the https: prefix.

suresheka

You can use IDM's (Internet Download Manger) Site grabber
Tasks -> Run site grabber

taztoon

MetaProducts Offline Explorer, you can copy the downloaded Websites directly to your hard drive or to other external media.

abluesboy

been down this road > hyperlinks make it next to impossible .

sparkly

I posted a few ways to do this here (scroll down, it's one of the last comments):
https://sanet.st/community/d/23039-how-do-you-get-around-html-documents-for-udemy-courses/13
I haven't tried these methods myself, but it might give you some ideas

spiderman1369

wget

adiadi

Chrome extension web scraper

AndySu90210

MIZANing any idea how to protect a website from a downloader? i.e protecting from IDM's (Internet Download Manger) Site grabber?

MIZANing

AndySu90210
No, I'm sorry [Login to see the link], However, I believe [Login to see the link], who is very talented in computer science, might be able to assist you.
You can send him a message (PM) or start a new thread where all those who have experience in website protection can share it.

stefcab

AndySu90210

It seems impossible.
What we can see in the browser are the html document rendered from the server, and the javascript files, css files and images linked to the html page and cookies. So perhaps you could transform your javascript code to be almost unreadable, but all the element the public is seing (html pages, images, css, javascript) are "public", so easy to download.

Only the html code (front end), css, javascript files created with PHP, Node.js, Python, Java, GOlang, Ruby , could be downloaded, and not from those back-end languages.

choquehuanca

AndySu90210
Put captchas on your pages.

MediaFanatic

I believe this is the third version of this thread we've discussed in the past few months.

The consensus is that there are no good crawler/offline-archivers that properly rip sites, particularly when proprietary logins, or async JS are implemented.

As fas as countermeasures that limit others' ability to scrape your website, there are dozens of different options. I'm still traveling and it's difficult for me to go into details but I'll be happy to write a comprehensive explanation when I return home 🙂

djpj

I think SiteSucker Pro can be useful if you're using a Mac computer. Here's the sanet link:

[Login to see the link]

Best of luck!

thebuzzard

You didn't clarify if you are a Windows or Mac user, so if you are a macOS user, SiteSucker is a particularly simple app to automatically download an entire site with all its components: [Login to see the link]

spooky2k6

you can use firefox browser, load the webpage you want, then click File...Save page as.... and it will download the webpage you want. i use it for all my guides/information sites. i can then just double click the main.html/htm file an voila its there. If your after grabbing a website thats many many pages deep, then i dont know if it will work for that(just test it an see) i use it all the time an its worked fine for me so far....Good Luck =0)

cacarot

some programs that I know:
[Login to see the link]
[Login to see the link]
[Login to see the link]
[Login to see the link]
[Login to see the link]