Public/website-downloader
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
静态网站资源下载
3 Commits 1 Branch 0 Tags 85 KiB
JavaScript 47.4%
Handlebars 27.9%
CSS 24.7%
main
Go to file
liushuang c185e6fe5d 添加ico
2024-09-03 15:33:52 +08:00
archiver init 2024-08-13 11:43:25 +08:00
bin init 2024-08-13 11:45:11 +08:00
public 添加ico 2024-09-03 15:33:52 +08:00
routes init 2024-08-13 11:43:25 +08:00
socket init 2024-08-13 11:43:25 +08:00
views 添加ico 2024-09-03 15:33:52 +08:00
wget init 2024-08-13 11:43:25 +08:00
.gitignore init 2024-08-13 11:43:25 +08:00
app.js init 2024-08-13 11:43:25 +08:00
app.json init 2024-08-13 11:43:25 +08:00
LICENSE.md init 2024-08-13 11:43:25 +08:00
package-lock.json init 2024-08-13 11:43:25 +08:00
package.json init 2024-08-13 11:43:25 +08:00
README.md init 2024-08-13 11:45:11 +08:00

README.md

Website Downloader

Download the complete source code of any website (including all assets)

Description

Website downloader works with wget and archiver to download all websites assets and compress then sends it back to the user through socket channel

wget params the being used

wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://example.org

Explanation of the various flags:

  • --mirror – Makes (among other things) the download recursive.
  • --convert-links – convert all the links (also to stuff like CSS stylesheets) to relative, so it will be suitable for offline viewing.
  • --adjust-extension – Adds suitable extensions to filenames (html or css) depending on their content-type.
  • --page-requisites – Download things like CSS style-sheets and images required to properly display the page offline.
  • --no-parent – When recursing do not ascend to the parent directory. It useful for restricting the download to only a portion of the site

Run

  • $ npm install
  • $ npm start
  • http://localhost:3008/