Apache Nutch

Nutch is a well matured, production ready Web crawler. Nutch 1.x enables fine grained configuration, relying on Apache Hadoop™ data structures, which are great for batch processing....
Language(s): Java
Operating system(s): Cross-platform
License: Apache License 2.0

HTTrack

HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility. It allows you to download a World Wide Web site from the Internet to a local directory, building recursively al...
Language(s): C
Operating system(s): Microsoft Windows, Mac OS X, GNU, GNU/Linux, FreeBSD and Android
License: GNU General Public License Version 3