How to mirror a reasonably large web site? \ VOGONS

How to mirror a reasonably large web site?

Topic actions

Post a reply

First post, by lucky7456969

Posted on 2016-05-03, 09:20

lucky7456969 Offline

Rank Oldbie

Rank: Oldbie
Posts: 641
Joined: 2009-09-10, 05:49

If the forum structure is this,
when you look at page 1,
the links for page 2 to page 10 and the last page are there
but not in between
How can I mirror this web site? winhttrack, wget.
But I don't know how to do that? Is winhttrack faster.
I cannot find any good info on the net..
Thanks
Jack

Reply 1 of 4, by laxdragon

Posted on 2016-05-03, 14:53

laxdragon Offline

Rank Member

Rank: Member
Posts: 396
Joined: 2004-10-22, 18:42
Location: Minneapolis, MN

It really depends on the website. If it uses js/ajax/json, then it won't mirror very well. But, for static websites. wget works well enough:

1wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://example.org

laxDRAGON.com | My Game Collection | My Computers | YouTube

Reply 2 of 4, by ratfink

Posted on 2016-05-03, 21:07

ratfink Offline

Rank Oldbie

Rank: Oldbie
Posts: 1643
Joined: 2006-05-09, 15:06

Httrack?

Reply 3 of 4, by Stiletto

Posted on 2016-05-03, 23:34

Stiletto Offline

Rank l33t++

Rank: l33t++
Posts: 5133
Joined: 2002-07-01, 21:57

Jack, you always show up with the weirdest questions. Why is that? 😀

"I see a little silhouette-o of a man, Scaramouche, Scaramouche, will you
do the Fandango!" - Queen

Stiletto

Reply 4 of 4, by leileilol

Posted on 2016-05-03, 23:59

leileilol Offline

Rank l33t++

Rank: l33t++
Posts: 11774
Joined: 2006-12-16, 18:03

IIRC He is stuck in China and the google doesn't work.

long live PCem

Go to top of page Go to top of page

Back to Milliways

Main menu

Common searches