How to mirror a reasonably large web site? \ VOGONS

How to mirror a reasonably large web site?

Topic actions

First post, by lucky7456969

Posted on 2016-05-03, 09:20

lucky7456969 Offline

Rank Oldbie

Rank: Oldbie
Posts: 641
Joined: 2009-09-10, 05:49

If the forum structure is this,
when you look at page 1,
the links for page 2 to page 10 and the last page are there
but not in between
How can I mirror this web site? winhttrack, wget.
But I don't know how to do that? Is winhttrack faster.
I cannot find any good info on the net..
Thanks
Jack

Reply 1 of 4, by laxdragon

Posted on 2016-05-03, 14:53

laxdragon Offline

Rank Member

Rank: Member
Posts: 396
Joined: 2004-10-22, 18:42
Location: Minneapolis, MN

It really depends on the website. If it uses js/ajax/json, then it won't mirror very well. But, for static websites. wget works well enough:

1wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://example.org

laxDRAGON.com | My Game Collection | My Computers | YouTube

Reply 2 of 4, by ratfink

Posted on 2016-05-03, 21:07

ratfink Offline

Rank Oldbie

Rank: Oldbie
Posts: 1650
Joined: 2006-05-09, 15:06

Httrack?

Reply 3 of 4, by Stiletto

Posted on 2016-05-03, 23:34

Stiletto Offline

Rank l33t++

Rank: l33t++
Posts: 5133
Joined: 2002-07-01, 21:57

Jack, you always show up with the weirdest questions. Why is that? 😀

"I see a little silhouette-o of a man, Scaramouche, Scaramouche, will you
do the Fandango!" - Queen

Stiletto

Reply 4 of 4, by leileilol

Posted on 2016-05-03, 23:59

leileilol Offline

Rank l33t++

Rank: l33t++
Posts: 11835
Joined: 2006-12-16, 18:03

IIRC He is stuck in China and the google doesn't work.

long live PCem

Go to top of page Go to top of page

Back to Milliways