LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 02-15-2008, 01:27 PM   #1
el_pajaro!
Member
 
Registered: Sep 2003
Location: Ecuador
Distribution: Debian, Ubuntu, Elastix
Posts: 183

Rep: Reputation: 30
Problems mirroring an asp website with wget


Hi all,

We are working on a security problem of an asp (iss server) website that is really bogus and vulnerable. But the site is really important so we need it to be up an running. The long term soluntion is to migrate the applicacion to a cms and be aware of the security problems.

The short term solution is to mirror the site to static html on a server running linux (CentOS). For this we want to use wget and we try the following:
Code:
wget --mirror --convert-links --backup-converted --html-extension -o logfile http://10.4.1.110:81/somedir
After downloading about 4 MB the download it get stuck on a specific file:
Code:
Falta la fecha de la última modificación -- marcas de tiempo apagadas.
--02:00:02--  http://10.4.1.110:81/xxxm/xxxx.asp?id=221
Reusing existing connection to 10.4.1.110:81.
Petición HTTP enviada, esperando respuesta... 200 OK
Longitud: 21264 (21K) [text/html]
Saving to: `10.4.1.110:81/xxxxx/xxxxx.asp?id=221.html'

    0K .......... ..........
And it would be a hours until the file is download. If the file is
page is downloded directly using
http://10.4.1.110:81/xxxxx/xxxx.asp?id=221

The file is downloaded with no problem. So my hypothesis is that the
MS Internet Informatation service is bloking me because wget is doing
to many http requests at the time that it may be seen as an DoS
attack. Is this reasoning right?

If it is right, how can I keeping mirrorin the files with wget and not
being seen as attacker? The other solution is to configure ISS, but i
gues this is no something you can help me on this list.

Hope you can help,

Last edited by el_pajaro!; 02-15-2008 at 02:00 PM.
 
Old 02-16-2008, 11:19 PM   #2
Micro420
Senior Member
 
Registered: Aug 2003
Location: Berkeley, CA
Distribution: Mac OS X Leopard 10.6.2, Windows 2003 Server/Vista/7/XP/2000/NT/98, Ubuntux64, CentOS4.8/5.4
Posts: 2,986

Rep: Reputation: 45
Is that file being in use? Is it locked? Can you stop the IIS service for awhile to mirror the files? Any Windows sharing or NTFS permissions blocking it?
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
wget through an authenticated website davee Linux - Networking 2 02-11-2009 04:57 AM
hosting asp.NET website on linux based server using Tomcat Apache harrybazeegar Linux - Server 3 06-02-2007 06:47 AM
wget mirroring issue - GET variables Freezy Linux - Networking 4 02-17-2006 06:31 PM
wget problem with mirroring Tinku Linux - General 3 01-15-2006 08:18 AM
Website mirroring software ? xull Linux - Software 2 02-09-2004 05:17 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 05:13 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration