无需浏览器即可保存网页的全部内容

时间:2014-09-07 07:42:03

标签: .net vb.net webpage

我一直在使用以下代码在没有浏览器的情况下下载网页。问题是,当您将页面保存为完整时,它不会保存Firefox之类的所有代码。 Internet Explorer既不保存所有代码,也不保存Web客户端。我已经使用过Gecko和XULRunner但是我一直都会遇到错误,它会为你的项目增加20-40 MB。 Firefox保存的网页大约为55KB。 Internet Explorer(应用程序和Web控件)以24KB的速度保存完整页面。源代码遗漏了很多代码。使用下面的代码,他们无论如何都要保存网页的全部内容?也许是通过标题?

    Try
        Dim wrWebRequest As HttpWebRequest = CType(WebRequest.Create("http://websta.me/p/799354489959753224_22167696"), HttpWebRequest)
        wrWebRequest.Timeout = 30000
        wrWebRequest.UserAgent = "Mozilla/5.0"
        Dim wrWebResponse As HttpWebResponse = CType(wrWebRequest.GetResponse(), HttpWebResponse)
        Dim strStream As Stream = wrWebResponse.GetResponseStream()
        Dim bytBuffer(65536) As Byte
        Dim intBytesToRead As Integer = CInt(bytBuffer.Length)
        Dim intBytesRead As Integer = 0
        While intBytesToRead > 0
            Dim intNumber As Integer = strStream.Read(bytBuffer, intBytesRead, intBytesToRead)
            If intNumber = 0 Then
                Exit While
            End If
            intBytesRead += intNumber
            intBytesToRead -= intNumber
        End While
        strStream.Close()

        Dim fsFileStream As New FileStream(Application.StartupPath & "\" & "Data.dat", FileMode.Create, FileAccess.Write, FileShare.None)
        fsFileStream.Write(bytBuffer, 0, intBytesRead)
        fsFileStream.Close()
    Catch ex As Exception
        MessageBox.Show(ex.Message)
    End Try

0 个答案:

没有答案
相关问题