Web Page Scraping

  • Thread starter Thread starter DIOS
  • Start date Start date
D

DIOS

Im using VB2005 to hit a webpage and then scrape certain data off the
webpage. The data exits in a table and is pretty well behaved, in
other words the type and columns do not change too often. Anyway, is
there a good tutorial or link that I can look at to get started. I
have some experience with doing this with VB6 but thought maybe
in .NET the methods have changed.

thanks
AGP
 
Here is a very simple example I have created to do this:


Partial Public Class ScreenScraper : Inherits System.Web.UI.Page
Protected Sub btnGetSource_Click(ByVal sender As System.Object, ByVal e As
System.EventArgs) Handles btnGetSource.Click
Dim source As New System.Net.WebClient()
Dim utf8 As New System.Text.UTF8Encoding()
lblSource.Text = utf8.GetString(source.DownloadData(txtSourcePath.Text))
End Sub
End Class


Hopefully this helps!
 
Back
Top