Html Agility Pack - Knowledge Base (KB)
17 results in tag: screen-scraping
Using C# to create clean HTML
How do I repair malformed HTML using C#? A great answer would be an HTML Agility Pack sample!...I'm scraping a site (for legitimate use). The site's HTML is OK but there are some annoying problems....One way I could go would be through regular expressions...
asked by Avi
Using HTMLAgilityPack, select all p>s from a Node's children.
I've got the following code that I'm using to get a html page. Make the urls absolute and then make the links rel nofollow and open in a new window/tab. My issue is around the adding of the attributes to the ...<a>...s.... string url = "http://www....
asked by Denis Hoctor
What is the best way to utilize HTMLAgilityPack AppendNode?
Got a real headache at this stage on a Friday! I'm trying to add a HtmlNode to another using InsertAfter(). I can see the refChild node with id of breadcrumbs when I rpint it to the console but keep getting the following error:...System.ArgumentOutOfRange...
asked by Denis Hoctor
Screen Scraping XPATH in HTML Agility Pack isn't delivering data.
I'm attempting to write a screen scraper for Digikey that will allow our company to keep accurate track of pricing, part availability and product replacements when a part is discontinued. There seems to be a discrepancy between the XPATH that I'm seeing ...
asked by Matthias
Using an HTML Agility Pack, how can I obtain all material inside a td> tag?
So I'm writing an application that will do a little screen scraping. I'm using the ...HTML Agility Pack... to load an entire HTML page into an instance of ...HtmlDocoument... called ...doc.... Now I want to parse that doc, looking for this:...<table borde...
asked by Bob Dylan
Get hyperlinks from a website into a textbox (VB.NET + HTML agility bundle)
Im making a vb.net app and im using htmlagilitypack. I need hap to get the profile links from yellowpages.ca...Here is an example of the html:...<a href="/bus/Ontario/Brampton/A-Safe-Self-Storage/17142.html?what=af&where=Ontario&le=1238793c7aa%7Cc...
asked by Infodayne
Use of the Advanced HTML Agility Pack
I am pretty new to the HTML Agility Pack so I need some help with where to go next. I can do some simple things like pull a value from an href (knowing the url string I was looking for) and I can pull like the value in a span based on a specific class tha...
asked by WildBill
How can I use html agility to grab everything between <b> and <br>
I poorly asked about this same project last week and didn't receive any suggestions. I will try to be more clear. I am trying to work with data from the website ...www.gtin13.com.... For example if you enter peanut butter into the search, I am trying to ...
asked by JRB
Wildcards and Xpath
I have tried several combinations without success. The full xpath to that data is ....//*[@id='detail_row_seek_37878']/td... The problem is the number portion '37878' changes for each node and thus I can't use a foreach to loop through the nodes. Is th...
asked by JRB
Is it possible to use a wildcard or a string that "contains" in a switch case? caution: lengthy
Being new to programming I read a lot of sample code and try to hack things together in an attempt to learn what works. I am working with html agility pack trying to scrap a news webpage. ...Problem: One of the nodes that I am testing does not use a stati...
asked by JRB
Scrape data from a wiki page in C# (screen-scraping)
I want to scrape a Wiki page. Specifically, ...this one....My app will allow users to enter the registration number of the vehicle (for example, SBS8988Z) and it will display the related information (which is on the page itself)....For example, if the use...
asked by ryanswj
Grab data from an HTML table using HtmlAgilityPack.
My program uses HtmlAgilityPack and grabs a HTML web page, stores it in a variable and I'm trying to get from the HTML two tables which are under specific Div Class tags (boardcontainer). With my current code it searches through the whole web page for eve...
asked by Joe Chatterton
Using HtmlAgilityPack to parse dl
This is the sample HTML I am trying to parse with Html Agility Pack in ASP.Net (C#)....<div class="content-div"> <dl> <dt> <b><a href="1.html" title="1">1</a></b> </dt> <dd> First Entry</dd> <dt> ...
asked by redGREENblue
How to use htmlagilitypack to scrape an xml file
I need to scrape an xml file from ...http://feeds.feedburner.com/Torrentfreak... for its links and description....I used this code :... var webGet = new HtmlWeb(); var document = webGet.Load("http://feeds.feedburner.com/TechCrunch"); ...
asked by CracLock
Select a node with a certain text value using htmlagilitypack
So I'm aware of how to select a node using htmlagilitypack:...HtmlNode.SelectNodes(".//div[@class='description']") ...etc... but say I have a site set up in the following way:...<a href="/link1/">This is Link 1</a> <a href="/link2/">This is information i ...
asked by gfppaste
How do i Screen scrap html page generated by javascript
How do i screen scrap a html page generated by javascript? Ive tried something like this: ... HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument(); HtmlWeb hw = new HtmlWeb(); doc = hw.Load("http://stats.nba.com/sc...
asked by Daniel Gustafsson
HTMLAgility Pack: Screen Scraping Unable to Find a Div with Hyphen in Class Name?
This is kind of a learning exercise but part 'fun' as well. Basically, I am trying to parse the price of a 'Balcony' state room's price (currently at $1039) in a C# console application. The url is:...http://www.carnival.com/BookingEngine/Stateroom/Statero...
asked by IrfanClemson
Page 1 of 1