Html Agility Pack - Knowledge Base (KB)
17 results in tag: screen-scraping
Clean HTML using C#
How do I repair malformed HTML using C#? A great answer would be an HTML Agility Pack sample!...I'm scraping a site (for legitimate use). The site's HTML is OK but there are some annoying problems....One way I could go would be through regular expressions...
asked by Avi
Select all <p>'s from a Node's children using HTMLAgilityPack
I've got the following code that I'm using to get a html page. Make the urls absolute and then make the links rel nofollow and open in a new window/tab. My issue is around the adding of the attributes to the ...<a>...s.... string url = "http://www....
asked by Denis Hoctor
How should I use HTMLAgilityPack AppendNode?
Got a real headache at this stage on a Friday! I'm trying to add a HtmlNode to another using InsertAfter(). I can see the refChild node with id of breadcrumbs when I rpint it to the console but keep getting the following error:...System.ArgumentOutOfRange...
asked by Denis Hoctor
HTML Agility Pack Screen Scraping XPATH isn't returning data
I'm attempting to write a screen scraper for Digikey that will allow our company to keep accurate track of pricing, part availability and product replacements when a part is discontinued. There seems to be a discrepancy between the XPATH that I'm seeing ...
asked by Matthias
How can I get all content within <td> tag using a HTML Agility Pack?
So I'm writing an application that will do a little screen scraping. I'm using the ...HTML Agility Pack... to load an entire HTML page into an instance of ...HtmlDocoument... called ...doc.... Now I want to parse that doc, looking for this:...<table borde...
asked by Bob Dylan
Get links from webpage to textbox (vb.net + html agility pack)
Im making a vb.net app and im using htmlagilitypack. I need hap to get the profile links from yellowpages.ca...Here is an example of the html:...<a href="/bus/Ontario/Brampton/A-Safe-Self-Storage/17142.html?what=af&where=Ontario&le=1238793c7aa%7Cc...
asked by Infodayne
Advanced HTML Agility Pack useage
I am pretty new to the HTML Agility Pack so I need some help with where to go next. I can do some simple things like pull a value from an href (knowing the url string I was looking for) and I can pull like the value in a span based on a specific class tha...
asked by WildBill
How can I use html agility to grab everything between <b> and <br>
I poorly asked about this same project last week and didn't receive any suggestions. I will try to be more clear. I am trying to work with data from the website ...www.gtin13.com.... For example if you enter peanut butter into the search, I am trying to ...
asked by JRB
Xpath and wildcards
I have tried several combinations without success. The full xpath to that data is ....//*[@id='detail_row_seek_37878']/td... The problem is the number portion '37878' changes for each node and thus I can't use a foreach to loop through the nodes. Is th...
asked by JRB
Can a wild card or string "contains" be used in a switch {case}? caution: wordy
Being new to programming I read a lot of sample code and try to hack things together in an attempt to learn what works. I am working with html agility pack trying to scrap a news webpage. ...Problem: One of the nodes that I am testing does not use a stati...
asked by JRB
C# Scrape data from wiki page (screen-scraping)
I want to scrape a Wiki page. Specifically, ...this one....My app will allow users to enter the registration number of the vehicle (for example, SBS8988Z) and it will display the related information (which is on the page itself)....For example, if the use...
asked by ryanswj
HtmlAgilityPack - Grab data from html table
My program uses HtmlAgilityPack and grabs a HTML web page, stores it in a variable and I'm trying to get from the HTML two tables which are under specific Div Class tags (boardcontainer). With my current code it searches through the whole web page for eve...
asked by Joe Chatterton
Parsing dl with HtmlAgilityPack
This is the sample HTML I am trying to parse with Html Agility Pack in ASP.Net (C#)....<div class="content-div"> <dl> <dt> <b><a href="1.html" title="1">1</a></b> </dt> <dd> First Entry</dd> <dt> ...
asked by redGREENblue
How to scrape xml file using htmlagilitypack
I need to scrape an xml file from ...http://feeds.feedburner.com/Torrentfreak... for its links and description....I used this code :... var webGet = new HtmlWeb(); var document = webGet.Load("http://feeds.feedburner.com/TechCrunch"); ...
asked by CracLock
Select a node with a certain text value using htmlagilitypack
So I'm aware of how to select a node using htmlagilitypack:...HtmlNode.SelectNodes(".//div[@class='description']") ...etc... but say I have a site set up in the following way:...<a href="/link1/">This is Link 1</a> <a href="/link2/">This is information i ...
asked by gfppaste
How do i Screen scrap html page generated by javascript
How do i screen scrap a html page generated by javascript? Ive tried something like this: ... HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument(); HtmlWeb hw = new HtmlWeb(); doc = hw.Load("http://stats.nba.com/sc...
asked by Daniel Gustafsson
HTMLAgility Pack: Screen Scraping Unable to Find a Div with Hyphen in Class Name?
This is kind of a learning exercise but part 'fun' as well. Basically, I am trying to parse the price of a 'Balcony' state room's price (currently at $1039) in a C# console application. The url is:...http://www.carnival.com/BookingEngine/Stateroom/Statero...
asked by IrfanClemson
Page 1 of 1