HtmlAgilityPack C#--- Selectnodes Always returns a Null

c# html-agility-pack html-parsing xpath

Question

This is the xpath text i tried to use along with HtmlAgilityPack C# parser.

//div[@id = 'sc1']/table/tbody/tr/td/span[@class='blacktxt']

I tried to evaluate the xpath expression with firefox xpath add=on and sucessfully got the required items. But the c# code returns an Null exception.

HtmlAgilityPack.HtmlNodeCollection node = htmldoc.DocumentNode.SelectNodes("//div[@id ='sc1']/table/tbody/tr/td/span[@class='blacktxt']");            
MessageBox.Show(node.ToString());

the node always contains null value... Please help me to find the way to get around this problem... Thank you..

1
0
8/4/2013 3:09:09 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Popular Answer

DOM Requires <tbody/> Tags to be Inserted

All common browser extensions for building XPath expressions work on the DOM. Opposite to the HTML specs, the DOM specs require <tr/> elements to be inside <tbody/> elements, so browsers add such elements if missing. You can easily see the difference if looking at the HTML source using Firebug (or similar developer tools working on the DOM) versus displaying the page source (using wget or similar tools that do not interpret anything if necessary).

The Solution

Remove the /tbody axis step, and your XPath expression will probably work.

//div[@id = 'sc1']/table/tr/td/span[@class='blacktxt']

If you Need to Support Both HTML With and Without <tbody/> Tags

For a more general solution, you could replace the /tbody axis step by a decendant-or-self step //, but this could jump into "inner tables":

//div[@id = 'sc1']/table//tr/td/span[@class='blacktxt']

Better would be to use alternative XPath expressions:

//div[@id = 'sc1']/table/tr/td/span[@class='blacktxt'] | //div[@id = 'sc1']/table/tbody/tr/td/span[@class='blacktxt']

A cleaner XPath 2.0 only solution would be

//div[@id = 'sc1']/table/(tbody, self::*)/tr/td/span[@class='blacktxt']
0
8/4/2013 9:04:43 PM

Related Questions

DocumentNode in HtmlAgilityPack. Shouldn't SelectNodes return null?

According to the upstream bug comments it is for consistency:...DarthObiwan wrote Jan 11 2011 at 9:27 PM...This has been covered before, this function is written to mimic the way the System.XML works. Doing so will cause a major breaking change and thus will probably be slated for 2.0...http://htmlagilitypack.codeplex.com/workitem/29175...http://ht...
asp.net c# html-agility-pack parsing xpath
asked by Tim Abell

C# HTML Agility Pack Single Select Node returning null

try below...var varitem = doc.DocumentNode.SelectSingleNode("//h1[@class='producttitle']"); ...SelectSingleNode... can return null and also you better check whether ...InnerText... also not null or empty as well...if (varitem == null || string.IsNullOrEmpty(varitem.InnerText)) MessageBox.Show("no titles");
c# html-agility-pack web-scraping winforms
asked by Damith

Return null in HtmlAgilityPack

The ...DocumentNode.SelectNodes... could return null if no nodes are not found....You may check this related ...Why DocumentNode.SelectNodes returns null
c# html-agility-pack
asked by Rahul Tripathi

HtmlAgilityPack HtmlNodeCollection returning NULL , shouldn't

try this replace "*" , "div" ..."/html/body//div[@id='comments-view']/ul[1]/li[1]/a/span/span/span/span/img"
c# html-agility-pack xpath
asked by Gökhan Eryiğit

Html Agility Pack selectnodes returns null

Try doing: ...p = doc.DocumentNode.SelectNodes(".//p"); ...instead of: ...p = doc.DocumentNode.SelectNodes("//p"); ...since ...p... is a type of tag, not a class or id.
c# html-agility-pack html-parsing
asked by Abob

Chrome copy XPath returning null when using HtmlAgilityPack

There is no ...<tbody/>... element in that table, remove the .../tbody... axis step and your query works totally fine. See "...Why does my XPath query (scraping HTML tables) only work in Firebug, but not the application I'm developing?..." for details....Additional hint: XPath also supports single quotes for strings, so you don't need to escape the...
c# html-agility-pack xpath
asked by Jens Erat

DocumentElement.SelectNodes returns null (Html Agility Pack)

As you dont have any tr's table rows in your HTML the agility pack is not finding any... try this // Get all tables in the document HtmlNodeCollection tables = doc.DocumentNode.SelectNodes("//table"); // Iterate all rows in the first table HtmlNodeCollection rows = tables[0].SelectNodes(".//tr"); ...
c# html-agility-pack
asked by saj

C# HtmlAgilityPack HtmlNodeCollection SelectNodes not working

SelectNodes returns null when nothing has been found....You think your XPATH is ok because you used a browser's (Chrome, Firefox, etc.) constructed XPATH, but unfortunately, this XPATH is not exactly the same as the one you got from the network (or a file, or a raw stream)....Browsers rely on the in-memory DOM they use internally which can be drama...
c# html html-agility-pack selectnodes xpath
asked by Simon Mourier

HTMLAgilityPack Selectnodes always returns null

To load a file you should use ...Load... method.. ...LoadHtml... is used for strings containing html...doc.Load("htmldoc.html");
.net c# html html-agility-pack
asked by L.B

htmlagilitypack select nodes return null

Table rows are not direct descendants of the table but they are nested into other tags and that's why your code was returning null. Also you want to skip the header and scrape only the body of the table....var query = doc.DocumentNode .SelectNodes("//table[@class='table table-striped table-hover']/tbody/tr") .Select(r => { retur...
c# html-agility-pack linq select
asked by derloopkat

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow