Using HtmlAgilityPack to get a specific row and column data

c# html-agility-pack xml-parsing xpath

Question

This is my table 

<table class="DataRows" frame="myFrames" rules="Standard" width="100%">

  <colgroup><col width="70" align="CENTER">
  <col width="200" align="LEFT">
  <col width="80" align="LEFT">
  <col align="LEFT">
  <col align="RIGHT">

  </colgroup><thead>

  <col width="70" align="CENTER">
  <col width="200" align="LEFT">
  <col width="80" align="LEFT">
  <col align="LEFT">
  <col align="RIGHT">

  <thead>

  <tr>
    <td valign="TOP"><span class="classicBold"> 20 </span> Kg.
    <td class="BOLD" valign="TOP" nowrap="">
      PA Passion Foods Inc.
    <td class="BOLD">Fax:
    <td>
      222-555666
    <td class="BOLD">
      Processed foods and juices

  <tr>
    <td><a target="_blank" href="">See on Map </a>
    <td>
      120 NW 157TH AVE 
    <td class="BOLD">Warehouse Hours:
    <td colspan="2">


  <tr>
    <td>
    <td><span class="BOLD">
      Jacksonville,
      </span>
      FL 300000
    <td class="BOLD">Url:
    <td colspan="2">
      <a target="_blank" href="">PA Passion</a>
      &nbsp&nbsp
      <span class="BOLD">E-mail:</span>
      zoro@xyz.com

  <tr>
    <td>
    <td class="REDBOLD" colspan="4">


  <tr>
    <td>
    <td colspan="4" align="LEFT">Franchisee for:<span class="BOLD">
 Nutrella


</span>
  <tr>
    <td>
    <td colspan="4" align="LEFT">Franchisee for:<span class="BOLD">
APPLE Foods, Constants
</span>
  <tr>
    <td>
    <td colspan="4" align="LEFT"><span class="BOLD">

</span>

  <tr>
    <td>
    <td colspan="4" align="LEFT">We service:<span class="BOLD">
All occasions and hospitality services
</span>

  <tr>
    <td>
    <td colspan="4" align="LEFT">We sell :<span class="BOLD">
----
</span>

</td></td></tr></td></td></tr></td></td></tr></td></td></tr></td></td></tr></td></td></tr></td></td></td></td></tr></td></td></td></td></tr></td></td></td></td></td></tr>
  </thead>
</table>

I am looping through each node in my Html document using the code below

foreach (HtmlNode node in htmlAgilityPackDoc.DocumentNode.SelectNodes("//table[contains(@class,'DataRows')]"))
{

}

When I use the following 

node.SelectSingleNode(".//tr[1]/td[1]").InnerHtml

I get the following html

<span class="classicBold"> 20 </span> Kg.
        <td class="BOLD" valign="TOP" nowrap="">
          PA Passion Foods Inc.
        <td class="BOLD">Fax:
        <td>
          222-555666
        <td class="BOLD">
          Processed foods and juices

      <tr>
        <td><a target="_blank" href="">See on Map </a>
        <td>
          120 NW 157TH AVE 
        <td class="BOLD">Warehouse Hours:
        <td colspan="2">


      <tr>
        <td>
        <td><span class="BOLD">
          Jacksonville,
          </span>
          FL 300000
        <td class="BOLD">Url:
        <td colspan="2">
          <a target="_blank" href="">PA Passion</a>
          &nbsp&nbsp
          <span class="BOLD">E-mail:</span>
          zoro@xyz.com

      <tr>
        <td>
        <td class="REDBOLD" colspan="4">


      <tr>
        <td>
        <td colspan="4" align="LEFT">Franchisee for:<span class="BOLD">
     Nutrella


    </span>
      <tr>
        <td>
        <td colspan="4" align="LEFT">Franchisee for:<span class="BOLD">
    APPLE Foods, Constants
    </span>
      <tr>
        <td>
        <td colspan="4" align="LEFT"><span class="BOLD">

    </span>

      <tr>
        <td>
        <td colspan="4" align="LEFT">We service:<span class="BOLD">
    All occasions and hospitality services
    </span>

      <tr>
        <td>
        <td colspan="4" align="LEFT">We sell :<span class="BOLD">
    ----
    </span>

    </td></td></tr></td></td></tr></td></td></tr></td></td></tr></td></td></tr></td></td></tr></td></td></td></td></tr></td></td></td></td></tr></td></td></td></td></td>

How do I extract the address 120 NW 157TH AVE from this ?

When I tried using 

node.SelectSingleNode(".//td[@class='BOLD'][4]/preceding-sibling::td").InnerText;

I get an error:

Object reference not set to an instance of an object

1
0
3/19/2015 12:57:34 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Accepted Answer

Your html is a mess tags are overlapping i suggest you use text nodes as your identifiers rather than indices for example

.//td[./a[contains(text(),'See on Map')]]/td/text()

to get

120 NW 157TH AVE

Here is a full example that gets you everything

    var table = doc.DocumentNode.SelectSingleNode("//table[contains(@class,'DataRows')]");

    var name = table.SelectSingleNode(".//td[@class='BOLD']/text()").InnerText.Trim();
    var fax = table.SelectSingleNode(".//td[contains(text(),'Fax')]/td/text()").InnerText.Trim();
    var email = table.SelectSingleNode(".//span[contains(text(),'E-mail')]/following-sibling::text()").InnerText.Trim();
    var address = table.SelectSingleNode(".//td[./a[contains(text(),'See on Map')]]/td/text()").InnerText.Trim();
    var city = table.SelectSingleNode(".//tr[./td/a[contains(text(),'See on Map')]]//tr/td/td/span").InnerText.Trim(',');
    var zip = table.SelectSingleNode(".//tr[./td/a[contains(text(),'See on Map')]]//tr/td/td/span/following-sibling::text()").InnerText.Trim();

Note because of how messy your html is the xpaths has to be as messy, trying to access the tr element by index won't work because all tr elements are children of the previous tr, what is .//tr[4] in a normal table is .//tr/tr/tr/tr in your table.

1
3/20/2015 6:07:14 AM

Related Questions

In VB.Net, use HtmlAgilityPack to check whether an element contains a certain attribute.

I'm using HtmlAgilityPack to parse HTML....I want to check if an element has a specific attribute....I want to check whether an ...<a>... tag has the ...href... attribute....Dim doc As HtmlDocument = New HtmlDocument() doc.Load(New StringReader(content)) Dim root As HtmlNode = doc.DocumentNode Dim anchorTags As New List(Of String) For Each link ...
html-agility-pack html-parsing vb.net
asked by PeeHaa

To identify all elements with innertext containing a certain phrase or words, use Xpath and HtmlAgilityPack.

Use...:...//*[text()[contains(., 'Mr T')]] ...This selects all elements in the XML document that have a text-node child which contains the string ...'Mr T'.......This can also be written shorter as...:...//text()[contains(., 'Mr T')]/.. ...This selects the parent(s) of any text node that contains the string ...'Mr T'....
html-agility-pack xpath
asked by Dimitre Novatchev

Using HTMLAgilityPack Extract text, which is not between tags and comes after specific node

HTML code:... <b> CAR </b> <br></br> Car is something you can drive. <br></br> <br></br> ...C# code:... HtmlAgilityPack.HtmlDocument doc = new HtmlWeb().Load("http://website.com/x.html"); if (doc != null) { HtmlNode link = doc.DocumentNode.SelectSingleNode("//b[contains(text(), 'CAR')]"); ...
c# html html-agility-pack web-scraping xpath
asked by GiedriusK

How Can I Find a Specific Node By Using SelectSingleNode From HtmlAgilityPack

Using the HtmlAgilityPack I am trying to obtain the text "9/30/2013" from a node on this website: ...http://www.nasdaq.com/symbol/goog/financials?query=income-statement&data=quarterly...Here is the HTML from the website ...<div id="financials-iframe-wrap"> <br> <div class="nextgen thin"> <div class="table-headtag"> <div style="float:left;"> <h3 sty...
html-agility-pack html-parsing selectsinglenode vb.net
asked by gromit1

Having problems with inserting node in a specific order using HTMLAgilityPack

I am once again lost with HTMLAgility....Here is the HTML string I am working with:...<table>...</table> ...I am trying to correct this by adding:...<html> <head> ... </head> <body> <table> ... </table> </body> </html> ...Here is my code, I am able to get everything except the body. Any advise?...HtmlNode htmlNode =...
asp.net-mvc-4 c# html-agility-pack nodes
asked by Rick

How to get count of parent row nodes from a html using HtmlAgilityPack

Below is my html page:...Using Html Agility Pack, i need to get the Main Table Main Rows. Means in the below page, Only One Main Table and Only 3 Main Rows Under the Main table....I need to get the count of 3, excluding all inner TR....Please help....HTML :... <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xht...
c# html-agility-pack
asked by SPN

HtmlAgilityPack method for returning value from a row in a table given column data

I want to use Html Agility pack to extract inner html info based on it's relative distance from other td's within a given row in a table....For example in the code below what would be an efficient dynamic command that would take the data in the first td tag as an input and give the data in the third td tag as an output:...<tbody> <tr> <...
c# html-agility-pack
asked by Sperick

Using HtmlAgilityPack to get specific data in C# and serialize it to json

I've downloaded an html source code and I'm trying to get some data out of it to serialize it to a "json" file. ...This is the html source file: ...https://drive.google.com/file/d/0BzweTZsfeoxMTWk2LVdnYTJMRUE/view?usp=sharing...In the html code there are "2" groups that I wish to collect data from....At the moment I managed to get the code inside t...
c# html html-agility-pack json visual-studio
asked by Jose Cancel

Count rows and columns in Html Table having subtables using HtmlAgilityPack

I'm parsing an Html table and I need the columns and rows count....I tryed using:...ColNum = mTables(1).SelectNodes(".//th").Count RowNum = mTables(1).SelectNodes(".//tr").Count ...But I get a wrong results if table has one or more subtables....Here's a sample of html table I need to parse:...<table border='1'> <tbody> <tr><th>Some Text...
html-agility-pack html-table vb.net
asked by genespos

Get specific data from a webpage with HTMLAgilityPack

I've been trying to get data from a webpage in C# using the HTML Agility Pack. I have been able to retrieve data from different webpage, but on this webpage I am getting a ...NullReferenceException... and my only guess is that it has something to do with the XPath....Here is my code, trying to reach the 'Limbo Wand' text...string url = "https://ww...
c# html-agility-pack xpath
asked by Hyarantar

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow