get all td in XPath c#

c# html html-agility-pack xpath

Question

I am trying to parse HTML using HtmlAgilityPack in C#. I have 21 tr items and each tr items have 7 td items. How can I get all tr and td items in order? Now I can get only one tr item and its 7 td items.

Here is my C# Code:

var url = "url";
            HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
            HttpWebResponse response = (HttpWebResponse)request.GetResponse();
            StreamReader sr = new StreamReader(response.GetResponseStream());
            string sourceCode = sr.ReadToEnd();

            HtmlAgilityPack.HtmlDocument document = new HtmlAgilityPack.HtmlDocument();
            document.LoadHtml(sourceCode);


            var name = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[2]/a[1]")[0].InnerText;
            var year = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[3]")[0].InnerText;
            var km = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[4]")[0].InnerText;
            var color = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[5]")[0].InnerText;
           var price = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[6]")[0].InnerText;
            var date = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[7]")[0].InnerText;
            var location = document.DocumentNode.SelectNodes("//*[@id=\"searchResultsTable\"]/tbody/tr[1]/td[8]")[0].InnerText;

I tried to use [@id=\"searchResultsTable\"]/tbody/tr[1]/td[position()<8] but is returns only /n

Accepted Answer

Try below code (not tested. Chances of compile errors. But gives you an Idea.)

Comments in the code gives you more details.

//GET THE TABLE NODE
HtmlNode table = document.DocumentNode.SelectSingleNode("//*[@id='searchResultsTable']");

//LOOP THROUGH THE TABLE NODE AND FIND EACH TR 
foreach (HtmlNode row in table.SelectNodes("//tr")) {

      //PRINT HERE WHATEVER YOU WANT FOR EACH ROW.
      Console.WriteLine("New Row");

      //LOOP THROUGH THE ALL TD OF EACH TR
      foreach (HtmlNode cell in row.SelectNodes("//td")) {
          //PRINT HERE EACH TD
          Console.WriteLine("cell: " + cell.InnerText);
      } //END TD

}//END TR

Popular Answer

Similar to what's been mentioned, query with a selector to loop on tr elements then select your fixed position td nodes per row:

Assuming a structure like the following:

<table id="searchResultsTable">
<tbody>
<tr>
    <td>1</td>
    <td>Name<a>Name 1</a></td>
    <td>Year 1</td>
    <td>KM 1</td>
    <td>Color 1</td>
    <td>Price 1</td>
    <td>Date 1</td>
    <td>Location 1</td>
</tr>
<tr>
    <td>2</td>
    <td>Name<a>Name 2</a></td>
    <td>Year 2</td>
    <td>KM 2</td>
    <td>Color 2</td>
    <td>Price 2</td>
    <td>Date 2</td>
    <td>Location 2</td>
</tr>
</tbody>

Example:

var document = new HtmlDocument();
document.Load("example.html");

var rows = document.DocumentNode.SelectNodes("//*[@id='searchResultsTable']/tbody/tr");

foreach(var row in rows)
{
    var name = row.SelectSingleNode("td[2]/a[1]").InnerText;
    var year = row.SelectSingleNode("td[3]").InnerText;
    var km = row.SelectSingleNode("td[4]").InnerText;
    var color = row.SelectSingleNode("td[5]").InnerText;
    var price = row.SelectSingleNode("td[6]").InnerText;
    var date = row.SelectSingleNode("td[7]").InnerText;
    var location = row.SelectSingleNode("td[8]").InnerText;

    Console.WriteLine("{0}, {1}, {2}, {3}, {4}, {5}, {6}", name, year, km, color, price, date, location);
}

Produces:

Name 1, Year 1, KM 1, Color 1, Price 1, Date 1, Location 1
Name 2, Year 2, KM 2, Color 2, Price 2, Date 2, Location 2


Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Is this KB legal? Yes, learn why
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Is this KB legal? Yes, learn why