VB.NET & HtmlAgilityPack parse element attributes

html-agility-pack parsing vb.net

Question

I have HTML file like this

<html>
      <head>

    <title>Page Name in a Folder</title>
        <meta http-equiv="X-UA-Compatible" content="IE=edge"/>
    <meta http-equiv="content-type" content="text/html; charset=utf-8"/>
    <meta name="apple-mobile-web-app-capable" content="yes"/>
    <link href="resources/css/jquery-ui-themes.css" type="text/css" rel="stylesheet"/>
    <link href="resources/css/axure_rp_page.css" type="text/css" rel="stylesheet"/>
    <link href="data/styles.css" type="text/css" rel="stylesheet"/>
    <link href="files/page_name_in_a_folder/styles.css" type="text/css" rel="stylesheet"/>

  </head>
  <body>
    <div id="base" class="">

      <!-- Image Shape Name (Image) -->
      <div id="u0" class="ax_image" data-label="Image Shape Name">
        <img id="u0_img" class="img " src="images/page_name_not_in_a_folder/u0.png"/>
        <!-- Unnamed () -->
        <div id="u1" class="text">
          <p><span>&nbsp;</span></p>
        </div>
      </div>

      <!-- Heading 1 Shape Name (Shape) -->
      <div id="u2" class="ax_h1" data-label="Heading 1 Shape Name">
        <img id="u2_img" class="img " src="resources/images/transparent.gif"/>
        <!-- Unnamed () -->
        <div id="u3" class="text">
          <p><span>Heading 1</span></p>
        </div>
      </div>

      <!-- Heading 2 Shape Name (Shape) -->
      <div id="u4" class="ax_h2" data-label="Heading 2 Shape Name">
        <img id="u4_img" class="img " src="resources/images/transparent.gif"/>
        <!-- Unnamed () -->
        <div id="u5" class="text">
          <p><span>Heading 2</span></p>
        </div>
      </div>

      <!-- Label Shape Name (Shape) -->
      <div id="u6" class="ax_paragraph" data-label="Label Shape Name">
        <img id="u6_img" class="img " src="resources/images/transparent.gif"/>
        <!-- Unnamed () -->
        <div id="u7" class="text">
          <p><span>Label</span></p>
        </div>
      </div>



      <!-- Unnamed (HTML Button) -->
      <div id="u26" class="ax_html_button">
        <input id="u26_input" type="submit" value="Submit"/>
      </div>
    </div>
  </body>
</html>

And I need to extract all DIV's with its classes and attributes, eg:

  • Class name: (ax_html_button) extract value of the button = “Submit”
  • Class name: (ax_paragraph) extract value of the data-label = “Label Shape Name”

etc.

Tried with using HtmlAgilityPack:

Public Shared Sub parseAgility(fName As String)
        Dim htmlDoc As New HtmlAgilityPack.HtmlDocument()
        htmlDoc.OptionFixNestedTags = True

        htmlDoc.Load(fName)

        Dim classes As New List(Of String)()
        For Each node As HtmlNode In htmlDoc.DocumentNode.SelectNodes("//body//div")

            classes.Add(node.InnerHtml)
       Next
    End Sub

But not sure how to handle all the attributes. Any idea ?

and how to get value of input element ("Submit") ?

 <div id="u26" class="ax_html_button">
    <input id="u26_input" type="submit" value="Submit"/>
  </div>

if I type this I get value of "u16_input" element instead of "u26" !?

For Each node As HtmlNode In htmlDoc.DocumentNode.SelectNodes("//body//div")
            Dim className = node.GetAttributeValue("class", "")
            Select Case className
                Case "ax_html_button"
                    Dim node2 As HtmlNode = node.SelectSingleNode("//input")

                    value= node2.GetAttributeValue("value", "")
                Case "ax_paragraph"
                Case "ax_h1"
                Case "ax_h2"
                Case "ax_h3"
                Case "ax_h4"
                Case "ax_h5"
                Case "ax_h6"
                Case "ax_checkbox"
            End Select
        Next

EDIT: Found the solution.

1
0
8/15/2014 10:22:50 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Accepted Answer

It isn't entirely clear what you're trying to get. But here is an example to get class name from class attribute :

For Each node As HtmlNode In htmlDoc.DocumentNode.SelectNodes("//body//div")
    Dim className = node.GetAttributeValue("class", "");
    If Not String.IsNullOrEmpty(className) Then classes.Add(className)
Next

You can use similar approach to get other attributes of the <div>s.

0
8/15/2014 1:04:33 PM

Related Questions

In VB.Net, use HtmlAgilityPack to check whether an element contains a certain attribute.

I'm using HtmlAgilityPack to parse HTML....I want to check if an element has a specific attribute....I want to check whether an ...<a>... tag has the ...href... attribute....Dim doc As HtmlDocument = New HtmlDocument() doc.Load(New StringReader(content)) Dim root As HtmlNode = doc.DocumentNode Dim anchorTags As New List(Of String) For Each link ...
html-agility-pack html-parsing vb.net
asked by PeeHaa

VB.net HTML AgilityPack is used to parse links and tables.

I'm trying to do some screen scraping, and discovered the HTML AgilityPack, but am having some trouble figuring out how to use it with VB.net....The first thing I want to do is find the URL string for an HREF tag if I know the text that is enclosed in the HREF....The second thing is that I want to do is parse an HTML table, going through each row, ...
.net html-agility-pack vb.net
asked by Avi

htmlagilitypack and vb.net to retrieve a> tags and attributes

i have this code...Dim htmldoc As HtmlDocument = New HtmlDocument() htmldoc.LoadHtml(strPageContent) Dim root As HtmlNode = htmldoc.DocumentNode For Each link As HtmlNode In root.SelectNodes("//a") If link.HasAttributes("href") Then doSomething() 'this doesn't work because hasAttributes only checks whether an element has attributes or not Next...
html-agility-pack vb.net
asked by Smith

VB.NET - HtmlAgilityPack - Get innertext between two tags

I'm using HtmlAgilityPack and I want to get the inner text between two specific tags, for example:...<a name="a"></a>Sample Text<br> ...I want to get the innertext between ...</a>... and ...<br>... tags: Sample Text...How can I do it?...TIA...
html html-agility-pack innertext vb.net
asked by Hossain Alhaidari

Parsing htmlagilitypack (table without id's) vb.net

Hope to get some answers from you. ...I use vb.net and htmlagilitypack to fetch data and it works, but not the way I want it to =)...I have this html page (part of):...<TABLE WITH=100% BORDER=4> <TR> <TH><A HREF="http:/cgi-bin/vplata.py?tgnr=4300&val=Visa+T%C3%A5gnummer&Bek=Visa&sort=Lok" >Lok</A></TH> <TH><A HREF="http:/cgi-bin/vplata.py?tgnr=430...
html html-agility-pack html-table vb.net xpath
asked by Gabriel.Linden

VB.net extract links from google-search using HtmlAgilityPack

I have now updated my code as a test I want to list all URLs that has the word index.php but it also displays other things. ...Here is my working code:...Private Sub Button1_Click(sender As Object, e As EventArgs) Handles Button1.Click Dim webClient As New System.Net.WebClient Dim WebSource As String = webClient.DownloadString("http://www....
google-search html-agility-pack vb.net
asked by Marc Intes

VB.net Getting the InnerText of href using HtmlAgilityPack

I have now updated my code (Thanks Tim for helping me learn) which is already working but it doesn't give me the right links i want. ...Here is my working code:... Private Sub Button1_Click(sender As Object, e As EventArgs) Handles Button1.Click Dim webClient As New System.Net.WebClient Dim WebSource As String = webClient.Downloa...
href html-agility-pack innertext vb.net
asked by Marc Intes

Get Inner text between two tags and get the output into two labels - VB.NET - HtmlAgilityPack

I tried to search for examples and much but nothing seems to work. so i'm using HtmlAgilityPack and I want to get the inner text between two specific tags....Example:...<br>Terms of Service<br></br>Developers<br> ...I want to get the innertext where first ...<br>... and ...<br>... into label1 and the second ...</br>... and ...<br>... into label2...
html html-agility-pack innertext vb.net
asked by Jeff

Getting the <ul> <li> and <b> tags in htmlAgilityPack VB.NET

I honestly don't know how to do this, and I am very stuck. My code is probably not worth sharing, but I will try my best to ask the question....<div class="pricing-table"> <div class="span4"> <div class="plan"> <h3>PPTP <span>$0</span></h3> <ul> <li><b>IP:</b> " (hidden)"</li> <li>...
.net html-agility-pack vb.net
asked by Neckup4

vb.net get all attributes value using htmlagilitypack

this is the html ...<div id="catlist-listview" class="cat-listview cat-listbsize"> <ul> <li><a href="http://wantedlink1" rel="bookmark" title="sometitel1" class="sonra">title1</a></li> <li><a href="http://wantedlink2" rel="bookmark" title="sometitel2" class="sonra">title2</a></li> <li><a href="http://wantedlink3" rel="bookmark" title="...
attributes href html-agility-pack vb.net
asked by Snoopy Ohoo

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow