How to get text that has no tag with htmlAgilityPack

c# html html-agility-pack xpath

Question

I have an html file like below

  <div>

  <div style="margin-left:0.5em;">
  <div class="tiny" style="margin-bottom:0.5em;">
  <b><span class="h3color tiny">This review is from: </span>You Meet</b>
  </div>
  If you know Ron Kaufman as I do ...
  <br /><br />Whether you're the CEO....
  <br /><br />Written in a distinctive, ...
  <br /><br />My advice? Don't just get one copy
  <div style="padding-top: 10px; clear: both; width: 100%;"></div>
  </div>

  <div style="margin-left:0.5em;">
  <div class="tiny" style="margin-bottom:0.5em;">
  <b><span class="h3color tiny">This review is from: </span>My Review</b>
  </div>
  I became a fan of Ron Kaufman after reading an earlier book of his years ago...
  <div style="padding-top: 10px; clear: both; width: 100%;"></div>
  </div>

  </div>

I want to get review text which doesnt have any html tag. I am using below code now

  foreach (HtmlNode divReview in doc.DocumentNode.SelectNodes(@"//div[@style='margin-left:0.5em;']"))   
   {
      if (divReview != null)
          {

 review.Add(divReview.Descendants("div").Where(d => d.Attributes.Contains("style") && 
 d.Attributes["style"].Value.Contains("padding-top: 10px; clear: both; width: 100%;")).
                                          Select(d =>
 d.PreviousSibling.InnerText.Trim()).SingleOrDefault());  
          }
       }

which only return "My advice? Don't just get one copy", how can I get the whole text?

Update: Even if I remove all

"br"

tag from htmlnode, still when use the above code I only get "My advice? Don't just get one copy" part!!! any comment?

1
0
5/9/2013 9:13:59 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Accepted Answer

I've updated the code to this:

var allText = (reviewDiv.Descendants("div")
  .First(div => div.Attributes["style"].Value == "padding-top: 10px; clear: both; width: 100%;")
  .SelectNodes("./preceding-sibling::text()") ?? new HtmlNodeCollection(null)) 
  .Select(text => text.InnerText);

This should return an IEnumerable of strings with the text preceding the div with the intricate style.

Without having a little more of the surrounding HTML it's hard to tell whether this is exactly what you're after. I'm currently guessing that you have selected a div and that that div is the direct parent of this whole block of text (given your reference to a reviewDiv). Your HTML sample doesn't seem to contain this piece of HTML, so I'm making a few assumptions here.

With the following input:

<div><div class="tiny" style="margin-bottom:0.5em;">
<b><span class="h3color tiny">This review is from: </span>You Meet</b>
</div>
If you know Ron Kaufman as I do ...
<br /><br />Whether you're the CEO....
<br /><br />Written in a distinctive, ...
<br /><br />My advice? Don't just get one copy
<div style="padding-top: 10px; clear: both; width: 100%;"></div></div>

It extracts this:

If you know Ron Kaufman as I do ...
Whether you're the CEO....
Written in a distinctive, ...
My advice? Don't just get one copy

To build a single string I used: string extractedText = string.Join("", allText);

0
5/9/2013 8:36:21 PM

Related Questions

htmlagilitypack and vb.net to retrieve a> tags and attributes

If HtmlAgilityPack supports this XPATH selector, you can replace ...//a... with ...//a[@href]...For Each link as HtmlNode In root.SelectNodes("//a[@href]") doSomething() Next ...Otherwise, you can use the ...Attributes... property:...For Each link as HtmlNode In root.SelectNodes("//a") If link.Attributes.Any(Function(a) a.Name = "href") The...
html-agility-pack vb.net
asked by Jay

htmlagilitypack may be used to get p tags that come after a specified tag.

Try the following code:...var htmlText = "source code of your html page"; var htmlDoc.LoadHtml(htmlText); var h3= htmlDoc.DocumentNode.SelectNodes("//h2"); var lineNum = h3[0].Line; var p = htmlDoc.DocumentNode.SelectNodes("//p").Where(x => x.Line > lineNum);
c# html-agility-pack web-crawler
asked by tsubasa

Get Text From 1st STRONG Tag Inside SPAN Tag with HTML Agility Pack

var nodes = doc.DocumentNode.SelectNodes("//span[@class='advisory_link']//strong[1]"); if (nodes != null) { foreach (var node in nodes) { string Description = node.InnerHtml; return Description; } } return null;
c# html-agility-pack html-parsing
asked by guitarPH

Removing Html tags while preserving inner text and <br> tags

For this kind of HTML manipulation, there's a great library called the ...HTML Agility Pack.......Here's a similar question which will point to the right direction: ...Html Agility Pack - Remove element, but not innerHtml
c# html-agility-pack html-parsing
asked by Mark

Getting text between all tags in a given html and recursively going through links

Regex is not a good choice for parsing HTML files.....HTML is not strict nor is it regular with its format.....Use ...htmlagilitypack...This extracts all the links from the web page...public List<string> getAllLinks(string webAddress) { HtmlAgilityPack.HtmlWeb web = new HtmlAgilityPack.HtmlWeb(); HtmlDocument newdoc=web.Load(webAddress); ...
c# html html-agility-pack web-crawler
asked by Anirudha

Using HTMLAgilityPack Extract text, which is not between tags and comes after specific node

XPATH is case-sensitive (see here for more on this: ...Is it possible to ignore case using xpath and c#?... ) plus the second phrase that contains 'Car' is not a child a B element. You could have it work like this:...HtmlDocument doc = new HtmlWeb().Load("http://website.com/x.html"); foreach (HtmlNode node in doc.DocumentNode.SelectNodes("//text()[...
c# html html-agility-pack web-scraping xpath
asked by Simon Mourier

How to fix html tags(which is missing the <open> & <close> tags) with HTMLAgilityPack

The library isn't intelligent enough to create the opening ...p... where you put it, but it's intelligent enough to create the missing ...h1.... And in general, it creates valid HTML always, but not always the one you would expect....So this code:... HtmlDocument doc = new HtmlDocument(); doc.Load(yourhtml); doc.Save(Console....
c# dom html-agility-pack
asked by Simon Mourier

Use HtmlAgilityPack to determine if string contains ONLY tags from list of allowed tags

var allowedTags = new List<string> { "html", "head", "body", "div" }; bool containsOnlyAllowedTags = doc.DocumentNode .Descendants() .Where(n => n.NodeType == HtmlNodeType.Element) .All(n => allowedTags.Contains(n.Name));
c# html-agility-pack
asked by Sergey Berezovskiy

Get Inner text between two tags and get the output into two labels - VB.NET - HtmlAgilityPack

this is a bit dirty, but should work. ...Imports System.Text.RegularExpressions Dim mystring As String = "<br>Terms of Service<br></br>Developers<br>" Dim pattern1 As String = "(?<=<br>)(.*?)(?=<br>)" Dim pattern2 As String = "(?<=</br>)(.*)(?=<br>)" Dim m1 As MatchCollection = Regex.Matches(mystring, pattern1) Dim m2 As Match...
html html-agility-pack innertext vb.net
asked by user2990854

HtmlAgilityPack : Issues getting content of anchor tag within a string

Replace ...Console.WriteLine("Content: " + acontent.InnerHtml); ...With ...Console.WriteLine("Content: " + acontent.InnerText); ...Or even better something like this...var result = acontent.DocumentNode .Descendants("a") .Where(x=>x.Attributes["class"].Value =="url link").InnerText;
c# html-agility-pack html-parsing
asked by Zach Spencer

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow