"Not" in XPath. Ignore branches that have a certain tag.

html-agility-pack xpath

Question

I have loaded a web page into the HTML Agility Pack and have a DOM. I want to use XPATH to pull out all of the text on the page (but not the javascript found within <script> tags).

I figure I need a //text() and then a 'not' to ignore any tag within the branch that has a <script> in it.

I have tried

doc.DocumentNode.SelectNodes("//text()[not(self::script)]"))

and

doc.DocumentNode.SelectNodes("//text()[not(script)]"))

but neither work. An example of the XPath property of a node that they return is (notice the Script)

/html[1]/body[1]/div[2]/div[4]/div[1]/div[1]/div[1]/div[3]/script[1]/#text[1]

I have consulted with both of these posts.

Is it possible to do 'not' matching in XPath?

Grab all text from html with Html Agility Pack (This is a good post but it brings out the JS)

Any suggestions?

1
2
5/23/2017 12:21:11 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Accepted Answer

Your first attempt rejects all text nodes that are script elements, and your second rejects all text nodes that have script node children. Of course, in both cases, the condition is never true.

You haven't explained your requirements clearly, but I guess you want to reject all text nodes that have script elements as their parent, which would be

//text()[not(parent::script)]

or

//*[not(self::script)]/text()
2
2/28/2012 1:49:53 PM

Related Questions

Using XPATH, get the meta tag attribute using HTML Agility Pack.

For a long time HtmlAgilityPack ...didn't have the ability to directly query an attribute value.... You had to loop over the list of meta nodes. Here's one way: ...var doc = new HtmlDocument(); doc.LoadHtml(htmlString); var list = doc.DocumentNode.SelectNodes("//meta"); foreach (var node in list) { string content = node.GetAttributeValue("con...
html html-agility-pack xpath
asked by Rohit Agarwal

XPath to HtmlAgilityPack re:test() (get all p tags with matched regex internal)

Apparently HtmlAgilityPack doesn't handle namespaces (not that I had one). So I've come up with this hack,...var pNodes = htmlDoc.DocumentNode.SelectNodes("//p") .Where(node => Regex.Match(node.InnerText, "^=.+=$").Success); ...If there is an HtmlAgilityPack solution I'd love to hear it!
c# html html-agility-pack xpath
asked by Chuck Savage

htmlagilitypack may be used to get p tags that come after a specified tag.

Try the following code:...var htmlText = "source code of your html page"; var htmlDoc.LoadHtml(htmlText); var h3= htmlDoc.DocumentNode.SelectNodes("//h2"); var lineNum = h3[0].Line; var p = htmlDoc.DocumentNode.SelectNodes("//p").Where(x => x.Line > lineNum);
c# html-agility-pack web-crawler
asked by tsubasa

To identify all elements with innertext containing a certain phrase or words, use Xpath and HtmlAgilityPack.

Use...:...//*[text()[contains(., 'Mr T')]] ...This selects all elements in the XML document that have a text-node child which contains the string ...'Mr T'.......This can also be written shorter as...:...//text()[contains(., 'Mr T')]/.. ...This selects the parent(s) of any text node that contains the string ...'Mr T'....
html-agility-pack xpath
asked by Dimitre Novatchev

XPath case ignoring in HtmlAgilityPack

If the actual value is an unknown case, I think you have to use translate. I believe it's:...SelectSingleNode("//meta[translate(@name,'ABCDEFGHIJKLMNOPQRSTUVWXYZ','abcdefghijklmnopqrstuvwxyz')='keywords']") ...This is the hack, but it's the only option in XPath 1.0 (except the opposite to upper-case).
.net-2.0 c# case-sensitive html-agility-pack xpath
asked by Matthew Flaschen

XPath ignores cases while selecting nodes

Not sure if you've tried this yet, but this is what I do for case sensitive contains searches:...//*[contains(translate(./@id,'ABCDEFGHIJKLMNOPQRSTUVWXYZ','abcdefghijklmnopqrstuvwxyz'), 'footer')]/@id ...I saw you have found your solution, so I'm posting this answer in case others have the same issue.
c# case-insensitive html-agility-pack xpath
asked by JWiley

Get the value of all td tags using xpath and html agilty

I think what you want is this:...HtmlNodeCollection collection = doc.DocumentNode.SelectNodes("//table[@class='string_14']//td[@class='tab_space']"); ...You can consult ...XPath Tutorial... for more on this.
c# html-agility-pack web-scraping xpath
asked by Simon Mourier

Using HTMLAgilityPack Extract text, which is not between tags and comes after specific node

XPATH is case-sensitive (see here for more on this: ...Is it possible to ignore case using xpath and c#?... ) plus the second phrase that contains 'Car' is not a child a B element. You could have it work like this:...HtmlDocument doc = new HtmlWeb().Load("http://website.com/x.html"); foreach (HtmlNode node in doc.DocumentNode.SelectNodes("//text()[...
c# html html-agility-pack web-scraping xpath
asked by Simon Mourier

Get value between html tags Xpath and HtmlAgility

I'd recommend using CsQuery (...https://www.nuget.org/packages/CsQuery/1.3.4...) and then it's as simple as:...var doc = CQ.CreateFromUrl(@"http://www.karmaloop.com/Browse.htm"); var nodes = doc.Find("span.thumbnail-details-grey"); foreach(var node in nodes) Console.WriteLine(node.InnerText);
c# html html-agility-pack html-parsing xpath
asked by Martin Ernst

XPath Select all children with specific parent node by attribute

For the ...div... element with an ...id... attribute of ...hero...//div[@id='hero']..., these XPath expression will select elements as follows:...//div[@id='hero']/*... will select all of its ...children... elements....//div[@id='hero']/img... will select all of its ...children...img... elements....//div[@id='hero']//*... will select all of its ...
html-agility-pack xml xpath
asked by kjhughes

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow