Using htmlAgilityPack scraping all inner text from tag

.net c# html-agility-pack web-scraping xpath

Question

I want to remove every word from the http://search.freefind.com/siteindex.html?id=59478474&ltr=10240&fwr=0&pid=i&ics=1 link. I made the following attempt:

HtmlWeb web = new HtmlWeb();
HtmlAgilityPack.HtmlDocument doc = web.Load("http://search.freefind.com/siteindex.html?id=59478474&ltr=10240&fwr=0&pid=i&ics=1");
HtmlNodeCollection nodes = doc.DocumentNode.SelectNodes("//font[@class='search-index-font']//a");

if (nodes != null)
{

    foreach (HtmlNode n in nodes)
    {
         link = n.InnerText;
        my_link.Add(link);
        MessageBox.Show(link);
    }

}
else
    MessageBox.Show("no wordfound ");

My anticipated result should be similar

a    
aa
aachhe
aagrashi
aagun
aaj
aam
aanka
aankhi
aar
aashman
abāddhō
abāddhōtā
abadh
..
..

But that wasn't successful? zzz 21 zzz means that it gives null. In that situation, how can I get all text from the a > tag? Can someone please explain me what goes in SelectNodes("")?

1
0
2/22/2013 2:21:34 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Accepted Answer

After that, you must look for the subsequent text node.<script> tag(not <a> like you said, within<font class='search-index-font'> . The following xpath expression will work:

//font[@class='search-index-font']/script/following-sibling::text()[1]

Also, this code:

HtmlWeb web = new HtmlWeb();
HtmlAgilityPack.HtmlDocument doc = web.Load("http://search.freefind.com/siteindex.html?id=59478474&ltr=10240&fwr=0&pid=i&ics=1");
HtmlNodeCollection nodes = doc.DocumentNode.SelectNodes("//font[@class='search-index-font']/script/following-sibling::text()[1]");

returns the text nodes you require:

a
aa
aachhe
aagrashi
aagun
aaj
aam
aanka
aankhi
aar
...
0
2/22/2013 2:55:08 PM

Popular Answer

HtmlWeb web = new HtmlWeb();
HtmlAgilityPack.HtmlDocument doc =
    web.Load("http://search.freefind.com/siteindex.html?id=59478474&ltr=10240&fwr=0&pid=i&ics=1");
HtmlNodeCollection nodes = doc.DocumentNode.SelectNodes("//font[@class='search-index-font']");
string link = string.Empty;
if (nodes != null)
{
    foreach (var item in nodes)
    {
        var value =
        item.Elements("script").ToList();
        foreach (var items in value)
        {
            link += items.NextSibling.InnerText+ "\n";
        }
    }
    MessageBox.Show(link);
}
else
    MessageBox.Show("no wordfound ");
user2099420

Related Questions

htmlagilitypack may be used to get p tags that come after a specified tag.

Using htmlagilitypack c#, I'm crawling a webpage....i have in the source code of an html page .... <p>this a p that come before h3</p> .... .... <h3>this h3 </h3> <p>first p after h3</p> .... <p>seconde p after h3</p> ...I want to acquire every P going forward....Is it possible to utilize a position-based where to filter Ps?...Specifically, (po...
c# html-agility-pack web-crawler
asked by user594166

choose a> tag with given inner text with htmlagilitypack

One approach (case-sensitivity applies):...//a[contains(text(), 'wake')]
.net html-agility-pack xpath
asked by Birei

Selecting Inner Text Using HtmlAgilityPack

Using HTMLAgilityPack, I'm attempting to extract some inside text. The HTML of interest is shown below:...<select name="Archives" onchange="javascript:setTimeout(&#39;__doPostBack(\&#39;Archives\&#39;,\&#39;\&#39;)&#39;, 0)" id="Archives" style="width:200px;"> <option selected="selected" value="Dashboard_Jul-2012">Dashboard_Jul-2012</option> ...
c# html html-agility-pack
asked by Kevin

Removing Html tags while preserving inner text and <br> tags

While retaining text and other HTML information, I'm attempting to delete the span, font, b, s, strike, and other inner element elements....<br>... tags inside it I'm using HTML Agility Pack for this. I was able to save the text, however...<br>... Tags continue to be a concern. Any thoughts?...This is the key:... private void removeTagsButPreserveT...
c# html-agility-pack html-parsing
asked by Rade Milovic

Inner text of Node ignoring inner text of children

The ...div... if there is text before and after it, it can contain many text nodes. As I also said ...here..., I believe the easiest technique to get all of a node's direct text content is to carry out the following:...HtmlDocument page = new HtmlWeb().Load(url); var nodes = page.DocumentNode.SelectNodes("//div[@id='div1']//div[@class='h1']/text()"...
c# html-agility-pack xpath
asked by JLRishe

Using HTMLAgilityPack Extract text, which is not between tags and comes after specific node

CSS code:... <b> CAR </b> <br></br> Car is something you can drive. <br></br> <br></br> ...C# code:... HtmlAgilityPack.HtmlDocument doc = new HtmlWeb().Load("http://website.com/x.html"); if (doc != null) { HtmlNode link = doc.DocumentNode.SelectSingleNode("//b[contains(text(), 'CAR')]"); ...
c# html html-agility-pack web-scraping xpath
asked by GiedriusK

how to replace <br> tag with <br/> tag using HtmlAgilityPack?

document.OptionWriteEmptyNodes = true; ...will work its magic on you!
c# html-agility-pack
asked by ragmn

Append a node to inner text using HTMLAgilityPack

Problem: I have to delete all of the style properties from...<p>... and if it has tags...font-weight:bold... after property, add...<b>... to it....if the html is ...eg:...<p style="margin-top:0pt; margin-bottom:0pt;font-weight:bold; font-weight:bold;font-size:10pt; font-family:ARIAL" align="center"> SOME TEXT HERE</p>... ....It should produce:...<p...
c# html-agility-pack
asked by user2729272

Get Inner text between two tags and get the output into two labels - VB.NET - HtmlAgilityPack

The simple answer is no, HAP is not a good choice for carrying out your mission. Below are my notes:...Imports HtmlAgilityPack Public Class Form1 Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click Dim mystring As String = "<BR>Terms of Service<BR></BR>Developers<BR>" Dim ...
html html-agility-pack innertext vb.net
asked by user2990854

How to get the inner text for a single node using HtmlAgilityPack

The HTML I use is as follows:... <div id="footer"> <div id="footertext"> <p> Copyright &copy; FUCHS Online Ltd, 2013. All Rights Reserved. </p> </div> </div> ...In my C# code, I want to extract the following content from the markup: "Copyright © FUCHS Onlin...
c# html-agility-pack
asked by MD.Amjad Hossain

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow