KeyNotFoundException with using HtmlEntity.DeEntitize() method

c# html-agility-pack keynotfoundexception

Question

I am currently working on a scraper written in C# 4.0. I use variety of tools, including the built-in WebClient and RegEx features of .NET. For a part of my scraper I am parsing a HTML document using HtmlAgilityPack. I got everything to work as I desired and went through some cleanup of the code.

I am using the HtmlEntity.DeEntitize() method to clean up the HTML. I made a few tests and the method seemed to work great. But when I implemented the method in my code I kept getting KeyNotFoundException. There are no further details so I'm pretty lost. My code looks like this:

WebClient client = new WebClient();
string html = HtmlEntity.DeEntitize(client.DownloadString(path));
HtmlDocument doc = new HtmlDocument();
doc.LoadHtml(html);

The HTML downloaded is UTF-8 encoded. How can I get around the KeyNotFound exception?

1
8
11/7/2012 6:12:35 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Popular Answer

My HTML had a block of text like so:

... found in sections: 233.9 & 517.3; ...

Despite the spacing and decimal point, it was interpreting & 517.3; as a unicode character.

Simply HTML Encoding the raw text fixed the problem for me.

string raw = "sections: 233.9 & 517.3;";
// turn '&' into '&', etc, before DeEntitizing
string encoded = System.Web.HttpUtility.HtmlEncode(raw);
string deEntitized = HtmlEntity.DeEntitize(encoded);
3
5/10/2017 7:29:47 PM

Related Questions

Html Agility Pack Load method issue

I am using the Html Agility pack. When the Load method of HtmlDocument class is passed the URL like "http://www.stackoverflow.com" it says the URI is not in correct format.... doc.Load(TextBoxUrl.Text, Encoding.UTF8 ); ...the url I try is this ...http://www.stackoverflow.com/questions/846994/how-to-use-html-agility-pack
asp.net c# html-agility-pack
asked by azam

HtmlAgilityPack, using XPath contains method and predicates

Perhaps the issue is simply that you're missing the closing parenthesis on the contains() function:...//div[contains(@class, 'yom-art-content']//p v //div[contains(@class, 'yom-art-content')]//p List<string> paragraphs = doc2.DocumentNode.SelectNodes("//div[contains(@class, 'yom-art-content')]//p")...
contains html-agility-pack xpath
asked by JLRishe

Match exact string using string.Contains() method in c#

yes I'm trying to find match inside an html content....Then use ...HtmlAgilityPack.... Your code would be something like....var doc = new HtmlAgilityPack.HtmlDocument(); doc.LoadHtml(HtmlString); var tds = doc.DocumentNode.SelectNodes("//td[@align='middle']"); ...or something like this using LINQ...var tds = doc.DocumentNode.Descendants("td") ...
c# html-agility-pack
asked by I4V

get value from table in a web page using Html Agility Pack Without using "SelectNode'

SelectNode (with an XPath query) just does its own thing of iterating through the nodes and matching things up. You just have to do this by hand, by looking at the HTML itself and building a path to get to what you want. ...var table = htmlDocument.DocumentNode.ChildNodes["html"].ChildNodes["Body"].ChildNodes[0].ChildNodes[0].ChildNodes[0].ChildNod...
c# c#-4.0 html html-agility-pack windows-store-apps
asked by Thraka

HtmlAgilityPack method for returning value from a row in a table given column data

I want to use Html Agility pack to extract inner html info based on it's relative distance from other td's within a given row in a table....For example in the code below what would be an efficient dynamic command that would take the data in the first td tag as an input and give the data in the third td tag as an output:...<tbody> <tr> <...
c# html-agility-pack
asked by Sperick

Site uses Javascript and I am having trouble accessing it using htmlagilitypack

I am trying using a Windows Phone 8.0 Silverlight App to scrape data from ...PlayStation.......However, I believe the site uses Javascript and I am having trouble accessing it using htmlagilitypack....My code so far is:...protected async override void OnNavigatedTo(NavigationEventArgs e) { base.OnNavigatedTo(e); string htmlPageLive = ""; ...
c# html-agility-pack web-scraping windows-phone-8
asked by Keith K

HTML Agility Pack SelectSingleNode method not listed on Universal Apps (C#)

I am developing a simple web scraping app in C# and here is my code to load html code received from the server to ...HtmlDocument.......string html = res.Content.ToString(); HtmlDocument htmlDoc = new HtmlDocument(); htmlDoc.LoadHtml(html); ...Whenever I try to use the ...htmlDoc.DocumentNode.SelectSingleNode... method I am getting this error:..."H...
c# html-agility-pack
asked by Krishna Kalubandi

Get the content of website using HttpClient but without async method

But the problem is when i call my async function :...Task.WaitAll(lst); List<NewsContent> enresult = lst.Result; ...Yes, that's a problem, all right. Two problems, actually: ...Task.WaitAll... and ...Result.... They should both be replaced with a single ...await...:...List<NewsContent> enresult = await lst; ...The core problem is a ...deadlock scen...
asp.net-mvc asynchronous c# html-agility-pack http
asked by Stephen Cleary

htmlAgilityPack Load() method does nothing

I'm using htmlAgilityPack to get the content of a website:...private String getImageUrl(String websiteUrl) { HtmlAgilityPack.HtmlDocument docHtml = new HtmlWeb().Load(websiteUrl); // ... } ...I don't reach the breakpoint at the second line, the first line does not throw an exception. The URL is existing and available. ...docHtml is also not...
c# html-agility-pack winforms
asked by Marcel

HtmlAgilityPack LoadFromBrowser method not found

I am using ...HtmlAgilityPack 1.6.2... within a ....NET Core 2.0... Console application. ...HtmlWeb.Load... function works fine but ...LoadFromBrowser... function is not available. I got a compiler error. The testing code is copied from the ...tutorial page... so it should be correct. Please advise how to use the API.
html-agility-pack
asked by user2722465

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow