Html Agility Pack - Knowledge Base (KB)

HtmlAgilityPack and large HTML Documents

I have built a little crawler and now when trying it out i found that when crawling certain sites my crawler uses 98-99% CPU....I used ...dotTrace... to see what the problem could be and it pointed me towards my ...httpwebrequest... method - i optimised i...

How to pass cookies to HtmlAgilityPack or WebClient?

I use this code to login:...CookieCollection cookies = new CookieCollection(); HttpWebRequest request = (HttpWebRequest)WebRequest.Create("example.com"); request.CookieContainer = new CookieContainer(); request.CookieContainer.Add(cookies); HttpWebRespons...

HtmlDocument.LoadHtml from WebResponse?

I try to extract image from a posted link and the first check I do is to see if the link is to a plain image like this : ... HttpWebRequest request; WebResponse webresponse; request = (HttpWebRequest)HttpWebRequest.Create(url); webrespon...

Multiple HttpWebRequest in loop?

I have to call web-service multiple time (in loop) the problem is that my code always return empty object (Image Description) and doesn't run properly when I tested it separately (out of loop) it worked normally...here is my portion of code...HttpWebReque...

How can i reuse cookies from HttpWebResponse to stay logged in on a web page?

I have a case with a simple application that browses to a XenForo Forum site, fetches cookies and further sends post data to login and fetch some information only available for logged in users....I am able to successfully fetch the cookies and verify that...

Htmlagilitypack after login to Https Website with HttpWebRequest?

I want to parse some html site like pluralsight,Forexample (...https://app.pluralsight.com/id...?), So How can I first login site programmaticaly (without using webbrowser control) then call another url (for example : ...Pluralsight...) and get response a...

the request was aborted could not create ssl/tls secure channel on shared hosting server C#

We are not able to connect to https server using ...webrequest... or ...htmlagilitypack... It showing below error...The underlying connection was closed: An unexpected error occurred on a receive.System.Net.WebException:... or ...could not create SSL/TLS ...