How can I take a remote screenshot of a website from a url?

c# html html-agility-pack multithreading webpage-screenshot

Question

So I have an application that does:

  1. Take n amount of links from SQL

  2. Creates a new thread for each link

  3. Get HTML code of this website with HTML-Agility-Pack for each thread

  4. Saves its data to SQL (image sizes, page size, word count, words etc) and saves this process with its date

This is to check the data on a website and see if there is any changes (like a typo or a problem with images that were previously uploaded) and I want to add a screenshot/thumbnail to these for each page. How can I take a screenshot of the whole page during each thread?

1
0
10/23/2017 8:40:31 AM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Popular Answer

Seems like an interesting app. As you already get the HTML for the entire URL (I would assume the app is running on a machine/server which has internet connectivity):

There are 3 ways you can do this (many more actually).

  1. In the Thread - create a System.Windows.Forms.Form object, Add a webbrowser control to its list of Child Controls (Dock = Fill). Make the browser navigate to the url. Once navigation is complete - take the screenshot of the WinForms Dialog.
  2. In the thread - launch chrome/IE web browser passing the Url as Command line argument. Wait for sometime in the thread (there isnt a good way to know when rendering finishes). Take the screenshot.
  3. In the thread - Use selenium type of .net compatible library - which helps you do web ui testing automation and then do Step #2. You will have more granular control over the web browser using this approach.
0
10/23/2017 9:01:22 AM

Related Questions

How can I get all the photos from a website using HTML Agility Pack?

You can do this using LINQ, like this:...var document = new HtmlWeb().Load(url); var urls = document.DocumentNode.Descendants("img") .Select(e => e.GetAttributeValue("src", null)) .Where(s => !String.IsNullOrEmpty(s)); ...EDIT...: This code now actually works; I had forgotten to write ...
c# html-agility-pack parsing
asked by SLaks

C# HAP "System.Net is a programming language. The remote name could not be resolved due to a WebException "uniqueness

You're not adding a slash between the FQDN and the path, and you are adding a ...HtmlAgilityPack.HtmlNodeCollection... to a string, which won't work.
c# html-agility-pack
asked by CodeCaster

How to send keys to the website using their element IDs in C# ASP.Net?

I'm doing something similar but I'm getting the page html manually....// do webrequest stuff and return raw html string html = DemoDoHttpGet(url, cookieContainer); // I'm hitting an asp.net page so I have to repeat a bunch of values back to the server // key is the "name" attribute of an element i want to find in the html // i gathered these manua...
asp.net c# html-agility-pack
asked by lincolnk

how to extract a url's title, images and description using HTML Agility utility

protected void btnGetURLDetails_Click(object sender, EventArgs e) { HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(new Uri(txtURL.Text)); request.Method = WebRequestMethods.Http.Get; HttpWebResponse response = (HttpWebResponse)request.GetResponse(); StreamReader reader = new StreamReader(response.GetResponseStream(...
asp.net c# html-agility-pack webforms
asked by Danilo Vulović

C# Using HTML Agility Pack and Need To programmatically Login To Website

It took me a long time to come to grips with the fact that this doesn't work with HTML Agility Pack. Just use Selenium with PhantomJS. It solved all my problems and it's possible to use CSS selectors. Don't waste as much time as I did on this.
c# html html-agility-pack login web-scraping
asked by Chris

Get the content of website using HttpClient but without async method

I guess i found the problem with your code.... You're not adding the ...NewsContent... object to your ...List.... ...in the ...foreach... loop please add it to the ...List...lstResult.Add(newsContent)...Hope it solves the issue with your ...async... strategy
asp.net-mvc asynchronous c# html-agility-pack http
asked by Vishnu Prasad V

How to get URLs on page with HTMLAgilityPack, when the Source does not contain the URLs?

Okay, I see the problem now. This page is using Angularjs directives and bindings, and the hrefs are loading post page load. The page we are getting is before any parsing/execution has happened as from the web browser agent. This means the changes on the page after any DOM manupulation/ javascript or ajax modification will not be included in the Ht...
c# html html-agility-pack
asked by mojorisinify

Htmlagilitypack after login to Https Website with HttpWebRequest?

You have to get the stream for the response via ...HttpWebResponse.GetResponseStream... and then load the document via the ...Load... method of the HtmlDocument....var doc = new HtmlAgilityPack.HtmlDocument(); doc.Load(response.GetResponseStream()); //further processing...
c# html-agility-pack https httpwebrequest
asked by shriek

How to extract meta tags of a series of URLs without downloading whole html in c#

You can request and download partial result using ...HttpClient... by specifying range header. You can define the buffer length you want to download and read:... static void Main() { Test().GetAwaiter().GetResult(); } private static async Task Test() { const string url = "http://google.com"; const int byt...
asp.net c# html html-agility-pack metadata
asked by Aleksey L.

Get Image Absolute URL From Some Node in HtmlAgilityPack.HtmlDocument

Consider ...ResponseUri... and to avoid second call give html agility parser the string with the content of the page instead.
c# html html-agility-pack redirect relative-url
asked by Eugene Komisarenko

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow