zzz projects Html Agility Pack
Home
Documentation Release Notes 3rd Party Libraries Knowledge Base  Help & Donate
Online Examples
  • Home
  • Documentation
  • Release Notes
  • 3rd Party Libraries
  • Knowledge Base
  • Help & Donate
  • Online Examples
  •   Download  

Html Agility Pack - Knowledge Base (KB)

59 results in tag: web-scraping

Screen Scraping XPATH in HTML Agility Pack isn't delivering data.

I'm attempting to write a screen scraper for Digikey that will allow our company to keep accurate track of pricing, part availability and product replacements when a part is discontinued. There seems to be a discrepancy between the XPATH that I'm seeing ...
c# html-agility-pack screen-scraping web-scraping
asked by Matthias

Find Comment Node in HTML Agility Pack

I am scraping a website that uses Javascript to dynamically populate the content of a website with the Html Agility pack....Basically, I was searching for the XPATH ..."\\div[@class='PricingInfo']"..., but that div node was being written to the DOM via Ja...
c# html html-agility-pack web-scraping xpath
asked by Abe

How can I get text next to a picture using HTML Agility Pack?

I have this bit of html that I need to parse though...<p class="feature_list"> <img src="candy.gif" alt="candy" title="candy"/>&nbsp; x 3&nbsp;&nbsp; <img src="lollies.gif" alt="lollies" title="lollies"/>&nbsp; ...
c# c#-4.0 html-agility-pack web-scraping
asked by Diskdrive

Making your web scraping operations seem to be typical browser browsing?

I'm using the Html Agility Pack and I keep getting this error. "The remote server returned an error: (500) Internal Server Error." on certain pages....Now I'm not sure what this is, as I can use Firefox to get to these pages without any problems....I have...
c# html-agility-pack web-scraping
asked by Diskdrive

How to parse a FORM from a WebResponse into a WebRequest's POST body

I'm new to this, this is my virgin voyage, the task at hand is to create a transaction in C# that will navigate through a page flow of a web app via WebRequest/WebResponse. I got the Request/Response mechanism working, cookies and all (I can successfully ...
c# html-agility-pack webrequest webresponse web-scraping
asked by Jessica Jones

Expression must evaluate to a node-set in HTML Agility Pack C#

I'm using Html Agility Pack to fetch a webpage. I want to collect all the TEXT I AM LOOKING FOR of the following form:...<li><a href="/deal/map/4087664" class="show-location" title="bla bla" data-address="TEXT I AM LOOKING FOR"></a></li> ...I tried this c...
c# html-agility-pack web-scraping
asked by Elad Benda

Creating an htmltable from a table in asp.net vb (htmlagilitypack)

I am trying to grab a html table from a remote page and display the contents of this table in a htmltable on my site. I am using htmlagility pack. So far here is my code:...Imports HtmlAgilityPack Partial Class ContentGrabExperiment Inherits System.We...
asp.net html-agility-pack html-table vb.net web-scraping
asked by Phil

HTML Agility Pack for HTML Scraping

Can some one tell me the best way to get the contents using HTMLAgilityPack that i mention below from the html....In the HTML provided i need to scrape ...value... of the ID "img" and set the values for ...x... and ...y... for them to be used in another f...
ajax c# html-agility-pack web-scraping
asked by user671805

Using C# and the.NET Framework, do screen scraping, web scraping, web harvesting, web data extraction, and more.

I am working on a Microsoft .NET Application in C# for Web Harvesting, Web Scraping, Web Data Extraction, Screen Scraping, etc. whatever you want to call it. For parsing HTML, I'm attempting to incorporate HTML Agility Pack but it's not as easy as I thoug...
.net c# html-agility-pack visual-studio web-scraping
asked by John

Filter Href Value Results with HTML Agility Pack

I'm working on a web scraper. The following text shows the results of the code given at the end of this question, which gets the values of all hrefs from a page. ...I only want to get values that contain ...docid=...index.php?pageid=a45475a11ec72b843d7495...
c# html-agility-pack web-scraping
asked by guitarPH

Agility Pack for HTML. Scrape and load a website

Is this the ...best... way to get a webpage when scraping?...HttpWebRequest oReq = (HttpWebRequest)WebRequest.Create(url); HttpWebResponse resp = (HttpWebResponse)oReq.GetResponse(); var doc = new HtmlAgilityPack.HtmlDocument(); doc.Load(resp.GetRespons...
c# html-agility-pack web-scraping
asked by thatsIT

Removing useless TextNodes in HtmlAgilityPack

I'm scraping a number of websites using HtmlAgilityPack. The problem is that it seems to insist on inserting TextNodes in most places which are either empty or just contain a mass of \n, whitespaces and \r....They tend to cause me issues when I'm counting...
c# html-agility-pack web-scraping
asked by Aabela

Extracting a table with Html Agility Pack

I am trying to extract a table from a webpage using Html Agility Pack. So far I have managed to do a little of progress with it. This is my code so far... Dim web As New HtmlAgilityPack.HtmlWeb() Dim htmlDoc As HtmlAgilityPack.HtmlDocument = web.Lo...
html html-agility-pack vb.net web-scraping
asked by Rob Schneider

Scraping data using HTMLAgilityPack

In HTMLAgailityPack, how to get the data from the website which is not coming in the innerhtml method of it. For example, if in the link below:...https://www.theice.com/productguide/ProductSpec.shtml?specId=1496#expiry...The table starting with contract s...
c# html-agility-pack html-parsing web-scraping
asked by nishant jain

How to scrape a flash based site?

We are using ...Html Agility Pack... to scrape data for HTML-based site; is there any DLL like ...Html Agility Pack... to scrape flash-based site?
c# flash html-agility-pack web-crawler web-scraping
asked by Noor

Html Agility Pack, Web Scraping, and spoofing in C#

Is there a way to spoof a web request from C# code so it doesn't look like a bot or spam hitting the site? I am trying to web scrape my website, but keep getting blocked after a certain amount of calls. I want to act like a real browser. I am using thi...
c# html-agility-pack spoofing web-scraping
asked by Mike Flynn

How to get table from Wikipedia

I want to put one table from Wikipedia into xml file and then parse it to C#. Is it possible? If yes, can I save in xml only ...Title... and ...Genre... column?...HtmlWeb web = new HtmlWeb(); HtmlDocument doc = web.Load("http://en.wikipedia.org/wiki/2012_...
c# html-agility-pack web-scraping xml
asked by a1204773

HTML Agility Pack and LINQ

I want to use HAP to scrape data from a table on a website, loop through the rows to find a value in a column that matches a predefined string and then store only that row that matches. Then I will have a dictionary with the column header as the key, and ...
c# html-agility-pack linq web-scraping
asked by jrob42

Using htmlAgilityPack scraping all inner text from <a> tag

I want to scrap all the word from the link ...http://search.freefind.com/siteindex.html?id=59478474&ltr=10240&fwr=0&pid=i&ics=1... I tried something like this:...HtmlWeb web = new HtmlWeb(); HtmlAgilityPack.HtmlDocument doc = web.Load("http://search.free...
.net c# html-agility-pack web-scraping xpath
asked by ImonBayazid

HtmlAgilityPack SelectNodes, Disposing

I am trying to do some screen scraping using HtmlAgilityPack using ...SelectNodes... and getting some values from each node returned...Here is the code ...private readonly HtmlDocument _document = new HtmlDocument(); public void ParseValues(string html) ...
c# html-agility-pack web-scraping
asked by Roman Ratskey

Page 1 of 3
  • 1
  • 2
  • 3
  • ยป

Prime Library

Performance

  • Entity Framework Extensions
  • Entity Framework Classic
  • Bulk Operations
  • Dapper Plus

Expression Evaluator

  • C# Eval Expression
  • SQL Eval Function
More Projects...

Related

  • EF Extensions Online Benchmark
  • WIN an EF Extensions license
  • EF6 BatchSaveChanges for only $79
Get monthly updates by subscribing to our newsletter!
SUBSCRIBE!