C# HAP how to obtain a url that redirects

c# html-agility-pack

Question

This is an ebay page

http://www.ebay.com/itm/GRUEN-RUNNING-PRECISION-WRIST-WATCH-/230718830945?pt=Pocket_Watches&hash=item35b7e9f961

I am using C# agility pack to get the 'print' version page from this link . 'Print' link is at the middle right side of this page . Agilitypack is returning this link :

http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&rt=nc&item=230718830945&si=a8iGAIchyvEbn7KveYFZ5QbEE7o%3D&print=all&category=3940

When I am loading this link its returning another page , not the actual one . Though clicking on 'print' works well . As far as i understand 'print' link is being redirected to another page. I have checked some solution of stackoverflow . not worked for this case . There is a .dll file in the link/path . Any suggestion to solve this problem ??

thanks in advance

1
2
12/24/2011 3:50:13 PM

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge

Popular Answer

The link points to http://cgi.ebay.com/ which redirects to http://www.ebay.com/itm/ the rest of the URL is identical, so you can just use string.Replace("http://cgi.ebay.com/", "http://www.ebay.com/itm/")

Or if you want to do it cleanly, use this code:

HttpWebRequest req = (HttpWebRequest)WebRequest.Create(print_url);
HttpWebResponse myResp = (HttpWebResponse)req.GetResponse();

string new_print_url = myResp.ResponseUri;
2
12/24/2011 3:28:34 PM

Related Questions

Using HtmlAgilityPack to extract the complete URL - C#

Assuming you have the original url, you can combine the parsed url something like this:...// The address of the page you crawled var baseUrl = new Uri("http://example.com/path/to-page/here.aspx"); // root relative var url = new Uri(baseUrl, "/Login.aspx"); Console.WriteLine (url.AbsoluteUri); // prints 'http://example.com/Logon.aspx' // relative ...
c# extraction html-agility-pack hyperlink
asked by Duncan Smart

How to comprehend page redirection and load redirected pages with HtmlAgilityPack

Assuming the document is relatively well-formed, I suppose you could do something like this:...static string GetMetaRefreshUrl(string sourceUrl) { var web = new HtmlWeb(); var doc = web.Load(sourceUrl); var xpath = "//meta[@http-equiv='refresh' and contains(@content, 'URL')]"; var refresh = doc.DocumentNode.SelectSingleNode(xpath); ...
c# html-agility-pack redirect
asked by Jeff Mercado

C# HAP "System.Net is a programming language. The remote name could not be resolved due to a WebException "uniqueness

var next = document.DocumentNode.SelectNodes("//td[@class='botpg-next']/a"); ...Returns a ...node... object and not a ...string.... You need to use one of the properties of this object, likely to be somethign like ...href... or ...link... and use this accordingly.
c# html-agility-pack
asked by ChrisBint

C# +HTMLAgilityPack: retrive background-url value

Try code below. Extract background-image url (string between brackets) with regex and replace it with new image. Now remove style attribute and add new (style with replaced image). ...This will work with all properties values and formats. ... foreach (HtmlNode bodyNode in doc.DocumentNode.SelectNodes("//body")) { ...
c# css html-agility-pack
asked by tilda

Getting the value of the 'href' inside of a div in HTMLAgilityPack in C#

I am trying to grab the value of a "href". The code is something like this:... <div class="s_newsbox" style="font-size:12px; vertical-align:middle; overflow: hidden; float:left; margin:10px; margin-bottom:15px; height: 270px; width:280px; border-radius:6px; position:relative; text-align:center; padding:0px"> <div style="backgro...
c# href html-agility-pack xpath
asked by Cente

How do I get direct URL of the .mp4 video using C#?

I need some sort of algorythm that would extract the link from mp4engine. ...Here is the example of a page I want to scrap....Desired output in this case would be: ...http://mp4engine.com:182/d/a2chmyndcqqgkpskitclvbgu5pgwxve2vmlrdsctpwbte2flb4i4hrz6/.hack_Roots... (Dub) Episode 001-360p.mp4...I tried to use ...HtmlAgilityPack... to get the player ...
c# html-agility-pack video web-scraping windows-phone
asked by Reynevan

C# HtmlAgilityPack TypeAccessException when loading page from Url

I am using Windows Phone 8.1 which I probably needed to mention in the question. The following is working....private async Task GetHtmlDocument(string url) { HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(url); request.Credentials = new LoginCredentials().Credentials; try { WebResponse myResponse = await req...
c# exception html-agility-pack request windows-mobile
asked by Josh Brass

html agility pack url scraping-- getting full html link

Hi I am using html agility pack from the nuget packages in order to scrape a web page to get all of the urls on the page. The code is shown below. However the way it returns to me in the output the links are just extensions of the actual website but not the full url link like ...http://www.foo/bar/foobar.com.... All I will get is "/foobar". Is ther...
c# html-agility-pack url web-crawler web-scraping
asked by Jonathan

How to get URLs on page with HTMLAgilityPack, when the Source does not contain the URLs?

I am trying to scrape the KB Urls from this page: ...https://support.microsoft.com/en-us/kb/894199...On the page, there are URLs such as: ...https://support.microsoft.com/kb/2976978...If you open up the developer tools in Chrome, it shows that data is contained like this:...<div class="indent"> <a id="kb-link-142" href="https://support.microsoft....
c# html html-agility-pack
asked by Fuzz Evans

How to extract meta tags of a series of URLs without downloading whole html in c#

I want to extract title , description and keywords of a seris of URLs ... I have this code ... WebClient x = new WebClient(); string pageSource = (x.DownloadString(url)); query.title = Regex.Match(pageSource, @"\<title\b[^>]*\>\s*(?<Title>[\s\S]*?)\</title\>", RegexOptions.IgnoreCase).Groups["Title"].Value; ...But I do not want to download ...
asp.net c# html html-agility-pack metadata
asked by mary

Fastest Entity Framework Extensions

Bulk Insert
Bulk Delete
Bulk Update
Bulk Merge
View more on Stack Overflow

Prime Library

Performance

Expression Evaluator

More Projects...

Related

Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow
Licensed under: CC-BY-SA with attribution
Not affiliated with Stack Overflow