c# - Webbrowser in ASP.Net - accessing DOM of loaded page -


i'm trying screen scrape web page "http://reading.beatthestreet.me/" type in card number , displays point score - done via ajax (try card number 123456)

i trying via webbrowser control in asp.net page. seems load ok bit scrape ajax generated results doesn't work - return blank

the class here

using system; using system.collections.generic; using system.linq; using system.web; using system.threading; using system.windows.forms;  namespace beat_the_street { public class customwebbrowser {       protected string _url;     protected string _cardnumber;     string score = "";       public string getcardscore(string cardnumber)     {         _url = "http://reading.beatthestreet.me/";         _cardnumber = cardnumber;         // webbrowser activex control must run in         // single-threaded apartment create thread create         // control , generate thumbnail         thread thread = new thread(new threadstart(getcardscoreworker));         thread.setapartmentstate(apartmentstate.sta);         thread.start();         thread.join();         string s = score;         return s;     }       protected void getcardscoreworker()     {         using (webbrowser browser = new webbrowser())         {             //  browser.clientsize = new size(_width, _height);             browser.scrollbarsenabled = false;             browser.scripterrorssuppressed = true;             browser.navigate(_url);              // wait control load page             while (browser.readystate != webbrowserreadystate.complete)                 application.doevents();              //set text of search input             htmlelement txttextfield = browser.document.getelementbyid("edit-card-number");             txttextfield.innertext = _cardnumber;             system.threading.thread.sleep(1000);              //perform click on search button             htmlelement btnsubmit = browser.document.getelementbyid("edit-submit");             btnsubmit.focus();             btnsubmit.invokemember("click");              // sleep allow population              (int = 0; < 30; i++)             {                 system.threading.thread.sleep(1000);                  htmlelement resultsboxtemp = browser.document.getelementbyid("box");                 if (resultsboxtemp != null)                 {                     system.threading.thread.sleep(3000);                     = 35; // exit                 }             }               // results                                         htmlelement resultsbox = browser.document.getelementbyid("box");             if (resultsbox != null)             {                 string results = resultsbox.innertext;                 if (results != null)                 {                     string pointsscore;                     pointsscore = results.replace("\r", "").replace("\n", "").replace("you have ", "");                     pointsscore = pointsscore.substring(0, pointsscore.indexof(" "));                     score = pointsscore;                 }             }          }     } } }

it gets called this

customwebbrowser browser = new customwebbrowser(); string s = browser.getcardscore("326325");


Comments

Post a Comment

Popular posts from this blog

c++ - Difference between pre and post decrement in recursive function argument -

i have following sample code used pre-decrement void function(int c) { if(c == 0) { return; } else { cout << "dp" << c << endl; function(--c); cout << c << endl; return; } } this function give output input 4 : dp3 dp2 dp1 dp0 0 1 2 3 but when use post decrement void function(int c) { if(c == 0) { return; } else { cout << "dp" << c << endl; function(c--); cout << c << endl; return; } } output goes in infinite loop dp4 can explain me in detail why happens ? this happens because function(c--) called same value of c , when finishes c decremented. recursively called, hence called same value no chance of return , hit stack overflow error. assume this, int x = 1, y = 0; y = x++ result y == 1 , x == 2. if y = ++x , bot x , y 2.
Read more

php - Nothing but 'run(); ' when browsing to my local project, how do I fix this? -

i added new project. made mistake in projectname.conf file in sites-available apache2, led me reinstalling apache2. after reinstalling , re-enabling projects on every page of every project .. <body> run(); </body> .. i've run composer update, restarted service, restarted pc, checked config files, tried disabling new project. there nothing in error log, , access.log: 127.0.0.1 - - [15/may/2015:01:40:47 +0200] "get / http/1.1" 304 181 "-" "mozilla/5.0 (x11; ubuntu; linux x86_64; rv:38.0) gecko/20100101 firefox/38.0" maybe i'm forgetting apache2 reinstall? don't think did different last time installed it. looks haven't setup php correctly. take @ this great guide , maybe you're forgetting link php config apache2.
Read more

php - How can I echo out this array? -

i don't know how go grabbing data in variable , put foreach loop. class tree{ private $info = array( array('name'=>'jim','state'=>'nu','company'=>'nu','phone'=>array('cell'=>'5615111111','office'=>'5611111111'),'email'=>array('primary'=>'exs@example.com','ex@there.com')), array('name'=>'joe smith','city'=>'phoenix','phone'=>'4805551111','email'=>'jsmith@some_email.com'), array('name'=>'john doe','city'=>'chandler','company'=>'doe co.','email'=>array('jdoe@gmail.com','personal'=>'email@email.com'),'phone'=>'6025550002') ); } if you're inside of class, can access private variable using $this->variablename . example, i...
Read more