php - Page loading progressively -


i'm building basic scraping tool, i'm running locally on laptop, backup data cms.

the basic procedural script wrote loads urls database , each url, scraps page, saves content database , echoes page saved.

the problem when manages go through urls @ once (a few hundreds of @ times), output of script loads progressively in browser.

in firefox can see part of echo statements few pages (indicating pages saved), rest comes in batches , @ bottom firefox indicates me "transferring data localhost..."

i'm confused because thought when php script runs, outputs , sends response single block, when it's done, , not this, progressively.

maybe i'm forgetting in code? think it?

here basic structure of script:

<?php  try {   // login cms   // connect db urls    ($i = 0; $i < count($urls); $i++) {     // data page     $data = $scraper->getdata($urls[$i]);      // store data page     if ( $db->save($data) ) {       echo 'data saved "' . $url[$i] . '"<br>';     } else {       echo 'problem when saving data "' . $url[$i] . '"<br>';         }   } }  catch (exception $e) {     echo $e->getmessage() . '<br>'; }  ?>

i thought of using output buffering thing if script fails or times out, thought i'm not going output @ all.

some type of output buffer want use. append these string , echo string when you're done:

<?php  try {   // login cms   // connect db urls   $html = '';   ($i = 0; $i < count($urls); $i++) {     // data page     $data = $scraper->getdata($urls[$i]);      // store data page     if ( $db->save($data) ) {       $html .= 'data saved "' . $url[$i] . '"<br>';     } else {       $html .= 'problem when saving data "' . $url[$i] . '"<br>';         }   }   echo $html; } catch (exception $e) {     echo $e->getmessage() . '<br>'; }  ?>

just echoing in php starts sending document immediately, if script not finish loading. why seeing happen line-by-line.

you @ ob_start() http://php.net/manual/en/function.ob-start.php . standard way of echoing were, holding output until ready show all.

as @lithis mentioned in comment, if want wait display information after script has stopped running, wrap in 

<div style="display:none"></div>

then use javascript on document.ready change display type "block" avoid appearing line-by-line.


Comments

Post a Comment

Popular posts from this blog

c++ - Difference between pre and post decrement in recursive function argument -

i have following sample code used pre-decrement void function(int c) { if(c == 0) { return; } else { cout << "dp" << c << endl; function(--c); cout << c << endl; return; } } this function give output input 4 : dp3 dp2 dp1 dp0 0 1 2 3 but when use post decrement void function(int c) { if(c == 0) { return; } else { cout << "dp" << c << endl; function(c--); cout << c << endl; return; } } output goes in infinite loop dp4 can explain me in detail why happens ? this happens because function(c--) called same value of c , when finishes c decremented. recursively called, hence called same value no chance of return , hit stack overflow error. assume this, int x = 1, y = 0; y = x++ result y == 1 , x == 2. if y = ++x , bot x , y 2.
Read more

c# - Retrieve google contact -

i'm using .net retrieve contact info google contact. however, retrieves including sent email not stored in contact. there anyway can retrieve contact contact? here code requestsettings rs = new requestsettings("", email, password); rs.autopaging = true; contactsrequest cr = new contactsrequest(rs); feed<contact> contacts = cr.getcontacts(); foreach (contact contact in contacts.entries) { name name = contact.name; response.write(name.givenname + " " + name.familyname + "<br/>"); foreach (email emailid in contact.emails) { response.write(emailid.address + "<br/>"); } response.write("<br/>"); } im using google.gdata.contacts package nuget v 2.2.0 string redirecturi = "urn:ietf:wg:oauth:2.0:oob"; // build base oauth2 parameters var oauth2
Read more

javascript - How to insert selected radio button value into table cell -

i have 5 radio buttons <input type="radio" id="rating">1 <input type="radio" id="rating2">2 <input type="radio" id="rating3">3 <input type="radio" id="rating4">4 <input type="radio" id="rating5">5 i have 1 table <table id="mytabledata" border="1" style="width:100%"> <tr id="templaterow"> <th>ratings</th> </tr> </table> one add button <input type="button" id="add" value="add" onclick="addradiovalue()"> i've written code dynamically add rows table, when select radio button , click on add button, value of selected radio button should inserted new cell within table ratings. i able thing text box, i'm not able radio button. can me? your problems didn't have name set on radios , tryi
Read more