Skip to content

Instantly share code, notes, and snippets.

Created November 5, 2011 16:37
Show Gist options
  • Save cjoudrey/1341747 to your computer and use it in GitHub Desktop.
Save cjoudrey/1341747 to your computer and use it in GitHub Desktop.
Lazy-rendering in PhantomJS
// This example shows how to render pages that perform AJAX calls
// upon page load.
// Instead of waiting a fixed amount of time before doing the render,
// we are keeping track of every resource that is loaded.
// Once all resources are loaded, we wait a small amount of time
// (resourceWait) in case these resources load other resources.
// The page is rendered after a maximum amount of time (maxRenderTime)
// or if no new resources are loaded.
var resourceWait = 300,
maxRenderWait = 10000,
url = '!/nodejs';
var page = require('webpage').create(),
count = 0,
page.viewportSize = { width: 1280, height : 1024 };
function doRender() {
page.onResourceRequested = function (req) {
count += 1;
console.log('> ' + + ' - ' + req.url);
page.onResourceReceived = function (res) {
if (!res.stage || res.stage === 'end') {
count -= 1;
console.log( + ' ' + res.status + ' - ' + res.url);
if (count === 0) {
renderTimeout = setTimeout(doRender, resourceWait);
};, function (status) {
if (status !== "success") {
console.log('Unable to load url');
} else {
forcedRenderTimeout = setTimeout(function () {
}, maxRenderWait);
Copy link

Thanks a lot.
I made an account at GitHub to thank you.

Copy link

Thanks a lot.

Copy link

I made a node module which was inspired by this, check it out !

Copy link

frankred commented May 5, 2014

Thank you, I do not use this for making a screenshot, but to give JS AJAX pages some time to build up the page, after that I can scrape usefull information...

Copy link

Can you please advice why does this script fail for "" ?

Copy link

Hooray, this is the only code I found so far on this topic which is really working as intended, thank you!

Copy link

This is fantastic. Thank you very very much for this snippet!

Copy link

Thank you ! It' work fine and it's so simplier !

Copy link

sramzan commented Oct 3, 2016

Thank you!... I've been having an issue where phantom would not wait for all resources to load. My initial method of static wait times wasn't working, so this was an awesome solution.

Copy link

dmmfll commented Nov 5, 2016

Thanks for this. It solved a lot of issues for some code I was writing.

Copy link

dvjunior commented Apr 7, 2017

How can I set proxy authentication? I tried this: phantomjs --proxy-auth=user:pass myTwitter.js but response is 401.
I have a script for screen capture and I and I was able to authenticate with the same way up.

ex: phantomjs --proxy-auth=user:pass --ignore-ssl-errors=true myScript.js output.png timeout 1400(px) 700(px)


Copy link

dvjunior commented Apr 7, 2017

I was able to solve with page.settings.userName and page.settings.password, but this script twitter.js did not solve my problem, was animation in page, the data is loaded via ajax, in my case, phantomjs render the animation.

Copy link

Thank you so much for share this!

Copy link

ghost commented Aug 28, 2017

Thanks, it helps!!!

Copy link

Nice script. A small side note; why do you declare the variable forceRenderTimeout? This one is never used and setTimeout can be called without an assignment to a variable.

Copy link

http91 commented Nov 17, 2017

It worked great!
Thanks a lot!

Copy link

opicron commented May 12, 2018

This is actually doing nothing:

renderTimeout = setTimeout(doRender, resourceWait);

Increase the resourceWait and set to:

renderTimeout = setTimeout(function () {
                }, resourceWait);

Copy link

Excellent. Thank you!

It works with everything I tried except this:

I do not get the rendering of the input for username, password and the submit button.
Any ideas why? Really thankful for your code.

Copy link

Works like a charm .
Thank you .

Copy link

cbilgili commented Aug 7, 2019

Thank you! After 5 years, it's still working!

Copy link

bgerd commented Mar 7, 2020

Thank you! Feb-2020 and still good

Copy link

How can I get through the five seconds wait for cloudflare?
Tried this, but its still getting stuck at the wait for 5 seconds as cloudflare redirects you.

Copy link

adeaji61 commented May 27, 2021

i tried, but it didn't work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment