LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices



Reply
 
Search this Thread
Old 01-17-2013, 02:04 AM   #1
laho
LQ Newbie
 
Registered: May 2009
Distribution: Debian, Ubuntu
Posts: 10

Rep: Reputation: 0
wget pages that load at scroll bottom


I played a little with wget, don't know it well. I'd like to use it in a script that would load Facebook timeline page down to a certain depth.

Since recently Facebook pages load additional content as the user scrolls to the bottom of the browser window. I haven't looked at how that's done, I'm assuming it's some Ajax thing.

Can wget trigger such additional loading?
 
Old 01-18-2013, 07:38 AM   #2
mina86
Member
 
Registered: Aug 2008
Distribution: Slackware
Posts: 412

Rep: Reputation: 172Reputation: 172
Run developer tools in your browser (every major one has something like that). It should have a network tab (or something like that) which will let you figure out URLs of the additional pages that are being loaded.

The second part of the puzzle is getting cookies right, but for that all you need to use is --load-cookies, --save-cookies and --keep-session-cookies.
 
  


Reply

Tags
wget


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Why do web pages that are taking forever to load suddenly load if you reenter the URL DJOtaku General 5 01-21-2012 11:47 AM
How to instant scroll bottom down with MC? ytd Linux - Newbie 5 04-29-2010 03:09 PM
The bottom menu bar on LQ pages - duplicate link. GrapefruiTgirl LQ Suggestions & Feedback 2 08-07-2009 11:47 AM
How do you scroll pages using top in Slack 9.1 ? lostboy Slackware 6 11-02-2003 03:06 PM
man pages scroll ? jamaso Linux - General 3 04-11-2002 05:19 PM


All times are GMT -5. The time now is 06:51 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration