Hi, I need help logging in to a site remotely, storing the cookies, then screen scraping a page that uses its cookies.
I have the login working fine but it redirects to the page that the site has listed.
Post your code.
You may want to try biterscripting IS (Internet Session - http://www.biterscripting.com/helppages_automatedinternet.html ). Here is code that I extracted from one of my scripts.
# A string variable to store source for a web page
var str page
# Start a browser session.
# "s" is the session name.
isstart "s" "Page Scrape" "Mozilla/4.0"
# Connect to webserver.
# I am using a fictitious address.
isconnect "s" "http://www.site9476zyx.com"
# Exchange cookies.
script SS_ISCookies.txt from("s") to("s")
issubmit "s" "/loginpage.php" "login=IAmMe" "password=MyPassword" > $page
# Parse $page - assuming you want to extract a table from the page
# and put it in .CSV format.
echo $page > "tempfile.html"
script SS_WebPageToCSV.txt page("tempfile.html")
# We are done. Disconnect and close session (we will be nice).