dcsimg
www.webdeveloper.com
Results 1 to 3 of 3

Thread: Using the best tools/method for the job

Hybrid View

  1. #1
    Join Date
    Dec 2013
    Posts
    1

    Using the best tools/method for the job

    Hi,

    I want to create a website which will srape a number of different websites to obtain details from them and store the information into a database. I want to do daily scraping and we are talking around 20,000 pages to scrape. For this kind of task, I want to use cloud services and I am looking at Amazon EC2 service.

    The code that will do the scraping is in PHP, and I have a database table with the 20,000 pages to go and fetch. What is the best way to do a process like this? Services like this is new to me.

    Ususally I would do a cron service to call the page however im sure there is a better, more efficiant way of doing this.

    Any advice?

  2. #2
    Join Date
    Jan 2014
    Posts
    12
    I would definately suggest a letter, or even an email but definately something in writing. Below is an example of a follow up letter. Hope it helps and good luck with the job hunt

  3. #3
    Join Date
    Jan 2014
    Posts
    120
    PHP tools is best.....

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center



Recent Articles