How to start a Classified Ads Aggregator?
I would like to create a website that is essentially a classified ads aggregator. It would scrape and aggregate the ads from local websites posting classified ads in several categories such as buy/sell, help wanted, etc. It would then display them in similar categories. The user would be able to sort them by price, location, etc. The site would also accept the ads from users.
The website will target the local market in one of the European countries. There are several dozens of local websites posting classified ads, either stand alone, or online versions of newspapers. I want my site to pull these ads and display in organized fashion for the user.
There are sites using this model, such as oodle.com, or kijiji.com. However these are huge sites in scope. On the other hand, my project is targeting only 30-40 websites for now.
Where can I find somebody who might be able to do this (I am not coder)?
I see obstacles at the outset:
1. overcoming the occasional changes in the targeted websites.
2. the site will be non-English
3. while basic ads categories are very similar, they are NOT spelled out exactly alike from website to website?
4. I am on my own, no big $$ sponsors
5. above 4 are just the ones that are coming to my mind (not a developer mind)
I have a ready-made solution
I can see that post is really old. However, if it concerns anyone, I have a solution available which aggregates all classified ads data in an organized manner. Currently I have added around 50 websites across various languages and region. The system is very much customization, that means, if you need to add new website, it's quite easy.
Reply to this thread if you need this.
Full-Automated Classified Website Aggregator scraping 12,000 URLs
Take a look at findmestuffs.com It is a classified website aggregator, aggregating listings from around 12,000 URLs ( All Indian classified websites ). The listings are organized in 18 categories as listed on the website. The website automatically updates for new listings on daily basis. The entire system is fully automated and does not require any maintenance and update. The current system is capable of scraping around 100,000 URLs on daily basis. The cost of running the entire system ( website + scraping system ) is 30$ per month.
I am looking to sell the website. If you are interested, please get in touch with me at a[at]amitkumargupta.com I will be happy to provide post-sale support as well.