webfeed

[cafead]

I have to replace a free newsfeed on my site (it has become prohibitively expensive). We intend to use a spider creator to create spiders to crawl several sites and harvest headlines and links to create our own feed. The spider will write the results to a mysql database.

I need suggestions about the best way to display the data once I have it. Should I create a script that will transform it into an rss document and use a channel to display it (I know about this in theory but I have never done it). Or would it be better to use an simple asp recordset to display it? I really need advice to on the most efficient way, in terms of server resources, to display the data.

Also if there are better ways to capture the data and store it, I would be interested in this advice also.

Thanks for the information

Wallace

[khalidali63]

if its possible,I'd say you should get the data in XML,and once you have that then you can use XSL/XSLT to transform it to HTML format,for web I'd say is probably the best solution.
But thats just me...:-)

Khalid

[cafead]

Thanks for the recommendation. Can you give some information on the best way to transform the data into xml. Also, what will be the best way to "call" the feed into the page where it will be displayed.

Thanks again for the help.

[khalidali63]

hunm.Well,I have not done what you are doing therefore my point of view may not be the best opinion on this issue.
To convert the data to XML format,I'd use any technology which you guys are are lready familiar.
I have use Java's JAXP(SAX OR DOM) APIs for XML manipulation and parsing.That would be the best aproach(again my pinion).Once you have done that you can write an XSL/XSLT routine for your desired results and you can apply that using java as well.
Khalid