Forums / General / Importing RSS feeds questions

Importing RSS feeds questions

Author Message

Paul Forsyth

Tuesday 25 May 2004 10:13:19 am

I see that RSS imports creates a set of objects based on the RSS setup choices in the admin. Now that i see this in operation on a local site I wonder whether this design is for the best.

The creation of an object per feed item does not seem right to me. Information from other sites is temporary information, to be replaced on the next update. I would instead update a single object with the latest information. An override template could style the object as necessary.

Also, importing from a feed doesn't clear up existing objects. Shouldn't there be X items from a feed at a time? Over a few updates the list grows. You can limit the display but having lots of 'dead' objects in the admin/db is unneccessary.

paul

--
http://www.visionwt.com

Paul Borgermans

Tuesday 25 May 2004 10:36:24 am

Hi Paul

For me, the current design is OK, provided the links remain valid for a while ... that's where the urlcheck comes into play.

It is not necessarily so temporary in nature. YMMV of course

Regards and see you next week

-paul

eZ Publish, eZ Find, Solr expert consulting and training
http://twitter.com/paulborgermans

Paul Forsyth

Tuesday 25 May 2004 10:58:27 am

Yes, it is a mileage question. For me the design eZ have chosen for RSS import is wrong. I use RSS largely to find new information, which is linked to. I don't want to keep it locally for all time. Nor do i want to be forced to manually remove the information.

A better choice on RSS behaviour would be nice.

Looking forward to next week!

paul

--
http://www.visionwt.com

Tony Wood

Tuesday 25 May 2004 11:33:48 am

Paul,

I think there needs to be two types of RSS feeds. The first type should be as it is now; a method of sharing content between sites.
The second should be the more usual "show me what's new" type of feed. This should have a maximum number of feeds it should store and a document it stores them in.
The main reasons for this are to
1) cut down the amount of time it takes to load a page that contains an RSS feed.
2) Reduce bandwidth as the server only need to go and get the information once.

tony
--
http://www.visionwt.com

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

Paul Forsyth

Tuesday 25 May 2004 12:46:14 pm

I am still of the mind that its wrong to think of RSS as a method of sharing content between sites. The term 'content' is stretching things. RSS is for notifying people *of* content, not delivering it.

paul

--
http://www.visionwt.com

Paul Borgermans

Tuesday 25 May 2004 12:59:43 pm

You are right on stretching "content" too far with RSS, but it is an easy way to get some "integration" between sites, like for linking several intranets. BTW, we also take the SOAP road for this.

Regards

-paul

eZ Publish, eZ Find, Solr expert consulting and training
http://twitter.com/paulborgermans

Tony Wood

Tuesday 25 May 2004 1:22:42 pm

I see RSS as one of the first steps in sharing content. The RSS feed shows you what is available. You then use SOAP or other protocol to go and grab the content should you need to. Of course you could just link to the content on the other site using the information in the RSS making the join seamless, apart form the lag as your server goes and grabs the content from a site you "hope" is up.
Its almost as if we need a seperate import/export feature that is dedicated to the "article" and SOAP that way we can choose what elemtns of an Article we what to share/import and then let the system do it.
IMHO I do feel that the current RSS import needs more thought to be useful.

tony

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

Tony Wood

Tuesday 25 May 2004 1:27:17 pm

This SOAP method would help with the problem of sharing content between intranet and internet sites. There are occasions where these cannot share the same database for secuirty reasons but they need to share some of the same articles. This SOAP method if taken to it natural next step could allow syncronisation between these boxes...

tony

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

Paul Forsyth

Tuesday 25 May 2004 1:32:16 pm

Ill add this as a bug tomorrow. Not as a suggestion because of the effect on performance over time.

For example, if we use rss import from the bbc website there will be around 10 new items per day. So for a cronjob running once a day you will get around 70 objects a week. Not the intended effect.

paul

--
http://www.visionwt.com

Tony Wood

Wednesday 26 May 2004 12:31:27 am

Paul,

I agree, but we need to check.

Is there anyone in the community using RSS imports in their current form? Would a change in functionality reck someones site?
(I wish we had a voting function on the site, we could vote on this then, ala Mandrake club http://www.mandrakeclub.com/modules.php?op=modload&name=RPM)

If no one is using it in it current form, it is safe to change. Otherwise a new type of RSS feature needs to be added.

tony
--
http://www.visionwt.com

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

Paul Forsyth

Wednesday 26 May 2004 3:14:19 am

It should be simple to offer a choice. Its not about removing functionality but addressing the design problem.

paul

--
http://www.visionwt.com

Paul Forsyth

Wednesday 26 May 2004 3:20:11 am

Okay its filed now:

http://ez.no/community/bug_reports/problem_with_importing_rss_feeds_design

paul

--
http://www.visionwt.com

nathaniel burbank

Wednesday 21 July 2004 9:56:55 pm

I just wanted to pipe up and say that the site I am building *depends* on the current way RSS is setup. I certainly don't want to see it taken away....

But I understand what you guys are saying, so I think it should be add as an option. Perhaps you could leave the "RSS Import" the way it is, and instead create a templet operator or special object that just fetches the latest headlines...

Nathaniel
http://politicalretort.org

Terry Grossman

Sunday 25 July 2004 5:00:07 pm

I thought I'd chime in with the absolute newbie point-of-view.

I couldn't get the RSS module to function, partly because of the cronjob requirements. I worked around it by using a third-party site/tool -- http://www.feedroll.com/rssviewer/ -- that generated javascript that pulls in the news and this was added into my template.

So, if you want some suggestions on how the RSS content should be re-designed, first I'd "fix" it before trying to make it "better". Yes, I know it works as-is, but it is way too complicated.

At least for a newbie ;)

Terry