Webmastersite.net
Register Log In

RSS Feed taking to long to process

Comments on RSS Feed taking to long to process

Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
Posted Nov 11, 2009 - 8:29 PM:

Im trying to proccess an RSS feed, but it taking like 5 mins just to import a few posts. It takes so long, that I dont even bother waiting for it to import all of the links.

im trying to import:

feeds.feedburner.com/Ilovey...rtshirtYourT-shirtMagazine

&

http://hideyourarms.com/feed/
Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
Posted Nov 13, 2009 - 8:07 AM:

any update to this problem?
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
Posted Nov 16, 2009 - 5:42 AM:

Sorry, things have been really busy lately and I'm falling behind. I'm seeing it hanging and stepping through to figure out where right now.
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
Posted Nov 16, 2009 - 5:52 AM:

Do you have blog pinging switched on at Admin -> Settings -> Switches? That seems to be what's causing the hang for me, because it's spawning pings to various sites for each listing in the feed. I'll have feed-based additions skip the pinging.

There's also an unnecessary repetition of a category listing count update, but that wouldn't cause a 5 minute delay.
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
Posted Nov 16, 2009 - 6:09 AM:

Nevermind, there's more to it than the pings. Continuing to step through it.
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
Posted Nov 16, 2009 - 6:26 AM:

The second problem was pagerank checks. Fixed it to timeout properly after 2 seconds.
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
Posted Nov 16, 2009 - 6:37 AM:

Best to skip pagerank entirely and let it autofill later, actually. Done. Your feed examples now load in 3 seconds.
Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
Posted Nov 16, 2009 - 8:57 AM:

awesome work man! it works beautifully now. and I knew you were busy. we all need time to do other things, so no problem.

One problem tho. when I added one of the feeds, it didn't process any of the posts. I looked at the feed and thought maybe it's because there's images in the feed.

Could you please make it so the script can process html, flash, javascript. Or even better, make it a "swtich" so we can turn on/off html, javascript, flash processing.

I really need this option, thanks.
Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
Posted Nov 16, 2009 - 9:03 AM:

I also found a bug with the category select on the submitfeed page ( /suggest.php?action=addfeed)

When you change to a different category and you dont have a link in the "URL" field; the page reloads and gives you an error message at the top of the page:

------------------------------------------------------------------------------

Error occurred at www.stylelogger.com/suggest...ction=addfeed&filled=1 on 2009-11-16 16:59:15. Error text: Error #2: 'file_get_contents() [<a href='function.file-get-contents'>function.file-get-contents</a>]: Couldn't resolve host name' in /home/orbiwan/public_html/includes/filefunctions.php on line 435.
Step 1 of backtrace:
File: /home/orbiwan/public_html/includes/filefunctions.php
Line: 435
Function: file_get_contents
Arguments: http:// Resource id #32


Step 2 of backtrace:
File: /home/orbiwan/public_html/includes/filefunctions.php
Line: 799
Function: geturl
Arguments: http:// 3


Step 3 of backtrace:
File: /home/orbiwan/public_html/includes/addfeed.php
Line: 14
Function: extractfeedurl
Arguments: http://


Step 4 of backtrace:
File: /home/orbiwan/public_html/suggest.php
Line: 92
Function: require
Arguments: /home/orbiwan/public_html/includes/addfeed.php
------------------------------------------------------------------------------


you can still submit the feed successfully, but it's a tad anoying.
Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
#10 - Quote - Permalink
Posted Nov 16, 2009 - 9:05 AM:

And one more thing. feedburner.com feeds dont seem to work. the script gives me an error saying "That feed is invalid or unavailable. Please check the URL you supplied"
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
#11 - Quote - Permalink
Posted Nov 17, 2009 - 11:20 AM:

Fixed the category change for next release.

Your feedburner link at the top is what I was testing with, works for me.

when I added one of the feeds, it didn't process any of the posts. I looked at the feed and thought maybe it's because there's images in the feed.

Please let me know what feed this is so I can see.

Could you please make it so the script can process html, flash, javascript. Or even better, make it a "swtich" so we can turn on/off html, javascript, flash processing.

I guess you mean in feeds? I believe HTML in feeds already gets kept when the can use html permissions is set for the usergroup, or gets converted to equivalent wsn codes where possible otherwise, right? Flash objects are called in HTML so go with that permission.

Allowing javascript to be run by feed submitters presents a lot of security issues of course, so that would require a tweak or setting defaulted to off. If you need it now, I can do it for $40. Otherwise, please post the suggestion in the feature suggestions forum because I'll never find this again in here when I'm looking at 6.0 possibilities.
Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
#12 - Quote - Permalink
Posted Nov 18, 2009 - 8:21 AM:

That's so freaking wierd, feedburner is working now. But it's this feed that has the images, and the images from the feed; dont show up in my posts: feeds.feedburner.com/Ilovey...rtshirtYourT-shirtMagazine
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
#13 - Quote - Permalink
Posted Nov 23, 2009 - 6:44 PM:

I see the problem is I have a special "get rid of flickr html gunk" filter that applies when the feed descripion contains flickr.com (as those images do). I'll change that to only apply when the feed url contains flickr.com.
Orbitalz
Experienced

Usergroup: Customer
Joined: Dec 19, 2004

Total Topics: 15
Total Comments: 54
#14 - Quote - Permalink
Posted Nov 24, 2009 - 10:04 AM:

so... images will show up now (well, in mean the next script update) ?
Paul
developer

Usergroup: Administrator
Joined: Dec 20, 2001
Location: Diamond Springs, California

Total Topics: 61
Total Comments: 7868
Paul
#15 - Quote - Permalink
Posted Nov 29, 2009 - 9:17 PM:

Flickr images in feeds work for me since the time of the first release after that post. I believe the post was after the last stable release, so just in the 5.1.14 betas.
Search thread for
Download thread as
  • 0/5
  • 1
  • 2
  • 3
  • 4
  • 5



Sorry, you don't have permission to post posts. Log in, or register if you haven't yet.