Reference: Scalability of Syndication Feeds

• Feed Analysis: Recap & Posting Index


• The Syndication Sky is Falling!

  I do mean to pick on the general notion that the Web can’t scale enough for syndication’s purposes; the Web provably does scale, and like gangbusters.



• Discussion on the Atom-syntax ML: Vogels, Nottingham


• RSS Traffic Burdens Publisher's Servers [technorati]

  "Our hourly RSS surge has all the characteristics of a distributed DoS attack [...]"



• RSS = DoS?

  Is anybody working on a solution?



• RSS Scaling Issues

  Because Bloglines has a vested interest in increasing RSS (in the generic sense) adoption, we're looking at ways we can help. We are working on a couple of projects right now, and we're of course open to suggestions.



• RSS Scaling Problems: How Can We Help?

  Jeremy Zawodny: "Thoughts and ideas out there?"



• HTTP Delta

  Something that came up as a partial solution at one of the blogger meetups was the HTTP delta proposal.



• NNTP syndication test

  one of the proposed solutions is to build on top of a protocol that fits the syndication model better than HTTP. one called NNTP already exists and is in widespread use as the foundation for network newsgroups



• When RSS Traffic Looks Like a DDoS

  We've seen similiar problems over the years. RSS (or as it should be called, "Speedfeed") is such a useful thing, it's unfortunate that it's ultimately just very stupid.



• Will RSS Readers Clog the Web?

  "Once all the covered wagons show up and an RSS reader is folded into Microsoft's Internet Explorer or Outlook, we're doomed," Murphy said.



• The RSS Traffic and DDoS Meme


• Getting the Word Out

  The functionality is clearly there in HTTP. The word is clearly not getting out to everywhere it should be.



• More on RSS bandwidth consumption


• "RSS Growing Pains"


• RSS growing pains


• IT Myth 6: IT doesn't scale

  For any technology, the statement “X doesn’t scale” is a myth.



• [2004-09-09] Full text RSS on MSDN gets turned off

  RSS is broken, is what happened. It's not scalable when 10s of thousands of people start subscribing to thousands of separate RSS feeds and start pulling down those feeds every few minutes



• [2004-09-13] Once More: Polling does not Scale, by Werner Vogels.

  Whatever duct tape you put on this problem (e.g. make the subscribers poll less frequently) will get ripped off again when the growth to the next order of magnitude will happen. And if atom/rss is indeed such a great thing, this growth is indeed something that will happen.



• [2004-09-28] New Bloglines Web Services Selected by FeedDemon, NetNewsWire and Blogbot to Eliminate RSS Bandwidth Bottleneck.

  Now, instead of thousands of individual desktop PCs independently scanning news sources, blogs and web sites for updated feeds, Bloglines will make low-bandwidth requests to each site on behalf of the universe of subscribers and cache any updates to its master web database. Bloglines will then redistribute the latest content to all the individuals subscribed to those feeds via the linked desktop applications.