Reference: Scalability of Syndication Feeds
- Feed Analysis: Recap & Posting Index
- The Syndication Sky is Falling!
I do mean to pick on the general notion that the Web can’t scale enough for syndication’s purposes; the Web provably does scale, and like gangbusters.
- Discussion on the Atom-syntax ML: Vogels, Nottingham
- RSS Traffic Burdens Publisher's Servers [technorati]
"Our hourly RSS surge has all the characteristics of a distributed DoS attack [...]"
- RSS = DoS?
Is anybody working on a solution?
- RSS Scaling Issues
Because Bloglines has a vested interest in increasing RSS (in the generic sense) adoption, we're looking at ways we can help. We are working on a couple of projects right now, and we're of course open to suggestions.
- RSS Scaling Problems: How Can We Help?
Jeremy Zawodny: "Thoughts and ideas out there?"
- HTTP Delta
Something that came up as a partial solution at one of the blogger meetups was the HTTP delta proposal.
- NNTP syndication test
one of the proposed solutions is to build on top of a protocol that fits the syndication model better than HTTP. one called NNTP already exists and is in widespread use as the foundation for network newsgroups
- When RSS Traffic Looks Like a DDoS
We've seen similiar problems over the years. RSS (or as it should be called, "Speedfeed") is such a useful thing, it's unfortunate that it's ultimately just very stupid.
- Will RSS Readers Clog the Web?
"Once all the covered wagons show up and an RSS reader is folded into Microsoft's Internet Explorer or Outlook, we're doomed," Murphy said.
- The RSS Traffic and DDoS Meme
- Getting the Word Out
The functionality is clearly there in HTTP. The word is clearly not getting out to everywhere it should be.
- More on RSS bandwidth consumption
- "RSS Growing Pains"
- RSS growing pains
- IT Myth 6: IT doesn't scale
For any technology, the statement “X doesn’t scale” is a myth.
- [2004-09-09] Full text RSS on MSDN gets turned off
RSS is broken, is what happened. It's not scalable when 10s of thousands of people start subscribing to thousands of separate RSS feeds and start pulling down those feeds every few minutes
- [2004-09-13] Once More: Polling does not Scale, by Werner Vogels.
Whatever duct tape you put on this problem (e.g. make the subscribers poll less frequently) will get ripped off again when the growth to the next order of magnitude will happen. And if atom/rss is indeed such a great thing, this growth is indeed something that will happen.
- [2004-09-28] New Bloglines Web Services Selected by FeedDemon, NetNewsWire and Blogbot to Eliminate RSS Bandwidth Bottleneck.
Now, instead of thousands of individual desktop PCs independently scanning news sources, blogs and web sites for updated feeds, Bloglines will make low-bandwidth requests to each site on behalf of the universe of subscribers and cache any updates to its master web database. Bloglines will then redistribute the latest content to all the individuals subscribed to those feeds via the linked desktop applications.
Daily Links
- The Next Great Web Application
What I imagine is a rich client type of application that is a combination of Web browser + RSS/Atom Aggregator + Content Management + Conversation Management (email/IM/weblog/wiki) + Social management (friend-of-a-friend list) + Entertainment Management (play lists) + Information management.
Where is the download?
- developerWorks : Blogs, including Grady Booch and Mark Pilgrim.
- PubSub REST API service
Daily Links
- HowStuffisMade - "HowStuffisMade is an encyclopedia of and manufacturing processes and labor conditions involved in the production of contemporary products. This information is often hard to obtain and little of this material exists on the web. The encyclopedia is an an independent academic webbased Twiki publication that uses primarily visual documentation.". More information on the project's page.
Daily Links
- Tasks Pro, a powerful web-based task manager. Also check Tasks2.0 and Tasks (a free personal edition).
- The Social Computing Research Lab List, a list of research labs on social computing.
- pagerankstatus, a mozilla plug-in.
- Publications, installations, presentations & workshop papers, Danah Boyd papers on social networks.
- The Future of Information Management, via Tom Wilson.
- RSS Traffic Burdens Publisher's Servers, architectural problems starting to appear. Related research: Feed Analysis: Recap & Posting Index.
- Has MasterCard gone on a phishing trip, leaving the back door wide open?, cross site scripting and script injection.
- Two usability studies: The Effects of Contrast and Density on Visual Web Search and Reading Online Text: A Comparison of Four White Space Layouts, from a psychology department.
- Three web-based calendar systems in PHP: PHP iCalendar (nice looking but only a viewer of iCal files), Kronolith Calendar Application (from horde) and WebCalendar.
- IAMCR 2004 Papers, online from July 25th.
Daily Links
- PunBB About, " In short, PunBB is a fast and lightweight PHP powered discussion board. It is released under the GNU Public License. Its primary goal is to be a faster, smaller and less graphic alternative to otherwise excellent discussion boards such as phpBB, Invision Power Board and vBulletin.".
- Making TeX Work, online book.
