CleverClogs

Experiments in writing, by Marjolein Hoekstra @OneNoteC

OnePipe : the Single-Button Generic Feed Filtering Bookmarklet

with 11 comments

“As far as I know OnePipe is the first solution to offer generic, on-the-fly feed filtering based on URL parameterization.”

OnePipe is a browser bookmarklet I created to filter any feed by topic. It’s simple to use: install the bookmarklet, navigate to any website whose feed you’d like to filter and click the OnePipe button. You’ll be prompted to enter any topic or word after which OnePipe will generate a custom feed that only contains those items that match your keywords. The exciting part about OnePipe is that it can be used over and over again.

Welcome, Lifehacker visitors. I’m very proud and grateful for Wendy Boswell’s announcement that OnePipe is now Download of the Day.

Before I explain the technical details let me illustrate OnePipe with a snapshot:

Onepipe_headline_animator_1

A typical use case: let’s assume I am visiting the FeedBurner blog Burning Questions. For the moment I’m really only interested in blog posts about their Headline Animator service. In fact, I would like to generate a feed based on just that custom keyword “Headline Animator“. With the OnePipe bookmarklet in place, I can just click the OnePipe button on my browser bookmarks toolbar, type in my topic. Next, a hyperlink pointing to the custom feed appears in a tiny rectangular pop-up in the top-left corner of the page. For convenience’s sake the hyperlinks that OnePipe produces automatically open the filtered feeds in a Grazr window.

Why the name OnePipe?
After processing the desired keyword, OnePipe calls upon the URL parameterization capabilities of Yahoo! Pipes to generate the feed. Look closely at the full URL processed by Grazr: there are really only a couple of parameters:

http://pipes.yahoo.com/pipes/pipe.run?_id=dCunRCfP2xGZfglMOUVYtA&_render=rss&query=Headline Animator&feedurl=http://feeds.feedburner.com/BurnThisRSS2
  1. a URL pointing to the Pipe I created (direct link: OnePipe : The CleverClogs Generic Feed Filter)
  2. the “_render=rss” suffix to force the output to RSS
  3. a query parameter
  4. the URL of the feed that is being filtered.

What this means is that you could substitute any feed, alter the query and parse those with one and the same Pipe—hence the name OnePipe. If you’re curious what OnePipe does behind the scenes, then please feel free to take a peek, then clone and tweak it. Here’s the link that takes you directly to the source of OnePipe : The CleverClogs Generic Feed Filter.

Installing OnePipe
Drag this hyperlink OnePipe to your bookmarks toolbar. This will cause a button named OnePipe to become available on your toolbar. Open its properties if you want to see the underlying Javascript code. The current version is from 2007-03-13, 3:49 PM – GMT +1.

Grabbing your feed
OnePipe feeds are just feeds as any other. With the bookmarklet I offer an easy way to view feeds created with OnePipe. Of course you can use any other tool too: to subscribe to your newly created feed in
your feed reader, grab the entire URL off the Grazr address bar. Select the URL,
copy it to the clipboard and paste it into the dialog box that your feed
reader provides for new subscriptions. Let me know if you have any issues with this.

Where to take your feed
Apart from subscribing to a OnePipe feed in your feed reader, you could also consider the following possibilites. Start out by creating a filtered channel of highly relevant posts about a certain topic, about a person, or about an event.

  • Receive a system tray alert or a sticky desktop message when a new feed item matches your filter, or display your channel as a running ticker on your system. To enable this, subscribe to your OnePipe feed in Touchstone.
  • Have all Twitter posts from your “With Friends” page that mention @yourname, forwarded as SMS messages to your cell phone using Rasasa or ZapTXT. Just sign in to your account with any of these services, fill in the URL of your OnePipe feed and set your preferences.
  • Receive the items in your OnePipe feed as instant-messaging notifications through your preferred IM system: for Skype there’s Anothr and, since fairly recent times, ZapTXT. For the other main IM systems, consider Rasasa (all systems) and Feed Crier (AIM and Jabber).
  • Forward the items in your OnePipe feed to your email inbox, for example using FeedBlitz, R|Mail or Zookoda.
  • Use your OnePipe feed as a building block to create a topic radar. To merge your OnePipe feed with other feeds, consider using newsmastering services such as mySyndicaat, Feed Digest and Feed Blendr.
  • There are literally hundreds of RSS Tool Vendors—yes I track them myself. Excellent resources where RSS tools are discussed in depth are John Tropea’s Library clips, who’s not just thorough and smart, but always points to other relevant tools in the same category, and 3Spot’s incredibly comprehensive RSS Tools page.

Feed Auto-Discovery
As you may have noticed, OnePipe is capable of detecting all of the feeds offered on any web page you visit. You may know that the mechanism of recognizing feeds is usually referred to as feed auto-discovery. Most blog publishing services offer this capability automatically and you should be able to use the bookmarklet with most blogs and sites offering RSS feeds. The bookmarklet component of OnePipe is mostly an adaptation of the OPML Auto-Discovery bookmarklet that I published a couple of months ago.

The concept behind OnePipe
For me the exciting part about OnePipe is not so much the bookmarklet itself, but the generic feed filtering mechanism that I built for it using Yahoo! Pipes. Feed manipulation is an essential part of newsmastering, the techniques used to build feeds matching a particular topic, person or event. As far as I know OnePipe is the first solution to offer on-the-fly feed filtering based on URL parameterization. With other feed filtering services the source feed and sometimes the search query get obfuscated, hindering direct finetuning of the settings.

Room for improvement
These are some ideas I have to make OnePipe better:

  • offer tag, category, author and title search capabilities (already in progress in Pipes)
  • integrate with John Forsythe’s Feed Preview add-on for Firefox
  • general debugging and fine-tuning

I’m very curious for your feedback on OnePipe. Moreover, if you’ve been able to successfully use OnePipe for a particular purpose, then please share your experience. David Tebbutt provided me with lots of useful input in this project. Thanks!

First Reactions:
Mike Kowalchik understands this is a proof of concept and there maybe some wrinkles to iron out. Indeed, Mike. It seems Pipes only searches through excerpts of feed items, and not the full feed.

Mike Gotta calls OnePipe innovative on his blog and suggests you give it a try. Thanks Mike!

James Corbett (through IM) points out that OnePipe could be especially useful to filter the noise from one’s Twitter Friends’ stream. He requested a Yahoo! Pipe that lets you create a feed that lists items that do not match certain keywords. Ok, James, here’s the AllButPipe bookmarklet, and the link to the Pipe that fuels it: AllButPipe : The CleverClogs “Exclude This” Feed Filter

Danish podcaster Karin Høgh (through IM) asks for instructions to add the bookmarklet to IE7. Yikes. Sometimes I forget I’m not in a Firefox-only world. What’s worse: the bookmarklet isn’t going to work in IE7 because its underlying Javascript code is tiny bit too long: 2880 characters instead of the allowed 250—more or less. Thanks Karin!

Phil Hollows of FeedBlitz (through IM) helpfully suggests to turn OnePipe into a server-hosted script. The advantage is that that might make it accessible for IE7 users, and it would give me version control. On the other hand, this is definitely beyond my scripting capabilities and the TypePad server would be accessed each time the script is called. I think I’ll leave that until I’ve had proper training in Javascript coding.

Chris Saad of Touchstone compares OnePipe to FeedBlendr and sees some similarities with his own product.

Seems I’ve got another fan down under! Better Communications blogger Lee Hopkins gives a fine example of how he might use OnePipe to track “Second Life” posts from Neville Hobson‘s blog. Lee is making a serious study of Second Life for his PhD, so I can fully imagine how OnePipe comes in handy there.

On his blog Knowledge Jolt with Jack, Jack Vinson calls OnePipe a “Cool Tool”.

I’m happy to see my German colleague and friend Siegfried Hirsch, who maintains a blog entirely focusing on RSS technology in German, also covered OnePipe. His story is here: OnePipe – Filtern von RSS-Feeds auf Knopfdruck

Quite a few people are visiting CleverClogs at the moment because of the mentions that Steve Rubel, Lars Trieloff and James Governor made of OnePipe on their blogs. Thanks so much.

The story has been on TechMeme for a while now.

If you’d like to digg this post, then feel free to click this button:

And as usual, a Grazr to let you track mentions of OnePipe:

Grazr Badge

Written by CleverClogs

March 13th, 2007 at 4:07 pm