Hey everyone. For those who remember, Yahoo Pipes was a tool to mashup RSS feeds back in the good ole' days. :) I really loved that tool, but of course, it was shut down. Since then I know there's been a few tools and attempts at bringing it back. I always wanted to create Yahoo Pipes clone myself. So here is my small side project - Mashups.io It's an MVP at the moment and well, let's see where it goes. Thanks all! |
Pipedream!
I've tried out NodeRed and n8n over the years but they've been a huge let down in ease of manipulating multiple RSS feeds and web scraping -- my primary use case for Huginn. I tried Zapier and IFTTT as well, but the free tier didn't allow for what I wanted to do. Since I could do it just as well with Huginn, I decided to stick the more complex flows there also.
Once you figure out the workflow (setting up agents, and which agents suit which task), then it's fairly straightforward.
The site seems to be down.
Let's say we all build wonderful apps on this, and then you run out of money or legal liability for hosting.
Is there a way to construct this so that we can export our Pipes to some standard format that the next person to pick up the torch could activate, and migrate to that?
It was really fun to have a service that could handle all the backend requests for you before sites like Zapier existed.
I've been thinking a lot about how LLM agents need some kind of glue to connect them to everyday websites at a level higher than raw HTML. What you’re building here really reminds me of that idea.
I actually wrote a little, easily modifiable Digital Ocean function I've been customizing and deploying per feed I want to filter. It feels like a hack, and it is, but it's "good enough". It's been working reasonably well and runs rarely enough that it falls into Digital Ocean’s free tier.
This video has … views by Tom Scott: https://youtu.be/BxV14h0kFs0?si=J3sVKEJhkABUSjN_
Has feeds for deep-linked sections too https://openrss.org/www.bloomberg.com/technology
$$("div[data-component='headline']")
Want to add for anyone wanting to quickly apply a filter to one RSS feed I recommend https://www.siftrss.com/, it doesn't require create an account and it works perfectly.
And, I can't help but think there is gold to be found mining the graveyards of tech that people loved but was never a billion dollar revenue source...
These kinds of software pipelines can be strangely satisfying to implement.
The development style of thinking of stream processing and online algorithms
It's also inspired by mapping and filtering and functional programming with flatmap.
It reminds me of factorio