How I Built My Own Tech Radar (BuzzScope): From Data Streams to Daily Insight As a technology evangelist, I’m always looking for better ways to keep up with what’s happening in tech. So I built a small system — BuzzScope, my personal tech radar. It currently has 3 key functions: 1⃣ Historical Insight: Search any keyword, and BuzzScope finds the most popular posts and active contributors from multiple platforms (Hacker News, Reddit, YouTube, and even selected Discord servers). Behind the scenes, historical data from HN and Discord are archived in Parquet format, which allows columnar access and faster queries across millions of records. Reddit and YouTube, on the other hand, are fetched on demand for real-time trending results. 2⃣ Daily Pulse: It automatically gathers trending posts from the past 24 hours (based on thresholds) and sends them to my inbox — quick and actionable. 3⃣ AI Analysis & Re-distribution: Then, multiple LLM agents collaboratively analyze the results to detect short-term trends and even generate tailored repost content for different platforms. Each agent works in parallel rounds — seeing global context but only refining its own results — until the network “converges.” The outcome? I now get a living snapshot of the tech landscape every morning |