Ask HN: How do you start researching for a project idea? How do you start researching for an idea you have? How do you look for if it is even worth the effort, what innovation can be made if a similar app exists? If you completely don't have an idea, but want to work on one, how do you look for ideas? Do you have a process that works for you, or some resources that help you generate ideas? |
https://www.amazon.com/Four-Steps-Epiphany-Steve-Blank/dp/09...
If you have an interesting idea, then write—Write for yourself, to yourself.
And when you’re ready, create a prototype or mock-up.
Without more information, simple is best.
- Go walk outside
- Consume media / go to events with topics that are VERY different than my field of expertise
- Do any kind of art
- Play like a kid
- Last but not least, my favorite: Have a lot of bad ideas. https://seths.blog/2018/06/the-two-simple-secrets-to-good-id...
Apply the "take an old idea and reinvent it in light of newer discoveries, new technology, or in application to a new problem" approach.
To do that, read about old ideas in some area of interest to you, that didn't catch on, or were abandoned for whatever reason. Use Google, Wikipedia, Sci-hub, old print magazines, old newspapers, whatever it takes. Look at things through a lens of "Could I resurrect this idea with a new twist that wasn't available when it was first proposed?" Do that for enough "things" there's a chance it'll spark something.
Extra hint: if you're looking for a startup idea specifically, Google for one of the multiple lists of "startup ideas that never work" that are out there. Of course it should go without saying to be very cautious about jumping into a project where many other people have failed with the same idea: there's probably a good reason for their failure. But IF you can find a new angle or hook that's "just right" maybe you can succeed. Or the whole exercise may actually bring a completely different idea to mind. Try to be open minded with this stuff.
Also, find the two video series[1][2] that Alan Kay did on "Inventing the Future" and watch those. He shares a lot of great ideas in those.
I prototype with basic materials (post-it notes, notecards, paper, etc.) to see if the idea is fleshed enough and has legs. I do this because a lot of my "failed projects" were just really not well-defined enough to proceed. It also helps build out the idea and helps illustrate deep-ends you should avoid in a prototype, and what an MVP might look like. Simple material prototypes help demonstrate the sorts of capabilities your program will need.
Once a project receives enough attention, I consider actually coding it up. I boil down the idea to the core of what's to be done, and try that. If it fails, maybe it wasn't a good idea, so try alternative approaches if I have any sketched out or any lessons learned from the initial attempt. I try to build up knowledge around the area of the project in-case it deserves a return in a few months or years.
If a project does actually work out, then I justify further development based on effort vs. what I need from the program.
I also enjoy sci-fi shows and often think "Ok that should really exist by now". Sometimes you see something that really is possible with current tech, but it's mostly just tedious UI work and nobody has actually made it practical yet.
Right now I'm working on open source CCTV software. I am also working on some basic VJ type functionality and adding QR support to an automation system. These are in fact the same project.
Non tech projects are different, but with tech I mostly focus on what existing things are out there.
Then I look for anything vaugely similar and see if it could ve extended to cover the use case.
If I'm absolutely sure a new app is needed, I look at what standards are used in slightly similar things, what tools exist to use those, and go from there.
Basically all my projects have just been FOSS things that already exist in the commercial space. I'm not sure I've ever really done anything innovative. I just use more software tricks to work around and hardware and put more effort into UI.
But ultimately, everything I do has been done a bazillion times. I just kind of pick up where the state of the art left off and add some nice to have features.
I really hate custom code and things I have to maintain by myself, so my first goal is always to make my project fit the larger ecosystem with as little originality as possible.
On a related note, old popular science type magazines have tech from 50 years ago that somehow still doesn't exist. If you want a real world changing project, I see zero reason a consumer level raman spectrometer couldn't be made.
so you can distinguish between genuine Maruchan and knock-off brands?
For example: Look to see what people complain about with shopify and see if there a product you can make to fix those issues. If you do it well, even if it's a niche solution. You can build on it or let it make you an extra $100 - $1000 a month.
Rinse and repeat.
Also, watch some lectures (and do problems if you really want to understand the material) from MIT open courseware on challenging subjects like Linear Algebra or Statistical Inferencing. If you can combine fields from web crawling/page ranking and linear algebra (like Google did), you could have a really great idea.
- Complete the sentence "It would be stupid if in 20 years we didn't have ..." (flying cars ? direct brain interface ? biological self-healing computers ? pick one)
- Now imagine this 'obvious' invention and bring it back into the present (IIRC he was trying to invent the iPad and came up with the Apple II - and succeeded. IIRC he's involved in Object Oriented Programming, Apple II, TCP-IP and other revolutionary inventions)
[0] https://www.ted.com/talks/alan_kay_a_powerful_idea_about_ide...
> If you completely don't have an idea, but want to work on one, how do you look for ideas?
(But also the one before.)
My line of thinking was there oughta be a community online where people can pitch their ideas and get opinions on it or look for collaborators, also cross-discipline. Like "hey I have this cool idea for an, idk, gardening app but I don't know how to code, wanna help?" or "I'm working on this thing, any ideas to make it better", etc.
From what I've seen, there are some forums like that on Reddit but they look more focused on momentary thoughts and whacky ideas rather than projects people are actually attempting. And it doesn't help that Reddit is mostly focused on recent posts (like HN or Twitter), so your post would only really be "active" for a few days.
GitHub could work like that in theory. You can push an empty repository with your idea in a README and people can use discussions to, well, discuss it. Tags could help others discover ideas to work on. But I haven't really seen anyone use GitHub like that, especially not people who aren't involved with IT in any way.
I guess what I would like to have is some kind of "Product Hunt but there is no product yet" (and with more useful discussions). Is anyone aware of anything like that? Or is this perhaps a niche that's not filled yet?
https://www.reciperadar.com/ is the current version of the idea, and I'm fairly happy about how it's developing. Previous iterations have included a Java-based web application (using recursive common table expressions in PostgreSQL) and dabbling with a Prolog-based web service implementation.
The current containerized architecture (which is ridiculous, I know) provides for a migration path towards Rust or golang for more resource-efficient microservices, if & when that's ever useful (or enjoyable to work on).
I started m4b-tool[1] for using it myself - and noticed, that the most features, I wanted it to have where not available in existing, free solutions. So I started to note things down, I would like to have for a utility to merge / create audio books.
Now the project is a bit bloated and I learned so much on the way to its current state, that I'm thinking over rewriting it (not in RUST, but in C# ;) but it was a joyful journey with a lot of new ideas and experiences.
Pro tip: Early shipping is very good for geetting early feedback and new ideas. Don't be afraid to publish something unpolished.
I'm going to play contrarian here and say I slightly disagree. OK, I mean, yes, as a general rule you don't want to start with a solution and work backwards. That I agree with. I just don't consider it an absolute. And I think that as an exercise done occasionally it can be worthwhile to look at some "solution" (that is, some bit of potentially usable technology) and work backwards and ask "What could I do with this?" I find that that can lead to some interesting ideas in its own right.
The danger, of course, is the possibility of getting overly enamored with the technology for its own sake, and wind up building something nobody needs or wants. But things like Steve Blank's "Customer Development" process can be used to help avoid situations like that, or at least before you invest very much in such an un-needed "solution".
For example, “why can’t I hail a taxi from my phone?”. At some point, all the ingredients were there but it didn’t exist. Uber answered the question.
Things that you wish existed, especially if they are a combination of existing ingredients.
Then you have to ask “so why hasn’t someone already done it really well?”
Hard to give a complete advice im just a few sentences, but basically this framework gave me the understanding necessary to quickly build out (validate) business ideas before anything is really developed. To oversimplify it - try selling before building it. That will give you a very good understanding of the potential market size, the actual needs of people and so on.
I have most of my good ideas when I have good mental stimulation. A diet of well written books is the gold standard. Talking to interesting people also helps.
My research process:
Fermi estimation.
Like when I started working on my search engine, I had a raspberry pi 4 with 8 Gb of RAM. I estimated that a webpage was 10 Kb. From that I figured a raspberry pi ought to be able to hold an index containing about 800 000 documents.
This is of course ignoring the fact that the index information is smaller than the document, and that an index requires metadata and operating system space. But like, ballpark wise it's not bad. I got a pi to index about 500k documents.
Then I did some basic research on data structures, both on what's typically used and just independent thinking.
When I had a sketch of an idea, I just go to work.
On the flip side, tech people tend to place importance on using technology to solve problems that did not even exist a few years ago. Think most SaaS startups.
Whereas, I’ve now realized, many of the problems most worth solving, also affected people 500 years ago. There is a lot of noise today in our information society, but the persistence of those problems is true signal.
So if you want to work on an idea that may stand the test of time, perhaps start looking at the problems that withstood the test of time. These are also hard problems that will be very humbling.
People post their problems, For which they haven't found a solution (or) when existing solution doesn't fulfill their needs i.e. need-gap.
You can check if any of the problems resonate with you and if it does you can choose to apply your skills to build a side-project which address that problem. The best part is you can get the feedback from those who want what you're building while building it.
"Factor Tables" (AI), "Dynamic Relational", and a stateful GUI markup standard are my pet suggestions. They are based on practical needs I observe, not pie-in-sky. (Desktops aren't going away, so let's stop making them a 2nd class citizen per UI's. Mobile is more "sexy" right now, but desktops get the real work done. Office Space's Milton probably does the real work.)
I'm sure there are topics you're curious about or sound interesting to you. Maybe there's a hobby you wanted to try out? Spend a little bit of time watching YouTube, listening to podcasts, reading blogs or joining discord/slack communities for that topic.
This doesn't have to be some huge investment. Spend an hour or two looking at a topic. This can be in 5-minute increments or a 2-hour block, w/e.
Are you still interested? Do you want to learn more about the topic? Do you want to try your hand at it? Go for it. Go as deep as you want on it, actually make your own version of w/e you're interested in.
Now go talk to people in various communities online. There are so many slack and discord groups out there, you'll find something you connect with. Ask questions. Engage in conversations. If you're feeling up to it, reach out to people to setup video calls. Some meetups are starting to offer in-person events, if you're comfortable doing that.
Still interested, still want to turn it into something more? Check out The Mom Test by Rob Fitzpatrick. It's fantastic guide on how to actually do customer development. Doesn't have to be about making something into a business. He's got great tactical advice on how to get info from people in a regular conversation and learn about stuff.
as for fishing for ideas, meditation, doodling, keeping a journal
1. I have a problem but I think it's just a small thing or very unique to me.
2. I have a problem and I see that other people have the same problem but they have simply learnt to live with it. Or I have this problem and it's driving me crazy ;)
For stuff in group 2, I first try to quickly build something (no matter how hacky) and then as time goes on, I try to expand it/get others to use it (this is how I got my current project). This in turn leads to more feedback which either helps me refine or abandon trying to commercialize it.
I also check out forums for the area that I'm working on and also look at bug trackers if it's public. Those are 2 places to get information on user requirements/pains. For example, my current project is on Google App Engine so I check the Google Groups forum for Google App Engine regularly
If it doesn't or if there's some pain points, I google about the topic and find out the important things about it. Depending on the field, this varies from blogs, youtube videos, research papers and press releases.
Is it mathematically possible? Physically possible? Economically possible? Politically possible? Etc?
I tried an Ask HN with my idea, but nobody cared.
Another time, I booked Facebook ads for people to subscribe to a pre launch email list, but nobody cared.
So mostly I just build stuff that me our my friends want. Or where a prospective customer comes to me with their project idea.
As far as I can tell, nothing like this really exists. A quick search gives r/startup_ideas and a few other low traffic forums.
I think structuring it around the fundamental problem, rather than the solution would provide a nice space for lots of solutions to flourish.
Users could easily like problems that they also have, giving a nice ranking of the ‘most important’ problems, and which would provide a ready list of people to present an MVP to, get feedback from, and you may even find a cofounder amongst them.
Maybe allow a mix of both? Like, people can open a thread starting from a pure problem and throw in some ideas for solutions. Or start with an idea and, as part of it, describe the problem. Let people filter if they only wanna see one type. And of course people can always link threads.
/r/SomebodyMakeThis
/r/somebodybuildthis
/r/stealmyidea
/r/startupideas
etc. come to mind.