Publishing your work increases your luck(github.com) |
Publishing your work increases your luck(github.com) |
All of the other bullet points there are pretty reasonable, but, having worked in OSS professionally, I genuinely hope none of my GH projects take off in the OSS world.
I have a few projects that are in the >50 stars range, and am both grateful for other people's interests and very glad that none of them crossed the threshold to becoming real OSS projects. I like sharing my interesting experiments, but I absolutely do not want to be stuck with the nightmare of maintaining OSS software for years.
Even on these small projects, I've had times when I'm pressured to do a bug fix on a 5 year old project where I don't even remember how it works or review and merge an enthusiastic PR solving a problem I don't actually care about. It has eaten up a few weekends, and was a relatively minor annoyance, but it gave me the taste for what OSS work involved. Working professionally for an OSS company gave me even more insight.
Maintaining OSS is a royal pain in the butt and I am forever grateful for the people who choose to do this. Running a popular OSS library is not a prize. It's at least a part time job you aren't paid for. The benefits are slim; even the "fame" part (name your top 10 favorite OSS tools, now name the maintainers of those), and has really limited rewards outside of that. I've know plenty of brilliant creators of OSS libraries who struggle to find jobs in industry that are appropriate to their skill level.
In fact, it's really hard to both run a successful OSS project and have a full time job (especially a high paying one that wants a lot of your brain and time) if you can't some how manage to make that OSS project your full time job... and even then you will be under constant pressure to find a way to monetize your OSS project (which inevitably leads to either losing that job or making decisions not in the interest of your community of OSS users).
OSS maintainers are saints as far as I'm concerned. So much of the world's software depends on them (even moreso in the age of LLMs) and the vast majority are compensated way less than your average FAANG engineer.
Also having spent years working in the OSS space, I wish it was normalized to have more nuance between "totally unmaintained" and "maintainer will literally miss their child's birthday to review your PR".
There's already all kinds of badges on GH readmes, couldn't we have a few more signifying "actively maintained, PRs welcome" or "security & critical bug fixes only" or "looking for new maintainers", etc.?
The other spectrum that I’d like to know up front is where the maintainers fall on the spectrum of “I would be honored if you forked my project” to “This project is my baby and I will mobilize my users against you if you fork it”.
The refrain with open source is always that if you don’t like something, you’re welcome to fork it. But my experience with forking projects has, in a couple cases, drawn anger and attacks from maintainers. In a corporate setting when we ran up against maintainers who were unable or uninterested in even merging PRs, we had to fork the project and continue work in the fork. For some maintainers, this turns into “<corporation> is trying to steal my work!” even when the name and README were maintained. Or the maintainer gets angry that the name is kept on the fork because it is no longer under their control, we changed the name, which prompted more anger because we were “stealing their project” and so on.
To be completely clear, this isn’t all maintainers. Some have been so happy that they marked their original as maintained and referred users to the new fork in the README. But I’ve had enough cases where forking triggered anger or even calls to mobilize their Discord against the fork across social media (HN, Reddit, Mastodon) that when I run up against a slowly-maintained OSS project I try to look for alternatives or evaluate the effort to just build it in house to avoid drama.
Scale has changed everything. There are orders of magnitudes more users than contributors compared to some of the early OSS and the balance between grateful and entitled end-users has skewed expectations much more towards maintainers as a support role with similar responsibilities to a product engineer in the commercial world. Why would you want to enter into that social contract now? Why would you want to risk your library taking off and the associated costs that would bring (as well as benefits)?
An alternative evolutionary pathway for OSS is for developers and communities to self-host their own git projects. Projects get to define their own ethos and workflow. Discovery remains high-friction which prevents the commodification of maintainer effort. The bar for writing custom tools to support things like this got a whole lot lower so it might start to make sense more than it did in the past (there are both push and pull forces at work here). It might even make OSS fun again.
However, this is a really sad state of affairs, and I'm wondering if we can't have scale _with_ friction to counter some of these pain points?
If they're so keen on helping people publish more stuff and showing how awesome AI is, perhaps they can pre-screen the entitled comments and just not let them get posted? Perhaps they could see that you've not touched a repo in 5 years and when that PR comes in, they could help bootstrap you back in with a code review summary? Perhaps they could stop the idiots pressuring you by explaining to them all the reasons why their PR might not get looked at any time soon?
Perhaps, just perhaps, Github could take some ownership of the problems they have created, and do some work to fix them?
Lot's of entitled "I want to speak to the manager" types ruined it for me.
And for little benefits to myself. Hitting HN front page or r/programming was nice for my ego. But that’s about it.
If you expect more long term support you better be paying me for my time.
It is also helpful to remember that 100% of $0 is still $0. And that .001% of a trillion dollar TAM is still a pretty big deal.
Get “street cred” in the dev space by being open source, and let the enterprise customers “pay” for it.
I have written articles about it and made the binaries freely available on my website under an 'open beta'. People keep telling me that if I really want it to take off, I should open source it.
So far, I have resisted doing that, for many of the reasons that you cited.
It's an article about how some of the best people do work that engages with public view and discussion either very trivially or not at all (or both).
Hard to describe more clearly but it has been a huge influence on me.
1. Work two jobs until you burn out.
2. Quit your paying job and hope you have you don't go broke.
3. Scale back or quit maintaining OSS projects.
I think companies, governments, and societies could do a better job funding this work. But since this is a "tragedy of the commons" problem, I'm not holding my breath that this will happen before the public experiences a lot more pain from failures.
Someone else being usually some corp that is happy to pay with exposure instead of money.
This is of course a rather cynical read, but the first instance of luck being "Having your OSS library take off" kinda paints this picture for me.
Which does make sense I guess, given that it's a piece of writing by the great free labor extraction machine GitHub, which was bought by Microsoft not because they had suddenly gotten altruistic at heart.
Which isn't to say that it's all bad, but there obviously is a clear conflict of interest here that doesn't get explored at all.
There is a point to be made for not publishing your work in ways that makes it trivial for others to benefit from it. A more balanced piece of writing would've warned about this instead of purely providing encouragement.
Because of OSS, I’ve never actually applied for a job or done a Leetcode interview. I’ve gotten multiple direct offers through Twitter DMs (I don’t post) and multiple referrals through random encounters that I never used.
E.g. Debugging an interesting issue with GitHub customer support eventually led to a referral for Microsoft by an MD. Similar stories with Cloudflare and more.
It’s not limited to OSS, but just having any sort of backing credibility to your name without going through the whole CV/CL process unlocks a whole slew of opportunities since people can “pre-screen” you from the start.
Don't code a lot but have written books which led to book signings at conferences that probably led to other opportunities if I had the need to exploit them.
1. Personally identify a pain in your own work, and it most likely will be a pain for many others.
2. Build a solution to solve for it.
3. Organically talk about it in forums — for me this is Reddit, HN lately and to some extent Bluesky.
When people ask why I build open source, I say it’s about signaling. As other comments have mentioned, if you’re fortunate enough that it gains traction, it becomes your calling card and can lead to consulting and jobs. It’s analogous to academic publishing (used to do more of that) but with different dynamics.
My personal examples of solving for a pain are:
[A] I started building the Langroid LLM agent framework after having a look at LangChain in Apr 2023, at a time when there was hardly any talk of LLM-agents. The aim was to create a principled, hackable, lightweight library for building LLM applications, and agents happened to be a good abstraction: https://github.com/langroid/langroid
[B] With the explosion of Claude Code and similar CLI coding agents, there were several interesting problems to solve for myself, and I started collecting them here: https://github.com/pchalasani/claude-code-tools One such tool is a lossless alternative to compaction, and a Tmux-CLI tool/skill for CLI agents to interact with others.
> greetings peasants! er, sorry, valued open source contributors!
> remember, without you feeding us training data, we won't be able to train our AI to replace you at your dayjob!
> now, get back to work
Putting more out there will increase the probability of a reward, but it doesn’t guarantee it.
I’m not a language purist, but are we really calling people who work in marketing „marketing _enginners_“ nowadays?
That seems like going a bit too far with the meaning of engineering…
Want to do something with motors, but don’t know how to calculate the right combination of motor, gearbox, brake, encoder and controller? Maxon’s sales engineers will happily walk you through the calculations.
Nor would you want someone who built most of their career as an actual engineer to suddenly drop that term and become a generic someone in “marketing”. They’re more than that for sure.
I quite like the terminology the more I think about it.
It was here back when I wrote it: https://news.ycombinator.com/item?id=32071137
Lots of comments talking about how this is just some sort of ploy to feed the machine. I don't know what to tell you. I can only tell you it changed my life and the lives of many others. Hope it can help you too!
Even with a following, most of the time when you publish it goes into the abyss. Every once in a while something hits but most of the time it takes a lot of patience and resolve. I've had some good visibility over the years from Reddit and Hacker News (though any post I make now on HN is marked as [dead]). It's not always fair and others can "pay" to get the visibility.
I've seen some of the other comments talking about the burden of OSS but I haven't felt that. I set my own agenda and fix what I want to fix. If someone wants to change my priorities that becomes a paid effort.
My blogging and publishing almost never comes up during an interview. Afterwards, I am openly told it's why they either asked for me, or why they chose me over another candidate. This has happened at almost every job I've accepted.
My writing style or content is not all that special. As the saying goes, 90% of success is simply showing up.
Just being explain complex topics in simple ways can go a long way, even if you're not an amazing author.
---
Addition: This is especially true with topics so expansive that even great LLM often conflates subtopics in weird ways. While this gap is rapidly closing, being able to clearly explain complex interconnected topics in simple ways is absolutely an advantage.
Here's some of my work - it's free until Jan 1. https://inkican.com/smashwords-white-hot-scifi-winter/
The advantage now is being able to preserve semantic fidelity as everything else accelerates into noise. Work that stays legible and grounded seems to compound in ways raw visibility no longer does.
Usually this only applies to business related websites, but lawyers could even argue a personal blog is business related due to the possibility existing for me to advertise products.
So yea, while I would love to share my work publicly, its simply not feasible due to medieval laws in place.
https://www.codusoperandi.com/posts/increasing-your-luck-sur...
while i agree it is irrefutable logic, the chance of being seen is quite small because there are literally millions of other people doing the same thing. gauging probability is what human brains have trouble with.
but it does improve your odds a minuscule amount. but it is always always always better to have friends in high(er) places who can amplify your work. that counts for x1000 more. one mention from someone with 1M followers is worth more than publishing 1000 articles.
by...
publishing your work and making friends in your industry
Perhaps in my original post I'm just confusing academia with industry, since I know so few academics.
They love your free labour. "Thanks for your OSS project! No, no, we're not hiring... and you'd never make it through out interview process!"
One should make free software for other free software developers and grateful end users. Not for parasites. Recognition doesn't pay the mortgage. And now you won't even get that because your work will just end distilled into weights in a large language model.
And that wouldn’t bother so many as much if it weren’t for the fact that large corporations often do not give back. It’s become so much of an issue that OSS maintainers have switched licenses, some have shifted closed-source, and others have simply abandoned their projects.
Just last week I began rethinking usage of MIT/Apache licenses for future work. For the longest time I was hesitant about GPLv3 and almost scared to use in my personal projects, but it turns out my hesitations were fueled by...large corporations.
I have a lot that I'd love to share (and let's... charitably... assume it's worthwhile stuff) but would be afraid to start just because of this stumbling block.
If anything, the fact that it worked for me, yet I found it necessary to add the full context, probably strengthens the statement even more.
But anyway. Standard damage control statement that latches onto nothing because there is nothing to latch on to as I made sure to structure the comment that way.
I hate corporate so much man. Just because you can predict what happens doesn't mean that the happening would be any less frustrating.
___
I understand that your role requires you to do this. That is clear to anyone moving through these systems.
What I do not understand though is why you even tried to deflect this with such a low-quality "oh it worked for me it might not have worked for you. YMMV" thing, when you could've also just said nothing at all, not forcing my hand and making me call you out on that.
That is, above all else, strategically unwise.
Fortunately, however, this all doesn't matter. It's not like anyone cares about anything on this platform anyway. So even a strategically unwise move might as well not exist at all.
It is not straightforward, however. One guy did only product-led marketing and it took him 3 years for his SaaS to make good numbers. And he's probably an outlier, since he's featured on the show.
And then you have another guy, who blogged for 5 years about Ruby and only after those 5 years using the audience from that, he built an OSS project with monetisation on top of that. But he could do that because he talked to his audience about ideas.
Listening to those interviews, I get the impression that if you know what you're doing, you can make a profitable SaaS in 2 or 3 years. But to get to a state, where you know what you're doing, you need at least another 3 years or more of actually putting in the reps in an honest way.
And I think that's where the "increase your luck" comes in. I think it's kind of shallow non-sense in the vein of motivational speaking but lots of people like this kind of content and like to be aspirational. Lots of the books sold by internet hustlers, like Rob Walling or Aaron Francis, don't get read, only bought.
Whether that's open source code, writing, various consulting, speaking at conferences, etc. will vary with the person. And the more you can do on a company's dime the better.
The exceptions to this are closed (or semi-closed) communities and forums where you directly interact with humans, either by inertia due to a large established human user base or (for newer, smaller communities) via personal vetting of participants.
Not looking for you to answer these questions for me here, but ask yourself, what are those dreams specifically? What are the concrete steps you've taken to get there, and how are you going to accomplish them? How long is it going to take you? What are success criteria? What are the risks? What are the failure modes?
But that wasn't enough. Someone else wrote that my article was useless and I write at a 7th grade level. I turned off the monitor, went for a walk. I decided that blogging wasn't for me. It was time to delete my blog. I was so embarrassed.
When I came back, there was a reply to that comment. It said something like "that's a good thing, 7th grade level writing means we can all understand it easily". And that was enough to keep me going. 13 years so far.
The problem with environments designed to make interaction low-energy and gamified like Reddit, is that it gathers just the worst people. I've got ~63k karma there, and disengaged some years ago and I can't tell you how much ditching that, twitter and Facebook improved my mental health. There's some great fun to be had there, but it's often the same thing over and over again and increasingly drowned out by utter crap. They've taken multiple actions that have destroyed the sense of community and have become a poster child for ens*tification, unfortunately.
On YouTube, I also sometimes get mean comments, though at least there the automatic moderation catches them so they don't show up publicly and I can shadowban the offenders off the channel easily. None of the content is even controversial, YouTube just attracts a lot of angry people that feel entitled to speak what's on their mind.
I wouldn't publish in an environment where blocking or banning people is difficult. They're not entitled for me to engage with their hateful drivel. My blog also doesn't have comments. At the end of the day, I will say what I want to say.
One of my projects for the next few weeks is to get my blogging stuff up and running again but with a couple of tweaks:
1. I'll never allow on-blog comments again, ever. The signal/noise was always so poor. I'm sorry that you had a similar experience and the unpleasant odour of drive-by sniping got to you. For what it's worth, I'm always interested in finding new writing on tech topics, and I try to never be mean: I am not unique in this, so consider if there's another way.
2. If I ever publish code, it'll not be on a SaaS platform like GitHub, I'll manage the release through tar.gz/zip files, and if people don't like that, fine. I'm not after pull requests or starting a "real" OSS project. If somebody wants to take that OSS license code and host/manage it, godspeed to them.
3. I will write some code that looks for links back to my blogs, so if something I write is referenced by another blog, I'll learn about it at some point and I can go take a look, and that would be interesting. A long, long time ago there was some automation around this using web hooks that almost became a standard, so I'll look into whether that is a thing or not any more.
In my experience if somebody is writing a blog about something they are normally more constructive and thoughtful than if they are just writing something in a text box while "driving by". I'm OK with those articles normally even if they're critical or in disagreement with me about something.
1) If you want to send a PR we charge $1000 to review them. This is no guarantee that we will merge. We will quote any further costs needed after a review.
2) Feature requests should be accompanied by a $250 quotation fee. Then we will scope and quote what is required to do your feature. If your feature would compromise the project, or is impractical a started we retain the right to refuse to quote or suggest more work is required. The $250 fee is non returnable.
Something like that?
I really don't understand why so many people will choose a specific license, and then get upset when people do exactly what it allows them to do.
Usually I see those lone devs either ignoring them entirely, or ragequitting open-source altogether.
In my eyes, this disqualifies Sourcehut for anything serious. You could get booted off any second, if Drew decides that he does not like you.
(I like Drew, and I like opinionated and outspoken people. But Service Providers should be neutral, and only involve themselves as far as required by law.)
In my eyes, if this ever does become a problem, migrating elsewhere wouldn't be that much trouble. When the "cryptocurrency purge" happened, maintainers were given 2 months of advance notice, which is a little short but reasonable.
[0] https://sourcehut.org/blog/2022-10-31-tos-update-cryptocurre...
They’re on my radar as an alternative.
Thanks!
It wasn't perfect, but you were required to do things like subscribing to mail lists if you wanted to interact with a project.
Yeah, sorry about that. I agree it indeed worked out for you and that is great.
The point that I'm getting at is that it is necessary for the system to occasionally produce a winner, because otherwise, people would stop trying.
Think for example about a casino with zero wins. No one would come to play. If they however occasionally select a winner, that winner will then be the best marketing they can get, encouraging all his friends to also start gambling.
Please do not mistake this analogy as me questioning your merits. I am confident in your abilities at your craft.
What I am however saying is that the system does not select its winners based on that merit. Instead, the criteria for selection are usually based on what benefits the system most. This, in some situations, might line up with general merits to some degree, but it also might not, and that is one of the core deceptions, the corporate world runs on.
I do believe you that the idea of the article was to encourage people so that they can also have these great wins and experiences you had. But, as said, that is just one side of the coin, and it would be unethical to not mention all the outcomes in which a person does not win.
Every phrase in the article was carefully selected to make it clear that we're trying to increase the odds. Nothing is sure. But if you play the game right, the odds of winning go up
"I don't own it, I didn't write it, and I don't understand it even slightly. I just made a one-line bug fix for one function in it a year ago and nobody has touched it since, so my name is on top of the git history."
"Cool, so as the owner could you tell me..."
I would not want to be a public maintainer though. I don’t have the patience or motivation to use my spare time for that.
My other comment in this thread has more details, but in my experience it’s more common to encounter projects that don’t want new maintainers or forks. They’re happy with the status quo with their name at the top but also don’t want to let go of control or see competing forks created.
I would say that now, more than ever, this means you should be collecting and sharing what you create.
Not on large social media platforms either, on websites that you own and (ideally) host yourself.
Start a blog, host your own instance of Gitea, build a platform for your videos. Spread what you create and activity participate in the community but maintain ownership and an audit trail over what you've created.
People ripping off others works has always been a thing, of course it's much easier and pervasive now. It's still (IMO) beneficial to say "Look! I did this thing first!", with the added benefit of accruing the kind of "social capital" Aaron talked about.
It's a pretty repeatable pipeline. And having proof that you can DO something makes you stand out. Maybe moreso than ever!
That means I will make things, talk about them, and accrue social and/or actual capital for me and my family. I can't stop any megacorp from training on my code, and it's futile to try. I CAN build cool things, talk about them, and get cool jobs or friends or a following or whatever. I understand not everyone is comfortable with this tradeoff.
I do not like this take and I do hope you reconsider repeating such. This very much reads as accepting a lack of any claim to reasonable privacy and ownership, borderline on accepting what I would consider theft.
You might actually get in trouble picking up stuff that is not a priority.
Company I work for is less strict so we do “fix anything Friday”.
But for some other companies you might get a slap on the wrist for not following the plan and product owners pick what gets fixed and what not based on business plan. If there are big customers nagging - bug will be fixed asap.