- Scuttlebutt
- GNUnet
- Secureshare
- Fereenet
- ZeroNet
- Retroshare
- Diaspora
- Mastadon
- Matrix
- Cabal
Twitter PiperNet?
Rather than building a new initiative from the ground up, we hope there’s some opportunity to join forces on this.
If two threads are so much the same that you want to post the same comment to both, that's a strong indication that they should be merged. Sending us a heads up at hn@ycombinator.com is a forcing function to make that happen.
(Parent is a duplicate of https://news.ycombinator.com/item?id=21763925. We merged the replies from here to there.)
Bush tripped over his words all the time. It's much more likely that than a calculated move (that backfired btw, it's been his most famous quote since the day he said it.)
Of all people to give the benefit of the doubt to...you give it to a bumbling idiot who was known for misspeaking and tongue tying himself into knots?
Before he even messed up the saying, he messed up his own introduction to the saying:
>There's an old saying in Tennessee — I know it's in Texas, probably in Tennessee...
I remember hearing people suggest this is why he misspoke shortly after it happened.
Do we really need a billion dollar company to figure this out, or is it just an advertising issue?
"In 2019 Anime will be associated with fascism, neo-Nazis, and hard-core misogyny." - Time traveler me from the future.
"LOL WUT?" - Me in 2005 before murdering this obviously false me from an obviously impossible timeline to prevent damage to the space-time continuum.
Definitely the best ActivityPub software on the market!
Also: Relevant XKCD: https://xkcd.com/927/
They are the last company that should be trusted to develop an open standard.
I never understood this, why can't the API/firehose serve ads that would be presented in the 3rd-party apps?
Additionally 90% of users would naturally gravitate to the default app regardless, leaving 3rd-parties for cool/interesting/advanced/innovative use-cases. I still feel this was a mistake - not as some hippy idealogue - but from a ruthless capitalist perspective. This was their like button.
I think it will not be difficult for anybody to siphon that data, and I don't know how one could prevent it, and it would be nice to see it done without complicated solutions. I think twitter could be biased.
I don't know if a law like GDPR would prevent it. If it doesn't, there should be law forbidding entities to gather data.
Because there has to be one giant tech company that everyone hates and Microsoft lost interest in the position over 5 years ago.
... and Oracle's got one hell of a lead on the rest of the race.
model technical standards by which to make interoperable popular classes of communications or information services, including—
(1) online messaging;
(2) multimedia sharing; and
(3) social networking
(And all within 180 days ;-) No small feat.)
This brings to mind the (truthfully) quite useless Minds.com social network. Twitter doesn't NEED a blockchain. Just look at Pleroma, Mastodon, or Gab to see p2p twitter replacements that are blockchain-free.
Of course, plenty of reasons to be sceptical about them either going with ActivityPub, or not.
You can even run an instance yourself, just like you run WordPress.
I've been thinking for a while that there should be something like a decentralized omni-Reddit. I liked forums, but people don't want to use them anymore, because there are too many different signups and too many different notification streams/etc. on too many different sites to bother with - so if you had something like Mastodon for forums, that could mitigate that.
But it seems like a consensus has set in that Facebook/Twitter-like social networks are the One True Model, and very few people are interested in things like forums anymore.
Feel free to email me if you'd like an invite to the network.
Also it's weird but Jack follows Cernovich.
Even if I trust the Twitter mod team, what's to stop tomorrow's jack-booted thugs from shooting the Twitter team and seizing control of the servers? I'd much rather we as a society move to decentralized censorship-resistant networks while we still have the freedom to openly build and advocate for them.
I really doubt that banning Hitler's social media accounts in the 1920s would have done anything to stop the Nazi rise to power. Whereas in the 1930s, rest assured that centralized platforms would have made the Gestapo's life a hundred times easier.
The solution to your problem is quite simple. The network will die off.
- a few proper web frontends (and especially one like Google+),
- groups (like Google+, WhatsApp, Telegram)
then this would start to look seriously promising.
I'd happily pay a 20-40 bucks a year for that and (if Telegram didn't exist) a bit more to get a hosted but private instance for my extended family.
(That said I have been experimenting with hubzilla this year and it seems seriously promising but all instances seems to be locked down really hard or doesn't acvept new members and testing on my own instance alone doesn't really give me a feel for how it works in practice.)
...should. That notion could disappear really fast if Twitter gets to decide who can run an instance based on their belief systems.
In the mean time, it's an interesting case study of what happened to Wil Wheaton when he tried to join a Mastodon instance. Already, even in these comments, people are expressing concerns about how Twitter will be able to maintain control over "misinformation and abuse".
That's the whole point of decentralization guys. It's impossible to moderate Twitter without being authoritarian and creepy. Bail on the concept of controlling others, and delegate that power to the end user by means of improved blocking tools.
If decentralization is going to work, we have to abandon our desire to control others with a centralized authority, and accept that responsibility as our own.
It would be a different scenario if it was the big network that supported free speech instead of a new ban reactionary network
"Twitter is a telegraph office" -- but should it be?
Look at ATOM/RSS, they are telegraph offices too, yet they don't have character limits. ActivityPub services like Pleroma also are "telegraph offices" without strict character limits yet they don't seem to suffer for it. In fact it's much more pleasant to use Pleroma for this reason, you have the freedom to express complete thoughts.
I am not happy with the balkanization involved in that concept - part of the beauty of the internet is a disregard for the globe's petty fiefdoms and their ability to literally divide and conquer.
Will keep my fingers crossed.
So its smart to try to build and promote something that is decentralized but also allows them a profit model. It also makes sense just from an architectural standpoint in terms of scaling. I think Ethereum offers at least a chance they may do both of those things.
Further, GNU Social still doesn't implement AP. This is largely because AP is very annoying to implement, but also because GNU Social sucks.
brevity? it s a virtue
In fact, any app can be made to act as a source, sink or both of ActivityPub events. I recently added ActivityPub support to learnawesome.org so that reviews can be consumed in any ActivityPub client. Implementation was easy and the data model is quite easy to understand.
ActivityPub is real-time pub/sub for the entire Web, something that Twitter could have been.
Operational: they don’t control features; adding them by contributing to the standard would leak planned features, and without contributing, would be seen as embrace-extend-extinguish.
Business: it would contribute work to their competitors.
Technical: implementing global search on it is implausible.
Business: what kind of work would contribute to their competitors? On the standard? Well, 90% of open standards (invented number) was created by for profit companies. On libraries and services, why would it?
Technical: implementing global search on the www as a whole is also impossible.
If that’s the case it’s just going to be dumb crap; it’s driven by business and not technology.
About Twitter RSS: I recently discovered nitter.net. It's a Twitter front-end without all that tracking and with the addition of RSS. Jack's at https://nitter.net/jack and the RSS is https://nitter.net/jack/rss
This rules out a lot of existing projects. IMO rules out AP, SSB, Matrix, etc
Twitter management actively and specifically decided to not be that.
Sadly, all centralized Facebook/Twitter/YouTube since 1st January of 2020 would add more restrictions (according each new ToS and Privacy rules).
BTW, I already prepared for fully migrating my Twitter activity to Mastodon.
Replace email with "social media content" and you have ActivityPub.
There are egos at stake here!
Also ActivityPub relies on servers/federated rather than p2p.
Human moderators.
Each grudgingly uses human moderators to squash the worst of the problems on their platform, and does a terrible job of it. Each underspends on human beings, using contractors without sufficient mental health care to ensure their well-being as they sift through our online sewer pipes.
Google outsources YouTube moderation to third-parties: the Content ID system is a labor shifting device designed to force the labor cost of enforcement outside of Google’s responsibility.
Twitter ended political advertisements rather than spend the human cost required to moderate them, and is now proposing a decentralized platform where Twitter is no longer responsible for content moderation for other platforms.
By doing so, they can continue to act as your “aggregator” of individual (RSS-like) Twitter accounts, so that they can continue showing you ads based on the data they harvest from you and your feeds — while outsourcing responsibility for moderation to others.
This is an effective strategy for increasing profits and if implemented correctly will permit mass layoffs of most of their content moderation workforce. This will also vastly increase the prevalence of abuse, racism, and other societal ills that infect Twitter with its underpowered moderation today.
Props to Twitter for identifying a way to externalize the cost of civility while continuing to profit from the resulting cesspool that will ensue.
I really wish I could hack on the youtube recommendation algorithm. It seems to be tuned for zombie viewing pleasure, and totally not for finding surprising new content. Even just having several "personas" would be a big help.
Rather than building a new initiative from the ground up, we hope there’s some opportunity to join forces on this.
For example, one of the people working on one of the most prominent pieces of software implementing the ActivityPub specification has proposed/is ~close to releasing a reference-implementation of one [a non-AP distributed protocol], which seems to solve most of the issues that Twitter would need to solve for privately-scoped posts (a major problem with most federated and decentralized social media), with plans to ~eventually get around to solving publicly-scoped things:
https://socially.whimsic.al/notice/9p6cjMLaIZxtCKyNto
(Pleroma doesn't really do per-user threading, so the responses to the original post are mixed in with the author continuing the original thread. Reader beware, etc.)
Are there genuine technical shortcomings in the ActivityPub standard that Twitter's engineering team has identified? Why not talk about that and contribute improvements to the standard?
Are there shortcomings to being part of the standardization process in the W3C? Then talk about that and make the processes better.
Is it that he needs his name stamped on a new protocol? I'm not sure we can do much about the terminal egotism of the ultra wealthy and its pernicious effects on our society. Solving this will take a tremendous amount of collective effort.
He doesn't care about decentralization. ActivityPub is impossible to directly control and it has no innate analytics, advertising or monetization layers. This makes it impossible for Twitter to utilize such a protocol.
If anything, Dorsey wants to embrace, extend, and extinguish AP by making an incompatible protocol that he can then pump VC money into in order to have it gain traction on Twitter's terms - with all the ads, spyware and analytics that Twitter desires.
The protocol wars begin anew.
Your doubts are correct. From the thread:
>@halcy: So, ActivityPub?
>@jack: Team will have charge to choose whatever is best, be that what exists today or start from scratch.
Dorsey follows the Mastodon twitter account - he knows about it.
That being said, solutions like Scuttlebutt, DAT, & IPFS are decentralized, do work, and do have social networks.
A service designed to get tweets to a larger audience. But Twitter banned the account that was working to put this standard into practice @shareU
Ironically Twitter has been, historically; the most restrictive force in social media.
While I'm all for open standards and protocols, Twitter has proven itself hostile to 3rd party developers. Even if their proposals are good Twitter has a long way to go to prove themselves trustworthy participants in open networks.
If anyone is interested I wrote a piece about democratizing social media https://medium.com/@shareU/we-built-this-city-2cb97437942f
https://twitter.com/MastodonProject/status/12047748080153272...
Mastodon has a number of instance and user-level boundary controls, like image muting for porn and sex work instances, that let people still federate with instances that could be trouble without that boundary. It would keep a hypothetical Twitter.com instance from causing what happened when AOL brought millions of people online.
https://gitlab.com/fediverse/fediverse.gitlab.io/wikis/watch...
I think Twitter should whitelabel its application and sell 'instances' to media, publishers, government agencies, and other organizations who would benefit over control of their namespace. G Suite seems to be a good model to follow.
What I'd really like to see would be a focus on nonprofits and grassroots political candidates, such as a NationBuilder for the Fediverse.
One of the massive "troubles" that social media has been having to deal with in recent years is the whole fake news problem. (in quotes, because it also has driven social media engagement, and thus revenue from ad impressions up, so from a business perspective it's a boon with the right narrative) Admittedly, it isn't a new problem, it just it's perceived impact has grown to the point of catching the public eye.
Twitter's response is that they're banning political speech entirely, to try and get out of the fake news domains that people care the most about.
Now, they're pushing a decentralized social media system that by it's very definition will be hard to control content on. In being a client for said open standard, they are certainly free to block whatever comes in that suits their fancy, but to me, it feels more than they're using this as a way to shift blame with regulation looking like it's on the horizon. It'd be an awful conveinent excuse to say "but Mr/Mrs/Miss regulator, we're just an aggregator, other entities are responsible for this content."
Maybe they really do believe the best approach to combatting this is to serve as a principled (by someone's definition) client of a sewer of public content, or maybe this is a strategic move to shift responsibility. I wonder which it'll be...
Twitter doesn't ban political speech, what they will stop accepting are political ads.
Webber's trashed it (the initial author) and is working on a way to mitigate the problems of it by implementing incompatible changes, the biggest piece of software claiming to implement it doesn't even implement it (Mastodon), the only piece of software that stays semi-faithful is full of devs who hate it (Pleroma).
AP is completely broken for anything but publicly-scoped content, relying on a lot of trust for every party involved. This gets broken frequently, and has had consequences so far on networks implementing it (like half of them are incompatible implementations, so I think it's completely fine to say "networks").
The specification itself is far too ambiguous. Here's a post by a maintainer of Diaspora explaining this part further: https://schub.io/blog/2018/02/01/activitypub-one-protocol-to...
So let's assume you can get Twitter to implement ActivityPub perfectly to-spec. Great! It doesn't work with literally any pre-existing ActivityPub software, and users' DMs and are more or less public, with users' private accounts literally being public.
I use AP daily, and while it's fine for technical users with a reasonable understanding that anything they post is public, putting naive users' data at risk has never and will never be acceptable; pushing AP will harm everyone.
Much more interesting is the why, not the how.
#1 reason to decentralize:
"Centralized enforcement of global policy to address abuse and misleading information is unlikely to scale over the long-term without placing far too much burden on people."
#2 reason:
"The value of social media is shifting away from content hosting and removal, and towards recommendation algorithms directing one’s attention. Unfortunately, these algorithms are typically proprietary, and one can’t choose or build alternatives. Yet."
#3 reason:
"social media incentives frequently lead to attention being focused on content and conversation that sparks controversy and outrage, rather than conversation which informs and promotes health."
This seems to run anathema to the concept of social media platforms being run by for-profit companies. Monetization absolutely mandates the need for controversy and outrage, as opposed to social welfare.
Personally I deleted my twitter account and barely use Facebook any more for this reason. If there was a fun happy version of these networks that showed me stuff I wanted to see rather than stuff that annoys me, I’d use it.
It's less the wire format (JSON-LD) and more the semantics (ActivityStreams) that are important, to be honest.
Ah... so that's how he's going to get the funding: https://external-preview.redd.it/CypLdP3MLDVm15Lwm1f-M98gyMh...
Why else would you need to insert a blockchain into the solution? Scuttlebutt (https://scuttlebutt.nz/) is already one possible solution and they wouldn't have to reinvent some new protocol.
> A distributed social network or federated social network is an Internet social networking service that is decentralized and distributed across distinct providers (something like email but for social networks), such as the Fediverse.
Centralized = One central system runs everything (i.e. Twitter, Facebook)
Decentralized = Multiple central systems run everything, but they talk to each other and you can build your own (i.e. email, Mastodon/ActivityPub)
Distributed = No central system at all (i.e. Bitcoin)
https://twitter.com/jack/status/1204766085037248512
"Finally, new technologies have emerged to make a decentralized approach more viable. Blockchain points to a series of decentralized solutions for open and durable hosting, governance, and even monetization. Much work to be done, but the fundamentals are there."
If the Twitter team go for a blockchain stack, they're doing so for the mass surveillance and control feature.
P2P is the way: see Holochain, Scuttlebutt etc.
It mostly makes moderation (or censorship) impossible.
This is good, in a sense - means Twitter is feeling the competition. But any open source developers out there should trust Twitter just as far as you can throw them.
https://www.bbc.co.uk/news/world-asia-india-50343054
https://qz.com/india/1746734/angry-twitter-india-users-are-m...
https://www.thehindu.com/news/national/mastodon-happening-in...
https://www.indiatoday.in/technology/news/story/indians-leav...
https://indianexpress.com/article/technology/social/social-n...
Good luck with your 'open standard'.
He's CEO of twitter and Square. His plan is for square to be at the center of decentralized payments via cryptocoins. Africa will be a huge place to start, as the incumbents in the west will sabotage any such effort
[0] Haha
Any medium supported by ads is toxic. This predates online social networks.
Any news feed (recommenders) is intrinsically toxic. Such feedback loops are just outrage machines.
It's highly doubtful that likes and ratings can be redeemed either. I'm fresh out of goodwill, so I don't care to try.
So what's left? The graph. Maybe that could be useful.
Meanwhile, it's hysterical that anyone tainted by Twitter imagines they have anything constructive to contribute. Now were he to completely renounce the whole effort, acknowledges it's deleterious impact on democracy and society, turn it off, and beg for our forgiveness. Well. That'd be a good start.
Twitter is creating a syndicated public one-to-all feed system; Email is a syndicated private one-to-many feed system. The public/private difference cannot be discarded and makes your question unrelated to my statement.
I encourage you to pursue a top-level thread about your concern instead, so that it’s not disregarded as a reply to mine.
I'd love a feature that defaults the next video to the newest unwatched video in a given channel or something like that, but we all know why it won't be built.
If you were asked to hack on YouTube's algorithm, any modifications you'd produce, no matter their merit, would be tested against the status quo for their ability to generate revenue.
We dint even need an open protocol for it, just a reasonable aggregator.
It should be federally mandated to enforce education.
I wrote a toy twitter clone using a discord server as a data source and it worked pretty coherently
Twitter is a global chatroom
what i think jack/twitter is moving towards is a model thats catering to the direction the youth are headed, with twitters implementation of topics, its akin to discords (gamer chat app) interest servers
Perhaps it's largely about branding/development control? I imagine it looks better to investors to say "we're making this new thing" rather than "we're gonna use this other thing that we don't own".
The developers behind Matrix are currently funded from cryptocurrency money to the best of my knowledge.
This is not true on multiple levels
Webber has not trashed ActivtiyPub. I'd love if you could provide some evidence.
And the updates, in the form of OcapPub, are not at all incompatible with the current AP. They're an optional add-on that has a good default behavior.
Source: I worked on the same paper where Webber talks about improving ActivityPub, I presented my own white paper about ActivityPub. I gave a talk about these possible upgrades at the ActivityPub conference and I do a podcast with Webber where we talk about ActivityPub.
I'm not a Mastodon developer, nor have I developed with it, but surely there are learnings there that could potentially be contributed back to the W3C to make ActivityPub better (including making it more rigorously spec'd).
The people at the W3C are not gods - they're human beings just like the rest of us. Why not get involved in the conversation there?
The only genuine reason I can think of to split away from the ActivityPub effort to build a completely different protocol would be if the W3C's working group on ActivityPub is filled with such toxic politics that it's impossible to make any progress on making the spec better. (That's been the only reason I could see in the past when I've been part of protocol standardization efforts).
Without evidence of that, however, I'd say that it's far better for the community to get involved in making the existing spec better. Robust debate (supported by evidence, such as that which Mastodon's built up) is incredibly valuable to the community as a whole.
Also, it's incredibly valuable from a political decentralization perspective to have as neutral a party as possible facilitating the standardization efforts, to minimize the risk of Big Tech shaping standards in ways that would suit them financially (and potentially against the interests of the average internet user).
[0] - https://activitypub.rocks/implementation-report/
[1] - https://blog.joinmastodon.org/2018/06/why-activitypub-is-the...
Not only this, but they go against it in multiple places. How they've implemented 'summary' and the bizarre things they've done to create compatibility with Misskey (but not in an actually-compatible way, Misskey's had to patch their own solution every time) has made every implementation have to implement an against-spec trashfire.
I'm not a Mastodon developer, nor have I developed with it, but surely there are learnings there that could potentially be contributed back to the W3C to make ActivityPub better (including making it more rigorously spec'd).
Alternatively, the AP spec is fundamentally broken in many ways, and that effort would be better off going into a protocol like Secure Scuttlebutt (not a fan, but it's much better than AP) or Diaspora (also not a fan, but it's much better than AP).
The people at the W3C are not gods - they're human beings just like the rest of us. Why not get involved in the conversation there?
The only genuine reason I can think of to split away from the ActivityPub effort to build a completely different protocol would be if the W3C's working group on ActivityPub is filled with such toxic politics that it's impossible to make any progress on making the spec better. (That's been the only reason I could see in the past when I've been part of protocol standardization efforts).
Not only politics, but it's incredibly slow. Webber has written a post on how troublesome the standardization process was, though he doesn't go into just how bad it was:
https://dustycloud.org/blog/on-standards-divisions-collabora...
Without evidence of that, however, I'd say that it's far better for the community to get involved in making the existing spec better. Robust debate (supported by evidence, such as that which Mastodon's built up) is incredibly valuable to the community as a whole.
There are already existing specifications, none of them as bad as ActivityPub. I'm fully for going in one of those directions, but AP is more or less a failed experiment.
Also, it's incredibly valuable from a political decentralization perspective to have as neutral a party as possible facilitating the standardization efforts, to minimize the risk of Big Tech shaping standards in ways that would suit them financially (and potentially against the interests of the average internet user).
W3C is not neutral, and not only are they not neutral, but the RIAA and MPAA are people with enough sway to have messed up the entire web multiple times (see: making EME a standard).
A neutral party sounds great! The W3C should not get to be involved, however.
In his own words:
> "OcapPub" sounds like a new protocol, whereas it's really just a way-to-use ActivityPub mostly as it already exists. Maybe time for a new name for that?
Even if Webber does think ActivityPub has fundamental problems, he doesn't seem to be discouraging anyone from pushing it. I mean, go ahead and watch his most recent talk and decide whether or not Webber is "trashing" ActivityPub.[2]
> "It was 3 years of really hard work, and it wasn't clear in the process if it was going to pay off. And it has. We now have this as a standard that we can all use to be able to speak to each other, and I think this is really exciting."
[0]: https://gitlab.com/spritely/ocappub/blob/master/README.org
[1]: https://dustycloud.org/blog/2019-10-01-updates/
[2]: https://conf.tube/videos/watch/2b9a985b-ccdd-49ce-a81b-ed00d...
That's a misrepresentation of history. Being responsible for your own data hygiene has been the norm in many online circles for a long time. I have often experienced pretend-stalking (e.g. via exif information not stripped from images) as a way of opening the eyes of community members about the data they leak.
Direct point-to-point we can make secure (relatively) yes. You can run your own e-mail server, setup up PGP keys, and once you make it through that usability nightmare, you now have secure e-mail (if you trust your hosting provider) that will probably get dropped as SPAM 1/3 of the time when e-mailing anyone on Google/MS/Yahoo.
There's an interesting case where Mastodon and Pleroma respect and forward delete requests. Say you have a thread started on BigInstanceA and I reply from PersonalInstanceB. Someone from IAC replies to the same thread and B sees it, but A can't because C is banned from A. The reply gets dropped. You now have two conversations not in sync.
Say A deletes the original. B gets the delete request, but C never does, since it's a banned instance from A's perspective and doesn't exist ... even though it has a full copy of the deleted thread.
Deletes are truly fucking silly in the AP world. As much criticism as Zuckerberge gets (and deserves), back in the day he just wanted everything public, and I'm kinda for that too. If I post something online, it's never personal. If I need to talk about something personal, I call a friend, or text them, or meet them in a bar or plan my next vacation to be in their city. Real conversations don't happen in this space.
Also, the way you ban people is basically by having unique capabilities handed out to everyone. Then you can do various things to stop access (it's called a revoker in ocap jargon). See http://habitatchronicles.com/2017/05/what-are-capabilities/
That comes across in delete requests. There's no way to guarantee that a server would honor that request. I don't think a blockchain style solution is needed -- just don't try to offer things that are impossible to offer. (There's this idea that AP/decentralized will be Nazi-free... what a ludicrous promise! Although, perhaps that's more an expectation of the users than the protocol authors...)
What do you base your statement on? I've heard this take before, but I haven't seen anyone provide a good explanation for it.
Use search to find Kaniini's threads about Rapunzel.
Also, no, it's not something inherent in distributed social networking as a whole (previous attempts have avoided it), and it's not even inherent to push protocols, but without a bit of thinking behind it, it's easy to collide with.
Deleting is stupid, though, yeah.
Dorsey wants a decentralized system exactly because he won't be held liable for not censoring people. It makes sense business-wise and it's a win-win for humanity.
Twitter has become a trigger-happy-people-fest because each group knows they can weaponize censorship against each other. With systems that are uncensored , nobody complaints, e.g. people don't make a fuss that email is not censorious enough
Censorship only becomes a problem when it is _unavoidable_, that is, you cannot choose to live outside of some entity's censorship influence. This is where things get complicated when you have giant entities like Facebook or Twitter, which are for many people difficult to avoid (and there certainly isn't an alternative to them).
The problem arises when these entities need to choose which messages to show you. Even without putting any conscious bias in this algorithm, there is a system there which prioritizes some messages over others in a completely opaque way, which is often game-able (bad-faith actors can abuse the system to spread their propaganda, for instance). So moderation is not merely necessary but _unavoidable_, simply because there is more content than you can be presented with, and unfortunately the huge power of moderating large social media networks rests in the hands of a handful of engineers.
Decentralization is an interesting solution here because it would make the social graph and the recommender system separate entities, with clients being able to choose which recommender/moderation system they subscribe to. The need for censorship wouldn't be gone, but with people being able to choose their own censor, the massive power imbalance is not quite as bad.
I'm sadly not surprised. While HN does attract hobbyists like me interested in technology and how it affects society, it also attracts a lot of those who dream of building and controlling the next big data silo for personal profit. Permanently liberating an entire mode of communication into an uncensorable distributed system that can't be easily replaced due to the network effect (such as your example of email) precludes that path to profit.
Does it make sense business-wise? What business will want to be on a system that has no moderation? It's just asking for your brand to be accidentally or intentionally associated with undesirable things.
You're posting this in a place (HN) that itself is not averse to deleting posts, shadow banning, manipulating the rank of articles, etc. Some have argued that HN is a good discussion environment precisely because of those things, though I don't necessarily agree. What I'm getting at is that you have reason to not expect sympathy for your position here.
The questions are where do you draw the line, and who gets to decide where the line is drawn?
If you don't like what the moderators are doing, you can select a different moderation feed, or start your own.
This way we decouple the moderation from the platform.
How is this not a laughable expectation? You may as well expect them to "solve evil".
There will be a space where different people and organizations can build filters that rate information for veracity and other traits. Over time these filters will develop a track record. People will be able to filter their feed through such filters.
Centralized orgs can already do this, but they make a central and opaque choice about it. This means that there is a lot of pressure from various interest groups to make sure that the hidden filter is biased towards their favored viewpoint, and the users cannot really see what the result of this fight is.
It's like how it probably wouldn't be a good idea to have just one news organization that served the whole US.
Making total censorship impossible is mostly congruent with the goals of society in my opinion. Censorship has done immense damage, e.g. Lysenkoism in the USSR (to pick a particular example).
However there is still the option for users to voluntarily opt in to certain kinds of filters. Most likely most people would voluntarily opt in to a filter that rejects child porn, for example. It's an open question whether a decentralized system with filters would lead to better overall environment, but I think it's worth trying.
This sort of case makes me an advocate for centralized access to moderate/regulate/also be accountable... but then if there's this magic backdoor to data access and removal...?
Many, many private money grabs were made trying to establish a proprietary replacement to web standards, including ActiveX, Flash, and NaCL.
Which is converging on a monarchy.
I can have a single non-distributed computer system and have that single computer be decentralized by having the programs it runs be done through achieving consensus. Your definitions are a bit off because Mastadon and Bitcoin are both distributed and decentralized systems.
Technically, decentralisation refers to anything that is not centralised (so both federated and distributed protocols would count) but in modern usage decentralisation refers more to distributed protocols.
In a completely decentralized architecture, every client would also be a server. And every client could, potentially, connect to every other client. So every user is beholden only to himself. Other users would be free, of course, not to connect to that user, but the user could post whatever s/he wanted without fear of being cut off. There is no good example of this architecture out there right now.
Basically with Mastadon, you can be cut off. With a hypothetical completely distributed social network architecture, you can't. (Well, maybe your ISP could cut off your internet connection? But that's a whole other issue.)
BitTorrent ? Git ? Bitcoin ? (They can also become centralized if there's a will, see Pirate Bay / Github / MtGox.)
I agree that sounds good, but can you point to something that they have actually done lately?
The ActivityPub process is a good example - yes, it got there, but much of the difficulties around the standardisation process seem related to the W3C process, not standardisation itself.
I was involved around the edges of the Atom standardisation process[1]. There's a reason that went through the IEFT and not the W3C[2].
[1] https://www.ietf.org/rfc/rfc4287.txt
[2] https://www.tbray.org/ongoing/When/200x/2004/06/10/AtomIETFY...
The only problem is meaningfully ordering those results and having the computing power to do it. An open standard doesn't solve those.
As with all(Most) Blockchains ~ it simply is too expensive to store data. Especially at any scale.
This provides tamper resistance to the data.
Incentivizing users or organizations to store large amounts of data is still a problem of course.
Let's Encrypt runs for around $3MM/year. Same budget for Internet Archive allows for adding storage for 2PB of content. Scale up accordingly. No blockchain! [1]
doesn't it speak to the limitations or choices of XMPP itself then, not the idea of a common protocol, if businesses can't reliably extend the protocol (only custom fork, and somehow barring eventual upstream contrib, whatever)?
I can think of an extensible protocol paradigm, with 'extensions' (really just libraries, packages, like those we fetch with `apt` or `npm` and optionally push to clients as well). Down to first principles, that's how we structured UNIX/Linux, most modern programming languages, the web itself (well, at least the Js and now wasm part of it).
(Thinking out loud...)
Facebook messages happened when FB didn't have so many users and in chat space there were XMPP services like ICQ/Jabber. Network effect was against FB so it made lot of sense to federate. When FB was convinced that by killing federation more people come to FB instead of leaving they just pulled the plug.
I am sure that if 80% of email users were using gmail Google would do the same thing. There is a chance of that happening... First gmail adds some amazing but nonstandard features, people start relying on those features and in time gmail becomes the one. Only thing thats keeping that from happening is actually other big businesses.
Decentralized means there is no center
I would add that Distributed to me seems there are no inherent “domains” you need to belong to, like for example email is federated but with scuttlebutt you’re identified by your public key and a hub is just a dumb relay and you can have many.
Non-federated routing alternatives include Kademlia (used in BitTorrent) and simple flooding/gossipping (like in Kazaa) or ad-hoc networks
For that matter, what is the authority at the top of email? You and I can set up an email server and start talking to each other right now without anyone's permission. We don't have to be connected to anyone else, and we don't have any authority that can control our implementations or even that keeps track of what servers exist.
I don't get the comparison between Email or Mastadon to ICANN.
It's also worth mentioning that most people have to trust their Mastodon / email provider not to snoop in their private messages. Systems like SSB provide true end-to-end encryption that makes it safe to broadcast your private messages to the world.
This will, I predict, make a lot of people unhappy because “omg there are Nazi tweets on my blockchain” but personally I’m happy with it.
ActivityPub can be private in the same way email is private. All the people in the recipients chain will have a copy of the object you're sending. If in these recipients there's the Public namespace, then yes, you can't talk about "private" any more, but outside of that ActivityPub supports private interactions.
As a followup on this discussion, I actually spent half a day today to add private messaging to my ActivityPub service. It actually works.
Twitter is not equal to an email list. They share certain aspects but they are significantly dissimilar in UI, approach, social perception (by participants and by others), and publication. M Twitter has not replaced mailing lists, and mailing lists continue to operate effectively.
Twitter is an electronic billboard that anyone with an app can post content to, and everyone can easily see it and do the same. Mailing lists are a town hall meeting inside a building: you can see them if you like, but participation from bystanders is quite rare and is often frowned upon or openly prohibited by the meeting’s coordinators.
The specification as-written is really, really bad (though I don't think this is a fault of the protocol),
Synapse is kind of...and work on Dendrite seems to have mostly stalled,
the billion people signed up on matrix.org has allowed for a sort of de facto centralization (not a huge problem, though in practice it sort of is, given how much the server buckles under the weight of all of the users; might be solved if it's ever moved onto a more performant implementation?),
the lack of encryption by default is iffy (though done for understandable reasons).
To lend credence to the specification being bad:
"I tried writing a matrix homeserver but I couldn't figure out how the state resolution process works" said by the author of Audacious/one of the authors of Pleroma/much more, so certainly a person who should be able to understand something that simple:
https://socially.whimsic.al/notice/9oxtjVqQw8gRS6QDKa
I know multiple people who've tried to implement the spec but who have gotten stuck on things that should be simple but are unclear if going by the spec.
> The specification as-written is really, really bad
We get a pretty wide range of feedback on the spec fwiw: some people seem to really like it. Others say that it’s “really, really bad” which doesn’t exactly give us much to go on...
> Synapse is kind of... and Dendrite is stalled
We have no choice but improve Synapse currently, and while it is still quite a resource hog it’s improved by at least 3-5x over the last year. Dendrite instead has become more of an R&D project for future homeserver shapes, but it’s not entirely stalled.
> The matrix.org server causes de-facto centralisation
The server has been less than 50% of the visible network for several years now - and ironically the datacenter perf issues (unrelated to Synapse) we had over the last few months have shifted that balance further - it’s about 35% and dropping. Ideally we will turn it off entirely once we have decentralised accounts.
> lack of e2ee by default is iffy
Our main project right now is to fix this. Cross-signing is mid flight; E2E search is done; Pantalaimon (E2E compat for dumb clients) is done; remaining key distribution bugs are in flight. We’re aiming to turn it in by default in Jan.
> “I couldn’t figure out how the state resolution works”
State resolution is the main technical novelty in Matrix, and yeah - it’s hard, much like git’s merge resolution is not exactly easy either. Unfortunately it comes with the territory; if you want to have consistent room state while replicating them over a byzantine network of servers to stop hijacks and other abuse, you have a relatively hard problem to solve. We got it wrong the first time; the current version gets it right (as far as we know).
The spec (which is deliberately formal and terse) is https://matrix.org/docs/spec/rooms/v2
However, there are supporting documents linked from the spec to help clarify: the original spec proposal at https://github.com/matrix-org/matrix-doc/blob/erikj/state_re... and the guide at https://matrix.uhoreg.ca/stateres/reloaded.html etc
Ironically I think that state res is one of the best documented and understood bits of Matrix now (which is just as well, given how important it is).
After more than two years in and around this space I'm still comfortable with stating that I'd take Matrix with all^wmost its flaws over ActivityPub. All of these protocols kind of suck. I see Matrix as having the lowest hamming distance between where it is and where it should be.
tons of businesses send promotional emails , even though they know the protocol is also used for sending porjn
I haven't heard of unsolicited CP being a common spam issue. And those who exchange CP intentionally can and do use encryption which makes such filters pointless.
you would call that a filter, like spam, and of course it's essential and can be deployed in multiple points (before sending, between servers, at the client). Both users and server instance owners can have control of what they allow. There is little disagreement that these filters should exist, so i expect all server to implement them.
Censorship is about allowing e.g. governments to request takedowns globally. most servers will reject such lists.
I see one public and one private:
Publicly, organize social engagement. As long as they are at the helm, and at the forefront of tech innovation, they won't have issues on that goal.
Privately, diffuse regulatory pressure. If unlike Facebook, they can share blame with other actors, they won't singlehandedly be responsible for political mayhem, so there won't be calls to break up Twitter. It is the whack-a-mole approach, similar to BitTorrent vs. Napster.
I don't buy this. Nothing is going to change from the user perspective, and almost nobody in the grand scheme of things will likely be aware of this open standard anyway, let alone people working in government. I don't see how this will change the public and political perception of social media websites whatsoever.
> and almost nobody in the grand scheme of things will likely be aware of this open standard anyway, let alone people working in government. I don't see how this will change the public and political perception of social media websites whatsoever.
I would argue this is a side-effect of the current state of affairs - obfuscation during studies and testimony (what little takes place), but mainly the inability to demonstrate superior implementations.
I'd rather we don't give up without having actually tried anything.
EDIT: Although, I could easily agree that this is simply a disingenuous smokescreen to buy time and mitigate legislative risks. In fact, I'd bet money on it.
i mean, you arent really saying that you dont believe a massively-confederated social networking infrastructure would change the political perception of social media? i think it necessarily would, and change every individuals relationship to social media too. its like that marshall mcLuhan quote 'the medium is the message', ie the medium defines what it contains and what those contents mean.
now, current leaders probably wouldnt want to adopt a system like this because it would be a test of their value on all those metrics, but i wouldnt say that makes the notion doomed from the start. i get what you mean though.
i mean, where would be right now without the open standards of 30 years ago?
And that analogy doesn't make any sense.
I was looking into building something on top of SecureScuttleButt, but didn't like some of the opinionated choices in it (same goes for ActivityPub). Looking at Matrix spec, the two seem to be somewhat conceptually similar, and Matrix seems to cover my needs. Never even thought to consider it before, but it might actually be a really good fit!
any chance there are ways for me to dub a few users as moderators and give them the ability to silence / kick / ban users by ip, hostname, ip subnets and cidr?
I'll be looking into whatever bridge things there are for combining matrix with some microblogging, that would be a really perfect fit for 2 of the projects I've had on the idea shelf this year.
If it can connect with wordpress / buddypress for logging / blogging things from chat by user, that could prove interesting for some uses indeed. Of course if it connect to mastadon or anything else similar that could work too.
It's been a while since I've checked in on Matrix and what's new. I'd love to find someone who knows the code and could help me mod it a couple hours a month for a reasonable fee.
Moderation has improved loads though - https://matrix.org/docs/guides/moderation/ has the details. You can't ban users via IP though (unless they're on your server), as otherwise it's a massive privacy leak to expose IPs.
Really glad to see this, I've been searching hard for a chat system replacement, and now it seems this might be it. With the ip addy api thing, if I can get someone who knows the code enough to help me use that to ban / block (on our own server) or bridge it to iptables, access.watch or something similar - this may be our future.
As far as a bridge to WP being basic at the moment, that is just fine, all I need is a way to port conversations from a certain room to posts, pages or whatever into WP and the rest can be handled from there later.
Really glad to see the progress with this!
Why do you have no choice but improve Synapse?
One of the reasons you seem to only get negative opinions along the lines of "really, really bad" is because "The way it's written is stylistically bad/unapproachable and an entirely different approach should probably be taken" is something that takes a few hours to diffuse into something useful, and not something most people really receive in a way that's productive. It takes a lot more effort to give truly constructive, workable criticism than expressing any sort of opinion, negative or positive.
thanks :)
> Why do you have no choice but improve Synapse?
There are quite a lot of Synapses out there right now, and Synapse's featureset is pretty mature. Given we have pretty high profile people running Synapse (e.g. all of the French government) we have no choice but to invest the time to polish it and make it more efficient and stable. In an ideal world we'd have paused on Synapse ages ago and focused purely on a next-gen server, but we can't leave Synapse users in the lurch. Dendrite will be getting some attention in the coming months though, but not as a direct Synapse-replacement, but more of a playground for more experimental stuff.
> It takes a lot more effort to give truly constructive, workable criticism than expressing any sort of opinion, negative or positive.
True. fwiw, my guess is that kaniini was trying to implement state resolution before we published the first stable Server-Server API back in Feb - where it most certainly was the weakest part of the spec (and had design flaws too, which is why we hadn't bothered speccing it in detail).
Because this would certainly happen when the current movement of email into two major silo's (Gmail, Outlook) goes forward. When those two (or three, or four) have a majority of email-users on board, governments will start discouraging or forbidding usage of other mailservers. And will start making demands of those few leftover mailserver monopolists.
To be clear, this is roughly what I'm arguing. In theory, I openly welcome Twitter and Facebook adopting an open standard and giving users the option of easily moving their content to another service, but I don't think it will pan out that way in practice due to the current state of affairs. For one, brand recognition is very powerful, and I think Twitter knows this and is banking on momentum keeping users on their platform regardless of the technical ability to move to another service. Also, most people simply won't understand the implications of this standard or why they should care. ("Why would I use XYZ when I can just use Twitter/Facebook?")
Moderation is the only known effective solution. Some times.
FAANGs and others abandoned human moderation because it "doesn't scale".
So what? When did we decide that scale was more important than civility?
--
I also have questions.
What is the feedback loop? For every medium, every style of communication?
How do we break those loops into discrete steps? Then where can we add friction? To slow down the negative psychological and sociological pathologies.
Defuse, disable those dopamine hits we all get from these social interactions. Maybe even figure out how to make it a positive feedback loop.
We used to have curated content indexes with human moderators guiding them - in print, Yahoo/DMOZ, AOL keywords, web rings, LiveJournal. Those required significant human labor compared to algorithmic text searching, and were not able to scale as rapidly as content creation tools did.
Was that lack of scaling a problem? No, not necessarily. Some percentage of people enjoy curation (thus Pinterest) and we could have celebrated their efforts and given them top billing in search.
Instead, we “democratized” search by harvesting all of those human rankings and feeding them into a machine algorithm that produces seemingly better-than-human results. Unfortunately, in doing so they did not highlight whose curation led to content being shown, and so curation became less popular over time.
Unfortunately, that curation is what led to Pagerank being so valuable. Without it, spam and liars and malicious activities have infected all “search” and “ranking” systems. Without human curation distinguishing “valuable” from “unevaluated”, search does not scale either.
We did society great harm when we sidelined curation, and no amount of machine-learning algorithms will heal that wound.
Recommenders, like bureaucracies, are misanthropic (anti-human).
The rules are meant to remove human judgement. While denying the baked in bias and dysfunction of the imposed ruleset.
Per Goodhart's Law, they arbitrarily state some things are worthwhile & meaningful, and everything else are not.
Black boxes which thwart inspection, transparency, accountability, explanation.
--
Forgive me for flogging this horse; I do have a point.
Also missing from online social networks are the concepts of fair and impartial adjudication.
Curation, adjudication, transparency, accountability... I'm sure we're omitting many other missing features. Because we're too close to the problem.
Going meta meta here: the common trait of all these "regulation arbitrage" unicorns is they profit by the destruction of our society's laws, checks & balances, social norms, and so forth.
I mean in contrast to a negative feedback loop. Socially, negative or positive denotes impact. Virtuous vs vicious cycles.
Suggestions for better phrases?
protocol-wise, which flaws are currently the most egregious from your pov? (i.e. `all - most = ?`) (And if any are security issues, please chuck them to security@)
Before I'm accused of being unfair because there's always going to be a ridiculous ratio for something like a "hi" message, consider some alternatives for both the format and payloads of the fundamental protocol primitives. Most of the messages contain cryptographic metadata which has a succinct binary representation, but JSON requires base64; when represented naturally with CBOR the overhead can be reduced ~40%, and without encoding/decoding either. Consider that virtually all of the overhead in "hi" is either cryptographic hashes or signatures or integers (depth/ts) which would benefit from compact formats.
Does representation actually matter though? Why can't I just store Matrix in my format and federate with your format? I guess this is an example of where theory and reality collide. One cannot write a server which handles messages as abstractly as possible (leveraging these JSON/CBOR extensible formats) while at the same time knowing which fields have a more efficient binary representation and transforming that. In reality that just looks like a CBOR message with a bunch of base64 plaintext strings. It doesn't achieve that 40%.
All of this is important because of Matrix's (superior) design over its event abstraction. When the whole protocol is hinged on fundamental primitives (a good thing) attention to detail and focus must be given to those primitives. The more optimized they are, the more everything built with them is also optimized. When the foundation is efficient, developers can do more with matrix and enrich the user experience. For another example, matrix has been reluctant to give developers the power to store shared-program (i.e bot) state efficiently in a chat room. This is because there's no mechanism to delete state_keys, or even discard overwritten state itself. That's an important cornerstone that's missing while the rest of the tower is being piled on.
It might be possible to confuse any of these issues as trivialities, and their solutions as bike-shedding. I contest their importance is evident in how they emerge to shape the character of the entire system. Consider: does matrix require the entire DAG to be acquired like a bitcoin block-chain? Then I better be careful and conservative about messages. Does matrix allow gaps in the DAG and have a smaller chain for auth? Then I can be liberal about messages and delete stuff later. When I go to build an application which communicates over Matrix those qualities emerge as fundamental limitations or liberations of what users can experience.
I'm actually building an Activitypub implementation myself. I quite like the protocol and the philosophy of "twitter without Twitter Inc.", but I'm thoroughly sick and tired of the rube goldberg "framework on top of framework on top of framework on top of obscure language for the backend" insanity that comes with the usual implementations. So I decided to do something about it. I'm working on an Activitypub server in Go, sqlite, and a pure vanilla javascript frontend. My goal is to have this be dead simple to install and maintain on a barebones VPS for anyone with a modicum of Linux commandline experience. One static binary, one small config file, one folder with a handful of javascript/css resources and html templates. And that's it. No bloody vue, react, angular, ember, or rails. And definitely no f---ing node.
I've tried to include ActivityPub support on an app, too, and it was a nightmare, it kinda worked, but I ended up abandoning everything.
Hopefully I'm wrong and I'm not giving enough credit to social media users in aggregate.
What im saying is you probably never get to the utopia, but maybe building some of the requirements for that utopia will be beneficial in an ever imperfect world.
Yes, the standardization process was a difficult one. Standards efforts often are, and social web ones especially. Nonetheless I think we did a good job.
The purpose of those posts is to ask people to stop fighting each other and try to work together; it feels highly ironic for you to quote them to increase division.
> A neutral party sounds great! The W3C should not get to be involved, however.
Perhaps I got lost along the way, but... we're still talking about Twitter here right?
Are you seriously calling out the W3C, an open but obviously flawed organisation, for finally capitulating on DRM, after huge public drama and well-documented opposition from within the W3C. DRM is something entities such as Twitter use as a matter of course; there is no public discourse, nor documentation.
This isn't even as basic as pots calling kettles black, any reservations one could have about W3C as an org are positively laughable when the alternative is a standard stewarded by a corporation with the size and influence of Twitter.
John Sullivan had a great tweet about this:
https://twitter.com/johns_FSF/status/909931688641400839
Fundamentally, the W3C does not work in the interest of the user, and shouldn't be trusted.
Get some of the Scuttlebutt guys or the Diaspora guys to contribute! Don't get the W3C, no one who's part of the W3C should have a say in anything.
Twitter making a standard would at least result in something not stupidly broken.
Agree with most of your comment, but I can't see where this is coming from. I would be shocked if any "standard" coming from Twitter would be anything but broken.
Again, you're saying W3C doesn't work in the interests of the user, but ignoring that Twitter works actively against the interest of the user.
W3C isn't ideal, but the alternative being discussed is devoid of any merit whatsoever.
If you have any specific feedback about which improvements are most important to you, I'd love to hear it. It's hard to see things with fresh eyes after you've been working on them for a bit.
And to anyone unfamiliar, I recommend checking out the "Principles" section of the handbook; there's a lot of interesting stuff in it, and it proves that Scuttlebutt's really got the best culture/morality of any distributed network so far:
https://news.ycombinator.com/item?id=16880060
Is this accurate currently? Its a turn off.
It's a quirk of the main feed encoding type, but there are other feed types (e.g. Gabby-Grove) that are major improvements. Right now the main hurdle is just adding support for more feed types to the major clients, which is something I'm actively working on.
SSB is great; I'm not sure if others would agree, but while I think it has a lot of problems, none seem inherent (i.e. while they mightn't necessarily be easy to fix, they wouldn't involve any major architectural overhauls or scratch rethinks; what's there is conceptually sound).
The main issue for me is performance and resource usage, which is tricky since a lot of the traditional solutions to perf/resource challenges are cloud-based, which would erode ssb's value. Thinking about SSB on older recycled or embedded systems, etc. is hard.
The other is NIH; this is definitely something I feel the community is acutely aware of however; I recall seeing discussions of parallel implementations in Kafka, etc. years ago. I haven't kept up with recent development though.
The NIH problem is hard, but I think we're moving in the right direction.
The alternative being discussed is Twitter appointing a different neutral party: if they're bending to the W3C, they're already appointing a "neutral party" to do the work for them, the only difference is changing who they trust from another giant organization that's very clearly apathetic about user interests to one that does: the SSBC would be perfect, for example.
IMHO, there's not enough daylight between ombudspersons and their paymasters.
I have no fixed opinion for standards of civility. I'm just trying to capture the notion that some dialog, rhetoric is out of bounds, as determined by the intended audience (context).
Scores of other issues could have been cited, but I included the representation example having confidence you'd probably tout those exact experiments and respond with that blog post. Your conclusion at the time was that CBOR and JSON had negligible differences. The company then proceeded to de-prioritize any serious work in that direction while simultaneously ramping up efforts for end-to-end encryption by default. This was a flawed conclusion and it has demonstrably added to your tower of debt. Even my "hi" example is already passé because now that too is another giant base64 string adding to this jumble. You can't bolt Ferrari body panels on a Honda and call it a Ferrari.
I can spend all day citing issues just as poignant, and you might even be kind enough to elevate them against the ~10,000 other [github] issues they're contending with. I can spend all day unpacking the string of missteps leading to all of your engineering disasters. It's not going to have any returns- not for either of us. It doesn't root the problems.
If I could impress upon you some serious advice, it would be to value people less transactionally. Don't estimate a person's worth by how they fill a few open gaps in your grand master plan and then dispense with them as if they won't be filling in any more. Avoid that by valuing people by how they think, and then don't try to think like them yourself. Delegate to them instead.
i’m afraid that nobody is going to delegate to you, but you are welcome to contribute via concrete spec proposals, which are assessed based on merits (and whose review is far from dominated by me; if they were my own proposals might move along faster than they do). if the spec process is too slow and doesn’t work for you, then feel free to spell out the proposal however you like.
I volunteered at least three solid examples of fundamental indecisions that have unambiguously cost your investors alone millions of dollars over several funding rounds; lest I mention also cost every poor soul that has volunteered their free time in the name of FOSS -- an ethically ambiguous embrace by you at best; every one of them is locked into the cost of your missteps.
I have clearly linked these indecisions to real-world outcomes. It's all history by now. The foundations of state resolution weren't in place when you built Communities/Groups so you didn't use the matrix chatroom; you built an entirely new inferior HTTP protocol without any state or replication whatsoever over several months. Now that you finally prioritized fixing that underlying problem with rooms there's a need to replace and spec an actual Groups system. In the meantime nobody can develop Matrix Groups into their software, not my server, not clients like Ditto, etc, because you tell everyone not to. You're going to overhaul the whole thing. You're doing them a favor by saving them that wasted effort. But Synapse and Riot use Groups and Matrix promotes it on matrix.org; still there's been no serious visible progress toward groups-as-rooms.
This is why Matrix is indeed a de facto centralized system. Let's not even get into issues in this system where every server trusts matrix.org for cryptographic keys. Matrix is really centralized around you.
In the end nobody is working with you. I have the only third-party implementation of this stack. Nobody is working with me either, but that's called the transitive property.
You have some time to think about this. I would say until the next recession hits. Then this is over. The way you do things won't survive that.
