The case against geometric algebra (2024)(alexkritchevsky.com) |
The case against geometric algebra (2024)(alexkritchevsky.com) |
> GA had gotten a bad reputation because of its tendency to attract bad mathematicians and full-on crackpots. Hestenes honestly sounds like one a lot of the time, and I’m not really sure whether he is or isn’t. It makes sense, really.
> GA ended up appealing to a lot of fringes: people who only had undergraduate degrees, people who had dropped out of PhDs, people with PhDs from unrigorous programs, people who had been good at math but were perhaps going a bit senile, random passerbies from engineering or computer programming, run-of-the-mill circle-squarers, people who had a bone to pick with establishment mathematics and felt like all dissenting views were being unfairly suppressed
> It didn’t help that a lot of the texts by the actually-competent GA people, like the Cambridge group, tended to say things that sounded and still sound kind of crackpotty as well.
After reading the article, the main "case against geometric algebra" I could find in there was that the author does not like the people using/doing research in geometric algebra, such as the ostensibly failed academics from a Cambridge research group [1] which the article links to.
I was expecting in the "An Actual Case Against GA" section that the author would demonstrate something like "Geometric Product actually does not work if you apply it to xyz domain". Rather, the section just ended up being mostly about the type of bikeshedding you see about naming of variables in programming.
There is I guess merit to the core "there is no good general interpretation or usage for the geometric product or mixed-grade multivectors" thesis of the article but calling other academics crackpots really subtracts from that message.
Mathematics is a social activity. The research cultures of different branches matter.
especially the part about duals -- made me feel like I was going crazy when I was trying to figure out degenerate metrics: every source deals with it in a slightly different (often sloppy) way; you're sure it all must be possible to resolve and get something beautiful and consistent, but not while you're trying to apply it to a specific problem you need to solve
The start of the article makes a specific technical claims:
> Hestenes’ Geometric Product is not a very good operation and we should not be rewriting all of geometry in terms of it
Later he explains why:
> there is no good general interpretation or usage for the geometric product or mixed-grade multivectors
AFAIK nobody is proposing to replace all of geometry with GA, only 3+1 spacetime.
I guess the people pushing this are a little pushy, but this reminds me of the whole pie fight over the Rust community. OK, so they're pushy. Nothing to do with the merits or demerits of the language (or of C for that matter).
If you're a baby duck about linear algebra and geometry, there's no need to care about different formalisms. Do whatever works. But it's interesting to see how all of this stuff comes together at different levels, whether it's the geometric product, differential forms, or just linear algebra.
> Most of the time we think of complex numbers as vectors in R2 or as rotation+scaling operators, but rarely do we actually we want them in both roles at the same time.
I can give one counterexample.
I was asked to comment on a piece of code that did 2D geometry in Python. There was one piece that was a tangle of trigonometry to find the angular bisector of an angle subtended at the origin by two points.
Using the fact that points can be represented by complex numbers and that rotation is just multiplication one can make that function into a one liner.
√(z1 * z2)
The exact same thing is happening here, only multiplicatively, where z1^(1/2) * z2^(1/2) is a combination with two weights of 1/2 (thus, summing to 1). It is geometrically meaningful to treat 2d vectors (displacements in a plane) as complex numbers, raise them to exponents summing to 1, and then multiply these together to get another vector in the same plane. But it is not generally geometrically meaningful to just multiply one vector by another vector to get a third vector in the same space (because this would require distinguishing some particular direction and magnitude as "1").
But if you have runtime support, it's sorta criminal not to use complex multiplication when applicable.
BTW there is another, equivalent, way of deriving the solution which to me seems more intuitive:
The angular travel from z1 to z2 is
z2 / z1.
√(z2/z1).
√(z2/z1) * z1Because the product of all Galois conjugates is a norm and the determinant of the linear operator defined by general field multiplication of a primitive element when viewing the field extension as a vector space of the extension field over the base field.
Although the geometric interpretation of norms in Galois theory really only works for the complex numbers because only the complex numbers are a field. Quaternions are not a field.
I had the bad fortune of reviewing some GA research articles once upon a time. It was almost embarrassing. Everything of substance had been published in a conceptually cleaner bivector language previously. The only "contribution" was writing everything in terms of weirder, more convoluted concepts that contributed neither technical clarity nor conceptual parsimony.,
This is not an issue when working with non-mixed-grade multivectors, for which dimensional analysis works just fine in the ordinary way. As the linked article notes, exterior algebra/the wedge product is great. Thinking about exterior powers of vector spaces is great. It's the further move of forcing everything into a Procrustean bed of Clifford algebra that is misguided for almost any application other than some spinor stuff.
> It was already widely understood that projective geometry allowed one to represent rotations and translations in R^3 with a single linear operator on R^4.
I think it's projection operators (in linear algebra) that allow one to do that, not projective geometry [1]. The latter, AIUI, studies projective spaces and projective transformations on them (which differ from vector spaces and their transformations by including "points at infinity"), contains no concepts of length or angle (and therefore no equivalent of translations and rotations) and is in some sense "geometry with only the straightedge, no compass".
Curious if I'm just missing something there, though. I'm no expert on any of this.
From a programmer's perspective, it seems like they're saying it's a flawed abstraction, while the GA stance is different. I'd like to hear the other side of the argument too. I'm sure HN will get a long GA comment thread, so from their standpoint, what would it feel like? I agree that merging objects and operators is problematic, but I'm curious what the GA camp would say
i used to use differential form for gauge theories, einstein-cartan gravitation and ramond-ramond fields.
also, in a paper, we used O(D,D) clifford algebras/spinors to represent differential forms, which worked quite well in our very specific case (appendix A)
https://arxiv.org/pdf/1304.1472
ps: i had colleagues that worked on GA for ML in robotics but wasn't really impressed by what it accomplished
But mostly the broad strokes points about the community are exactly the kind of hostility that makes geometric algebra communities so refreshing for curious young people. Geometric algebra is a welcoming pedagogy and community as much as it is a mathematical framework. If only mathematics as a whole was more welcoming.
I started out on with shaky linear algebra despite years of undergraduate education, but plenty of curiosity and intuition. The geometric algebra community schooled me and me prepared me for all kinds of "real math".
Yes the attitude that geometric algebra is the best language for everything is misguided and welcomes a lot of confusion, but most serious geometric algebra people I've met don't actually think that or say that. They're just off doing cool stuff.
That reminds me, I’ve been meaning to rewrite parts of Hormander’s epic with tools from GMT but never found the time.
> Most of the time we think of complex numbers as vectors in R2 or as rotation+scaling operators, but rarely do we actually we want them in both roles at the same time. So it is not very natural to equate the two objects, as opposed to finding a correspondence between them.
> So GA ends up being very stuck because it equates “vectorial objects” and “operators that act on vectorial objects”. It would be better to express all the geometric objects you care about in their most natural forms, and then find isomorphisms between them when it’s necessary to do so. Otherwise all the meanings get blurred together and it’s very confusing. So that’s another problem with geometric algebra: eliding the distinction between vectors and operators is undesirable, confusing, and disingenuous.
Despite trying many times to make greater use of it, I've found that it often just makes a lot of actual physics work less clear, and with very little practical benefit.
There's times where it affords quite pretty notation, but often you have to actually unpeel all that notation before you actually do something with it. And what's the point of nice notation if none of your colleagues can even read it? The only time I ever really found that GA was actually a benefit to me was performing rotations.
And my comment ended up being pretty long, so I will TL;DR it:
1. The social critique doesn’t match my experience and seems under-supported?
2. The technical critique is interesting, looks like a mix of good points, and some that need more work put into it. I think GA is legitimately cool in my opinion, but if there are better abstractions, we should find/define them and use them.
Longer version:
I hear people bring up the conspiracy/crackpot side of GA a lot, but I learned about Geometric Algebra a few years ago and am currently learning it alongside standard linear algebra.
I think GA is pretty cool. The author seems to have some decent points about its limitations and some ontological smells (like, maybe there is a cleaner representation hiding somewhere). But a lot of the criticism is aimed at the social side of the movement, and maybe I am just blind to it, but I have not really run into that much.
The author says things like:
Basically, GA is considered a kooky, crackpotty sideshow. And because it is so dubious and un-self-aware, the movement ends up alienating most people, except for a particular type of… zealous individual… who write about it with a sort of pseudoreligious zeal, and are prone to conspiracy, as if the only reason GA is not mainstream is that they are being oppressed by close-minded traditionalism.
In practice GA always refers to the particular platform and social movement which descends from the work of David Hestenes from the 1960s. It specifically does not refer to the underlying material of Clifford Algebras
Trying to build a unifying framework seems pretty normal to me. Lots of math is trying to expose common structure across different domains. Category theory, abstract algebra, topology, and, to a much bigger extent, the Langlands program all have that flavor. Obviously some unifications are more successful than others, but “this gives a unified language for a bunch of things” does not seem like a red flag by itself.
Some of the actual technical criticisms of GA are interesting, e.g. the proliferation of operations, but at this point I'm more interested in a formal accounting of the complexity of both theories rather than opinions or vibes. It would be nice to have description-length / complexity-accounting comparison of the formalisms.
Disclaimer: I have not read Hestenes’s original work, so maybe I am missing some of the historical baggage. But the modern resources I have seen seem mostly grounded in their claims.
I'm also learning both GA and linear algebra at the same time, GA has definitely helped me understand the linear algebra more deeply. In my opinion, alternative representations like GA gives your brain more structure to grab onto, even if they aren't perfect.
Also... math pedagogy does have a lot of inertia that hurts students. Doesn't Lockhart's Lament famously resonate with anyone who fell in love with math?
[PDF Warning] https://worrydream.com/refs/Lockhart_2002_-_A_Mathematician%...
While it's neat to write them all as one equation, I disagree that it's an enlightening perspective to learn. While it seems like writing Maxwell's equations in one equation instead of two is a step forward with even more symmetry, what is actually going on is that you are obscuring the most important part of Maxwell's equations: the gauge structure. Without this, it actually becomes much more hidden just how geometric electromagnetism is.
When you write Maxwell's equations as the pair `dF = 0`, `d*F = J`, the first of those two equations is exactly what tells you that this is a gauge theory, and thus may write `F = dA` where `A` is a vector potential. This vector potential then becomes the connection which defines a covariant derivative in a fibre bundle, and one then sees that charged particles follow geodesics now in spacetime, but in an enclosing fibre bundle. This is foundationally important to modern physics, and IMO obscured by writing Maxwell's equations as `∇F = J`
____
n.b. I'm not a particularly big fan of differential forms either, I think it leaves a lot to be desired, and it's super awkward to constantly have to pull out Hodge Duals every time you want to do something that involves the metric, but I'm also unconvinced that geometric algebra is the answer here.
i'd add it's quite nice in string theories for RR fields and coupling to D-branes, where writing 10 anti-symmetrized indices quickly gets annoying.. and topological field theories..
However, from the perspective of Yang-Mills theory, that's rather questionable as you're stitching together the Bianchi identity and the Yang-Mills equation for no particular reason.
As opposed to the weird GA form it actually makes the physically most meaningful symmetry (Lorentz transformations) explicit. That's why it's actually used in Physics.
Anti symmetric space time tensors are the absolute standard. Further formulations that reveal other aspects, dualities, symmetries are much more niche and specialized subjects and not how the subject should be taught when first encountering it.
https://en.wikipedia.org/wiki/Covariant_formulation_of_class...
"Standards" are things to be overcome when they've outlived their prime.
Disparaging new ideas as "niche" and "specialised" when their explicit aspiration is to be better foundations is motivated reasoning.
However, translation is an affine transformation, which is a particular case of a projective transformation [0]. It turns out that we can represent 3D affine (and general projective) transformations using a 4x4 matrix -- that is, as linear transformations in one dimension up, in a similar sense as how we can represent complex numbers as particular 2x2 matrices [1]. So yes, projective geometry is the right theoretical lens, even if we're usually able to forget about it (somewhat) when we use matrix representations.
[0]: https://en.wikipedia.org/wiki/Affine_transformation#Represen...
[1]: https://en.wikipedia.org/wiki/Complex_number#Matrix_represen...
Thanks!
The homogeneous coordinate system used to represent affine transforms in R^n using linear transforms in R^(n+1) is exactly the same as what is used to represent projective transforms in the projective space P(R^n). This is famously exploited in 3D graphics where 4x4 matrices can represent linear and affine transforms and perspective projections (modulo the final w-division normalization step).
Affine transforms are a special case of projective transforms where the last row (or column depending on convention) vector is (0, ..., 0, 1).
But if you think about it the other way around, since all programs are ultimately about data transformation, you could argue that UIs should essentially be drawn in SQL, but that would sound strange. That's because the tools we use have moved away from that mental model. (Though React's FRP premise does lean in that direction.)
And when I think about why languages split apart, it seems to me that it's because the word 'programming' covers so many different things at once. Languages end up diverging because they serve different purposes. In fact, as a programmer, I see programming languages as a collection of tools that essentially decide what to give up. C gives you safety and low-level hardware access through its ABI. Python gives you expressiveness. They exist because their target goals are fundamentally different.
In that sense, though I'm not an expert in this field, from my limited perspective this debate feels like it's just the noise that arises when Algebra tries to encompass too much and inevitably splits apart. I imagine these kinds of cases will only increase in the future. As things become more specialized, there will be more situations where existing frameworks don't fit, and new systems will be needed. Is there a term for this phenomenon? At that point, we might say we need to change the old system to fit the new one.
Personally, I wonder if there isn't a general purpose language at the bottom that models the entire world, with other languages layered on top of it.
What makes you say that?
> As I see it, GA is not so much a subject as an ideological position, consisting of basically two ideological claims about the world:
> Claim 1: That the concepts of EA (so, wedge products, multivectors, duality, contraction) are incredibly powerful and ought to be used everywhere, starting at a much lower level of math pedagogy—basically rewriting classical linear algebra and vector calculus.
I support this claim, so I suppose I’m a proponent of geometric algebra.
I think it’s more or less been carried out for vector calculus by Spivak’s “classical” Calculus on Manifolds, which is somewhat widely taught.
> Claim 2: That the Geometric Product (henceforth: GP) should be added to that list as the most fundamental operation, where by “fundamental” I mean that other operations should be constructed in terms of it, and theorems should be stated using it.
Like the author, I also believe this claim is nonsense.
“Rewriting classical linear algebra” is a honored pastime but it’s very difficult to make any headway doing it—the classical texts are classical for a reason, we more or less know how to teach them as an “80% solution” and it’s unclear that the investment in a new pedagogy would get us to an “81% solution.”
Especially with today’s undergrads. If you’re not churning arithmetic, they’re not into it.
The benefit is that multiplication and distributive property is a beauty in the '+' notation, no special rules need to be memorized for multiplying 2d vectors, i*i = -1 takes care of it.
On the other hand I never understood what the benefit, of writing the tuple of wedge and dot products like that, is.
Perhaps I am not being fair, that it is the same idea and I have not used it as much as I have used complex numbers.
Because of that, it just becomes so tempting to try and phrase everything you can in terms of this geometric product. I'm very sympathetic to the temptation, and I even think the geometric product has some great uses (it shows up a lot in some physics I do), and using it makes writing rotations a treat, but I think it's still vastly overemphasized by GA people.
I still don't really know what my favoured notation for differential geometry is, I find myself switching around so much.
Certain kinds of perfect correctness are like pure and shining crystallised bits of refined knowledge created by the greatest wizards. "Parse, don't validate" or "Make invalid states unrepresentable." ought to be familiar to the better programmers here, the ones with decades of experience built on iterative, collaborative foundations with real consequences for error.
Theoretical physics doesn't have those same consequences, because there is no real punishment for their equivalent of "spaghetti code". Perversely, there's cachet to be gained for gaining understanding of its unnecessarily esoteric knowledge, much like how biologists and lawyers spend half a decade or more studying... Latin.[2]
Introducing Geometric Algebra to physics is like that wizard coder who sweeps away reams of spaghetti code and replaces it all with a call to a single standard library function. It's that "cheff's kiss" of cleanup. Meanwhile the juniors are screaming about how the senior "deleted all their hard work!"
Meanwhile, I never understood where Pauli and Dirac matrices came from! It's like they were pulled from fat air.
You've seen this in code, I bet. Some junior worked really hard on solving a problem and wrote a solid screen-filling wall of "a && b || c || !d && e && (f || g)..." continuing up to "ba, bc, bd", etc.. as they ran out single letters until they're well into the alphabet in double-character symbols.[3]
That's what those matrices are. Someone's hacky attempt at "making things work".
The problem is that we gave those people Nobel prizes and told everyone they're geniuses.
They are, but they were like that brilliant junior. Brilliant.. but junior.
Geometric Algebra sweeps all of that into one beautiful, consistent, crystal clear abstraction that is widely applicable. The magic matrix constants vanish. Bugs in 100-year-old textbook formulas suddenly come to light. Dozens of formulas, one set for each of the 1D, 2D, 3D, and 4D cases collapse into a single formula valid for any number of dimensions.
It's like watching someone struggle with "catching every possible instance of JavaScript injection".
No son, no. Just no. Stop enumerating badness. Stop. Just stop. Escape everything at the boundary instead, enforced by the type system. You'll thank me later.
I know it might be obvious to you, and you always use properly parameterised SQL queries or whatever. This is not the norm everywhere! I still get arguments, long drawn out arguments from people convinced that this is unnecessary and just one more search & replace is all they need to be safe from the bad hackers.
Physicists (and mathematicians) are still making that argument against GA.
"It's isomorphic!"
"That isn't the point!"
[1] You can't convince someone to climb Everest if they struggled to hike up to the top of one of its foothills.
[2] Let me be crystal clear: They're spending their precious time on this Earth learning a dead language instead of learning about the law or bugs. No amount of arguments will sway me. The bugs don't care what you call them. Criminals are guilty or innocent whether or not you speak funny in court. You've just made a simple thing harder for no good reason, that is all. Please stop.
[3] Yes, I've seen this. Twice, from two different people whom have never met. Aliens are amongst us.
I mean, come on, lawyers and biologists don't really spend half a decade studying Latin. You can tell because smart people that spend a year or two studying Latin are conversationally fluent in it, and lawyers aren't.
They spend a month or two memorizing some latin words that could have been in English, and then (for biologists, lawyers just stop there) years memorizing lots of names of things that they'd have to memorize no matter what language they were in, and it's not really any slower in Latin than it would be in English once you spent that O(1) effort to get used to it.
Like us (systems) programmers don't spend decades studying the C language, we spend a year or two getting comfortable in C and then the rest of our careers learning all sorts of interesting ideas like generational GC that come phrased in pseudo-C but might as well have been phrased in English pseudocode with a similar cognitive load to grokking them.
That wonderful popcnt() algorithm that uses 0x33333333 and 0x55555555 constants would be just as hard to decipher if it was written in plain English.
I agree about the importance of alternative representations, but, people should be somewhat careful about which ones they're espousing. Sometimes people get quite enthusiastic about wedge products and then think what they're excited about is geometric algebra. Personally I would like to see wedge products taught alongside vector algebra and calculus. But I don't see a useful place to include the geometric product, except as more better way of stating things about actual Clifford algebras (quaternions and gamma matrices). I do suspect that there is a 'better' version of GA that is important than that, but I haven't seen it described.
Yep, me too. Maybe someday the HoTT folks will get around to formalizing it and standardizing the notation. /j
You need an optimizing compiler that would take the high level description and compile it to add subtract multiply divide of reals. I don't think we have that yet.
Till we have such a compiler it will be tempting to drop down to assembly. Assembly being a metaphor.
If I were in the GA Marketing Committee I'd publish a paper with suitably hand-picked worked examples where the vector approach is long and tedious, and GA version is short and sweet.
Without it, I think it'd be of significantly less mathematical interest because it'd lose almost all of its geometric properties.
Same with programming languages. Some people are like RUST RUST RUST and some are like C C C! I'm like, you guys only use one language?
The only thing that needed care was which sign of the sqrt bisects the internal angle as opposed to the external angle.
In general I prefer not to deal with angles when dealing with 2D rotation. Get inputs in angles if need be and from then onwards use the (cos,sin) tuple or, equivalently, use complex numbers. One can get rid of calls to trascendentals as long as you are happy to call sqrt.
In other words angle is a tuple.
The same calculation works in R^n, incidentally, using the geometric product. This is pretty much the ideal usecase for it, for constructing operators between vectors.