Show HN: Xcc700: Self-hosting mini C compiler for ESP32 (Xtensa) in 700 lines

Show HN: Xcc700: Self-hosting mini C compiler for ESP32 (Xtensa) in 700 lines(github.com)

154 points by isitcontent 207 days ago | 36 comments

Repo: https://github.com/valdanylchuk/xcc700

Hi Everyone! I just wrote my first compiler!

- single pass, recursive descent, direct emission

- generates REL ELF binaries, runnable using ESP-IDF elf_loader

- very basic features only, just enough for self-hosting

- treats the Xtensa CPU as a stack machine for simplicity, no register allocation / window usage

- compilable on Mac, probably also Linux, can cross-compile for esp32 there

- wrote for fun / cyberdeck project

Sample output from esp32:

    xcc700.elf xcc700.c -o /d/cc.elf
    
    [ xcc700 ] BUILD COMPLETED > OK
    > IN  : 700 Lines / 7977 Tokens
    > SYM : 69 Funcs / 91 Globals
    > REL : 152 Literals / 1027 Patches
    > MEM : 1041 B .rodata / 17120 B .bss
    > OUT : 27735 B .text / 33300 B ELF
    [ 40 ms ] >> 17500 Lines/sec <<

My best hope is that some fork might grow into a unique nice language tailored to the esp32 platform. I think it is underrated in userland hobby projects.

ValdikSS 206 days ago |

In case anyone interested, you can run (nommu) Linux on ESP32 Xtensa boards

https://github.com/jcmvbkbc/esp32-linux-build

ESP32-S3 N16R8 is <$5 on aliexpress:

    - Dual-core Xtensa 240 MHz
    - 16 MB NOR flash (eXecute-in-place supported)
    - 8 MB (PS)RAM
    - Wi-Fi 2.4 GHz 802.11n, Bluetooth

As well as Zephyr, NuttX RTOSes, MicroPython.

no_time 206 days ago | |

>eXecute-in-place supported

Losing this when you load ELFs is kind of a bummer. Probably a dumb question but I wonder if it'd be possible to only swap in the parts of the binary that are needed at any given time.

ValdikSS 206 days ago | | |

swap requires MMU, so no, unfortunately. But there are tricks to have XIP userspace: cramfs supports it, as well as a special AXFS file system.

cramfs parses ELF files and marks XIP only a .text/ro segments of it, not the whole file.

https://github.com/npitre/cramfs-tools/commit/2325ed2de8fd17...

artemonster 206 days ago | |

What is your username?

uecker 206 days ago |

Cool! And I do think the world needs more C compilers. There is so much you could do with this language, but it needs to be disentangled from the C++ compiler behemoths. (yes, I now that there are other small C compilers)

isitcontent 206 days ago | |

There is the TCC. Adapting that would probably be a faster path to a full featured C compiler on esp32 than building up my xcc700. This is more of an educational sandbox project.

uecker 206 days ago | | |

I know, and there are chibicc, kefir, etc. .. and I have my own experimental C compiler.

pjmlp 206 days ago | |

What we need is safety improvements in C, we already have enough security exploits in the standard library, strings and arrays, no need for more, without fixing what is broken since 1979 (lint birth year).

uecker 206 days ago | | |

I am looking forward to your contributions.

boznz 207 days ago |

Cool, always refreshing to see different approaches to the same problem, and you learn so much by doing, this is more the kind of tinkering I will be doing in retirement.

saidnooneever 206 days ago |

hats off. this is really easy to read and well written and easy to comprehend code imho because it only support basic features. its a really nice example to read through thanks. nice inspiration to see its possible to roll your own for this with a bit restricted featureset and goals :).

fuhsnn 206 days ago | |

This one[1] is similar in style and supports a bit more C constructs. [1] https://github.com/Lulzx/sectorc/blob/master/stage5/cc.c

ladyanita22 206 days ago |

That's super cool! I have been wondering what could be done with ESP32 if it weren't for the lack of RAM.

As a fun of Rust, one thing that saddens me is knowing these things would be difficult to achieve with a Rust compiler, given the language seems to be vastly more complex.

Unless someone created a subset of Rust without (some?) safety checks, I guess.

isitcontent 206 days ago | |

Right, Rust is more complex, and it is the complex bits that make it Rust. There are sure some shortcuts possible for starters, for example scope-based lifetimes like in early Rust versions, but still, to make it a worthwhile upgrade over C, it would take some intermediate representation, and definitely more than 700 lines.

There is a lively movement for coding in Rust for esp32, that works, just not on the device I think.

apitman 206 days ago | | |

I would love to see something like C with a borrow checker and Result/Option but not the fancy type system.

pjmlp 206 days ago | |

Everything that was possible on PCs with MS-DOS.

I think people have no clue how powerful ESP 32 actually is.

https://en.wikipedia.org/wiki/Amstrad_PC1512

MobiusHorizons 206 days ago |

Very cool! What was the shell you are running in the demo video?

isitcontent 206 days ago | |

Thanks! That is just my small custom experimental mini shell. This project started as a retro DOS-like cyberdeck, and first thing I tried to run there was DOS programs, which is why it looks like that. Only got to COM files, when I learned about elf_loader, so I now focus on that. I might extract and release whatever is valuable/reusable in that shell later on.

MobiusHorizons 206 days ago | | |

Yeah, very cool. I was thinking about possibly porting it to risc-v and using it on my fpga based core. I was trying to build a monitor style shell, but C like environment would be very cool.

guestbest 206 days ago | | |

Thanks for posting this here. I star’d the project. Getting a portable computer with a minimal flexible and previously well supported operating system was one of my goals for the esp32 as well. I’ll be watching for more.

nunobrito 206 days ago |

Can this run ELF programs that are placed on the memory card?

isitcontent 206 days ago | |

I only wrote the compiler. But ESP-IDF elf_loader component can do that, yes.