Hi HN! My Corona project has finally come far enough for me to show it to the world :)

alkymi is a pure Python (3.5+) library for describing and executing tasks and pipelines with built-in caching and conditional evaluation based on checksums.

I started writing alkymi because I was tired of using Make or similar tools to automate testing/validation of algorithms (data -> algorithm -> report). I've found that although most of my data preparation code, as well as the report generation code, is written in Python, I end up having to wrap all the Python code as CLI scripts to interface with Make. This breaks testing, type checking and generally just makes it really easy to make mistakes (no IDE autocomplete!).

You can view the docs at https://alkymi.readthedocs.io/en/latest/. The docs also contain examples, such as https://alkymi.readthedocs.io/en/latest/examples/mnist.html.

I really hope you find the project interesting, and am looking forward to feedback and (hopefully!) having someone else give it a try.