Three-LLM: Three.js-based WebGPU LLM inference engine

Three-LLM: Three.js-based WebGPU LLM inference engine(three-llm.ben3d.ca)

12 points by bhouston 3 days ago | 5 comments

esperent 3 days ago |

What makes a 3d graphics rendering engine a good fit for llm inference?

bhouston 3 days ago | |

ThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development:

https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan...

anematode 3 days ago | | |

That makes very little sense when you can just use WebGPU and have fine-grained control...

for something like LLM inference, having this kind of abstraction seems like quite a hindrance

jauntywundrkind 3 days ago |

can someone please go ham on a newer three.js, preferably with a lot of A-frame built in, for the modern era, that is also webgpu native? pretty please?