Directly run and investigate Llama models locally

Directly run and investigate Llama models locally(github.com)

8 points by anordin95 1 year ago | 1 comment

anordin95 1 year ago |

There are other popular ways to invoke these models, such as Ollama and Hugging-Face's general API package: transformers, but those hide the interesting details behind an API. I want to peel back the layers, poke, prod, understand and gain insight into these models and help you do the same.

anordin95 1 year ago |

There are other popular ways to invoke these models, such as Ollama and Hugging-Face's general API package: transformers, but those hide the interesting details behind an API. I want to peel back the layers, poke, prod, understand and gain insight into these models and help you do the same.