Ask HN: Where do I begin studying to run LLMs locally or in a private cloud? Where do I begin studying if my goal is to run LLMs locally or in a private cloud with solid software engineering practices? I am unsure of where to even begin. Let's say I want to: 0.) Find the locally run LLMs and identify which are applicable. 1.) Containerize the LLMs 2.) Use source control to capture changes to the LLM. Versioning output. 3.) Develop repeatable pipelines driven by APIs for sending data to it. 4.) Prompt engineering. 5.) Best ways to use langchain (or others) to make the system data-aware and agentic. Any thoughts are appreciated. |