Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World

Data Science and LLM (LLaMA vs. GPT-3): A Revolution That Will Change the World(medium.com)

6 points by dhdhd1 3 years ago | 6 comments

blackhat2017 3 years ago |

we need an open GPT, its becoming more and more centralized instead of becoming open source as Elon intended for.

version_five 3 years ago | |

LAION is working on an open chatgpt like model [0] and there is a project discussed here recently that is about running the llms on single gpus [1]

I agree, there is a very serious risk of newer AI advances being closed by default, and I think it's not being taken seriously enough.

Even "open" players are still for-profit, say Huggingface. There really needs to be Linux or FSF like players that are motivated by freedom.

[0] https://github.com/LAION-AI/Open-Assistant [1] https://github.com/FMInference/FlexGen

smoldesu 3 years ago | |

As many have said before, there are open GPT models you can use. You can't run ChatGPT yourself, but you don't have the resources to run it anyways.

You can get relatively SOTA models running locally, it just requires a lot of compute.

rani08 3 years ago | |

One day we will be kicked out of our Jobs

dhdhd1 3 years ago |

training the GPT-3 175B model required 3.2 million core hours spread across 285,000 processor cores over several months. It is projected that the overall cost of training the model will be roughly $4.6 million.

rani08 3 years ago | |

We are doomed