Lit-Parrot Homepage, Documentation and Downloads – A Hackable Implementation of Large Language Models – News Fast Delivery
Lit-Parrot is an implementation of the nanoGPT-based StableLM/Pythia/INCITE language model. Supports flash attention, LLaMA-Adapter fine-tuning, and pre-training. Hackable implementations of state-of-the-art open source large language models: This implementation is based onLit-LLaMAandnanoGPT, powered byLightning Fabricprovide support. The weights can be downloaded as follows: Design Principles This repository follows openness through clarity main principles. Lit-Parrot yes: […]