Instructions to use facebook/llm-compiler-13b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use facebook/llm-compiler-13b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("facebook/llm-compiler-13b", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Are there plans to use LLM-compiler for performance optimization?
#4 opened 4 months ago
by
coong2
Adding `safetensors` variant of this model
#3 opened over 1 year ago
by
SFconvertbot
A problem encountered by the llm compiler when generating IR from source code
#2 opened over 1 year ago
by
terry2334