Metadata-Version: 2.3
Name: mistralrs-mkl
Version: 0.7.0
Classifier: Programming Language :: Rust
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3.10
Summary: Fast, flexible LLM inference.
Keywords: machine-learning
Home-Page: https://github.com/EricLBuehler/mistral.rs
Author: Eric Buehler
License: MIT
Requires-Python: >=3.10
Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM
Project-URL: Source Code, https://github.com/EricLBuehler/mistral.rs

# mistralrs Python SDK

`mistralrs` is the Python SDK for [mistral.rs](https://github.com/EricLBuehler/mistral.rs), a blazing-fast LLM inference engine.

## Documentation

For full documentation, see:
- [Python SDK Documentation](https://ericlbuehler.github.io/mistral.rs/PYTHON_SDK.html)
- [Installation Guide](https://ericlbuehler.github.io/mistral.rs/PYTHON_INSTALLATION.html)

## Quick Install

```bash
pip install mistralrs-cuda   # NVIDIA GPUs
pip install mistralrs-metal  # Apple Silicon
pip install mistralrs        # CPU only
```

