fastapi
uvicorn[standard]
sentencepiece
beautifulsoup4
pydantic
torch
transformers
accelerate
llama-cpp-python