fastapi
uvicorn
pydantic
transformers>=4.41.0
torch
accelerate
bitsandbytes