llm_topic_modelling / requirements_gpu.txt
seanpedrickcase's picture
Added framework of support for Azure models (although untested)
138286c
raw
history blame
1.04 kB
pandas==2.3.2
gradio==5.44.1
transformers==4.56.0
spaces==0.40.1
boto3==1.40.22
pyarrow==21.0.0
openpyxl==3.1.5
markdown==3.7
tabulate==0.9.0
lxml==5.3.0
google-genai==1.33.0
azure-ai-inference==1.0.0b9
azure-core==1.35.0
html5lib==1.1
beautifulsoup4==4.12.3
rapidfuzz==3.13.0
python-dotenv==1.1.0
#
# Torch and Llama CPP Python
torch==2.6.0 --extra-index-url https://download.pytorch.org/whl/cu124 # Latest compatible with CUDA 12.4
# For Linux:
#https://github.com/abetlen/llama-cpp-python/releases/download/v0.3.16-cu124/llama_cpp_python-0.3.16-cp311-cp311-linux_x86_64.whl
# For Windows:
https://github.com/seanpedrick-case/llama-cpp-python-whl-builder/releases/download/v0.1.0/llama_cpp_python-0.3.16-cp311-cp311-win_amd64.whl
# If above doesn't work for Windows, try looking at'windows_install_llama-cpp-python.txt' for instructions on how to build from source
# If none of the above work for you, try the following:
# llama-cpp-python==0.3.16 -C cmake.args="-DGGML_CUDA=on -DGGML_CUBLAS=on"
bitsandbytes==0.47.0
accelerate==1.10.1