Prerequisites

• Anaconda
• NVIDIA GPU
• GIT

Steps

1. Run the following commands to activate conda:

   conda create -n textgen python=3.10.9
   conda activate textgen
   

2. Install Pytorch:

   pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
   

3. Clone the repo:

   git clone https://github.com/oobabooga/text-generation-webui
   cd text-generation-webui
   

4. Install the Python requirements:

   python -m pip install -r requirements.txt
   python -m torch.utils.collect_env # optional, checks that you have CUDA enabled
   

5. Start the server:

   python server.py