README.md

vllm-test

conda create -n vllm_test python=3.11 conda activate vllm_test pip install -r requirements.txt

environment settings

Please set the following environment variables first

export SHOPPAL_VLLM_API_URL=
export SHOPPAL_VLLM_MODEL_NAME=
export SHOPPAL_VLLM_API_KEY=