oneuptime/Llama/Readme.md

# Llama 

## Prepare 

- Download models from meta
- Once the model is downloaded, place them in the `Llama/Models` folder. Please make sure you also place tokenizer.model and tokenizer_checklist.chk in the same folder.
- Edit `Dockerfile` to include the model name in the `MODEL_NAME` variable.
- Docker build 

```
docker build -t llama . -f ./Llama/Dockerfile
```

## Run

```
docker run -it llama
```


## Run without a docker conatiner

uvicorn app:app --host 0.0.0.0 --port 8547
male llama work 2023-10-14 15:36:12 +00:00			`# Llama`

			`## Prepare`

			`- Download models from meta`
			- Once the model is downloaded, place them in the `Llama/Models` folder. Please make sure you also place tokenizer.model and tokenizer_checklist.chk in the same folder.
			- Edit `Dockerfile` to include the model name in the `MODEL_NAME` variable.
			`- Docker build`

			```
			`docker build -t llama . -f ./Llama/Dockerfile`
			```

			`## Run`

			```
fix llama 2023-10-14 16:59:52 +00:00			`docker run -it llama`
make llama work with rest api 2023-10-16 10:45:15 +00:00			```


			`## Run without a docker conatiner`

			`uvicorn app:app --host 0.0.0.0 --port 8547`