oneuptime/LLM/Dockerfile.tpl

# Use an official Python runtime as a parent image
FROM huggingface/transformers-pytorch-gpu:latest

# Set the working directory in the container to /app
WORKDIR /app

# Copy the current directory contents into the container at /app
ADD . /app

# Install any needed packages specified in requirements.txt
RUN pip install --no-cache-dir -r requirements.txt

# Make port 8547 available to the world outside this container
EXPOSE 8547

# Run app.py when the container launches
CMD ["uvicorn", "app:app", "--host", "0.0.0.0", "--port", "8547" ]
add python app for llama. 2023-10-15 17:14:15 +00:00			`# Use an official Python runtime as a parent image`
refactor: Update Dockerfile.tpl to use huggingface/transformers-pytorch-gpu image This commit updates the Dockerfile.tpl to use the huggingface/transformers-pytorch-gpu image instead of the continuumio/anaconda3 image. This change allows the Llama app to utilize GPU resources for improved performance in AI processing. Additionally, the unnecessary installation of the transformers and accelerate libraries is removed as they are already included in the huggingface/transformers-pytorch-gpu image. 2024-06-19 13:06:23 +00:00			`FROM huggingface/transformers-pytorch-gpu:latest`
male llama work 2023-10-14 15:36:12 +00:00
add python app for llama. 2023-10-15 17:14:15 +00:00			`# Set the working directory in the container to /app`
			`WORKDIR /app`
add create by 2023-10-01 11:46:51 +00:00
add python app for llama. 2023-10-15 17:14:15 +00:00			`# Copy the current directory contents into the container at /app`
chore: Update Dockerfile and docker-compose.llm.yml for LLM models This commit updates the Dockerfile and docker-compose.llm.yml files to include the LLM Models directory. The Dockerfile now uses the `ADD .` command to copy the entire repository into the container at `/app`, and the docker-compose.llm.yml file has been modified to set the context to the `./LLM` directory. These changes ensure that the LLM Models directory is included in the Docker image and that the correct context is used for building the image. 2024-06-28 17:59:43 +00:00			`ADD . /app`
add create by 2023-10-01 11:46:51 +00:00
add python app for llama. 2023-10-15 17:14:15 +00:00			`# Install any needed packages specified in requirements.txt`
			`RUN pip install --no-cache-dir -r requirements.txt`
add create by 2023-10-01 11:46:51 +00:00
refactor: Update Dockerfile.tpl to expose port 8547 instead of port 80 This commit modifies the Dockerfile.tpl file to update the EXPOSE directive. The port number is changed from 80 to 8547 to align with the port used by the Llama application. This change ensures that the Llama application is accessible from outside the container on the correct port. 2024-06-18 17:42:11 +00:00			`# Make port 8547 available to the world outside this container`
fix llama docker file. 2023-10-18 10:01:15 +00:00			`EXPOSE 8547`
add create by 2023-10-01 11:46:51 +00:00
add python app for llama. 2023-10-15 17:14:15 +00:00			`# Run app.py when the container launches`
fix llama docker file. 2023-10-18 10:01:15 +00:00			`CMD ["uvicorn", "app:app", "--host", "0.0.0.0", "--port", "8547" ]`