chore(docs/install.sh): image changes#5354
Merged
Merged
Conversation
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
mudler
changed the title
✅ Deploy Preview for localai ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
github-actions
Bot
added
the
kind/documentation
Owner
Author
|
this has to wait after the new release is out |
richiejp
reviewed
May 12, 2025
Collaborator
richiejp
left a comment
richiejp
left a comment
There was a problem hiding this comment.
I'm not sure if the images in the readme match for intel at least.
| docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-gpu-intel-f16 | ||
|
|
||
| # Intel GPU with FP16 support and extra dependencies | ||
| docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-gpu-intel-f16-extras |
Collaborator
There was a problem hiding this comment.
Presently this image doesn't exist on Docker hub, but we do have master-sycl-f16-extras
Collaborator
There was a problem hiding this comment.
I see further down some extras images are added for the other GPUs, but intel seems to be different and we have gpu-intel and sycl?
Owner
Author
There was a problem hiding this comment.
right there is some inconsistency with intel, however the images are already pushed. let's have another round on making more consistent naming for images
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR updates docs around the latest image changes.
This pull request introduces significant updates to the documentation and installation script for LocalAI, with a focus on supporting additional GPU configurations, simplifying image selection, and improving usability. The changes include new Docker image tags for various GPU types, updates to environment variables, and enhancements to the installation script to handle these new options.
Docker Image Updates:
latest-gpu-vulkan,latest-gpu-intel-f16-extras). Added AIO (all-in-one) images for pre-downloaded models. (README.md,docs/content/docs/getting-started/container-images.md) [1] [2] [3]Environment Variable Enhancements:
USE_EXTRASandUSE_VULKANto enable images with extra Python dependencies or Vulkan GPU support. Updated documentation to reflect these additions. (docs/content/docs/advanced/installer.md,docs/static/install.sh) [1] [2]Installation Script Updates:
install.shscript to automatically detect and configure GPU-specific Docker images based on the new environment variables. Simplified image tag selection logic and added support for Vulkan GPUs. (docs/static/install.sh) [1] [2]Documentation Improvements:
docs/content/docs/getting-started/container-images.md) [1] [2]Minor Fixes:
docs/static/install.sh)Notes for Reviewers
Signed commits