From 2bbbb6a928a16e5511358501105163b736c86292 Mon Sep 17 00:00:00 2001 From: Laura Jordana Date: Tue, 25 Jun 2024 16:26:44 -0400 Subject: [PATCH 1/3] update k8s release link to v0.2.2 --- docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md b/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md index 1f58dcf7..7cb0b9d5 100644 --- a/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md +++ b/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md @@ -61,7 +61,7 @@ helm install --wait -n gpu-operator --create-namespace gpu-operator nvidia/gpu-o For NKE 2.9, refer the [official documentation](https://portal.nutanix.com/page/documents/details?targetId=Release-Notes-Nutanix-Kubernetes-Engine-v2_9:top-validated-config-r.html) for the validated config. ### Download nutanix package and Install python libraries -Download the **v0.2** release version from [NAI-LLM-K8s Releases](https://github.com/nutanix/nai-llm-k8s/releases/tag/v0.2) and untar the release. Set the working directory to the root folder containing the extracted release. +Download the **v0.2.2** release version from [NAI-LLM-K8s Releases](https://github.com/nutanix/nai-llm-k8s/releases/tag/v0.2.2) and untar the release. Set the working directory to the root folder containing the extracted release. ``` export WORK_DIR=absolute_path_to_empty_release_directory mkdir $WORK_DIR From 9f2137f9a4090c063672c1e5617916451f1784e5 Mon Sep 17 00:00:00 2001 From: Laura Jordana Date: Sat, 6 Jul 2024 15:29:27 -0700 Subject: [PATCH 2/3] HF token no longer needed in run.sh --- docs/gpt-in-a-box/kubernetes/v0.2/inference_server.md | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/docs/gpt-in-a-box/kubernetes/v0.2/inference_server.md b/docs/gpt-in-a-box/kubernetes/v0.2/inference_server.md index 85dfce72..58cb9b06 100644 --- a/docs/gpt-in-a-box/kubernetes/v0.2/inference_server.md +++ b/docs/gpt-in-a-box/kubernetes/v0.2/inference_server.md @@ -2,7 +2,7 @@ Run the following command for starting Kubeflow serving and running inference on the given input: ``` -bash $WORK_DIR/llm/run.sh -n -g -f -m -e [OPTIONAL -d -v -t ] +bash $WORK_DIR/llm/run.sh -n -g -f -m -e [OPTIONAL -d -v ] ``` * **n**: Name of a [validated model](validated_models.md) @@ -12,7 +12,6 @@ bash $WORK_DIR/llm/run.sh -n -g -f +bash $WORK_DIR/llm/run.sh -n llama2_7b -d data/summarize -g 1 -e llm-deploy -f '1.1.1.1:/llm' -m /mnt/llm ``` ### Cleanup Inference deployment From a740fbc6eb2a8002016bcd5f0ac99af38069ef33 Mon Sep 17 00:00:00 2001 From: Laura Jordana Date: Thu, 25 Jul 2024 09:42:59 -0700 Subject: [PATCH 3/3] add version to solution name --- docs/gpt-in-a-box/kubernetes/v0.1/getting_started.md | 2 +- docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md | 2 +- docs/gpt-in-a-box/kubernetes/v0.2/validated_models.md | 2 +- docs/gpt-in-a-box/overview.md | 4 ++-- docs/gpt-in-a-box/support.md | 6 +++--- docs/gpt-in-a-box/vm/v0.2/getting_started.md | 2 +- docs/gpt-in-a-box/vm/v0.3/getting_started.md | 2 +- docs/gpt-in-a-box/vm/v0.3/validated_models.md | 2 +- mkdocs.yml | 2 +- 9 files changed, 12 insertions(+), 12 deletions(-) diff --git a/docs/gpt-in-a-box/kubernetes/v0.1/getting_started.md b/docs/gpt-in-a-box/kubernetes/v0.1/getting_started.md index e26dfd54..3dcbb811 100644 --- a/docs/gpt-in-a-box/kubernetes/v0.1/getting_started.md +++ b/docs/gpt-in-a-box/kubernetes/v0.1/getting_started.md @@ -1,5 +1,5 @@ # Getting Started -This is a guide on getting started with GPT-in-a-Box deployment on a Kubernetes Cluster. You can find the open source repository for the K8s version [here](https://github.com/nutanix/nai-llm-k8s). +This is a guide on getting started with GPT-in-a-Box 1.0 deployment on a Kubernetes Cluster. You can find the open source repository for the K8s version [here](https://github.com/nutanix/nai-llm-k8s). ## Setup diff --git a/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md b/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md index 7cb0b9d5..e3c52af2 100644 --- a/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md +++ b/docs/gpt-in-a-box/kubernetes/v0.2/getting_started.md @@ -1,5 +1,5 @@ # Getting Started -This is a guide on getting started with GPT-in-a-Box deployment on a Kubernetes Cluster. You can find the open source repository for the K8s version [here](https://github.com/nutanix/nai-llm-k8s). +This is a guide on getting started with GPT-in-a-Box 1.0 deployment on a Kubernetes Cluster. You can find the open source repository for the K8s version [here](https://github.com/nutanix/nai-llm-k8s). ## Setup diff --git a/docs/gpt-in-a-box/kubernetes/v0.2/validated_models.md b/docs/gpt-in-a-box/kubernetes/v0.2/validated_models.md index 3ed7c8b6..0e31b95a 100644 --- a/docs/gpt-in-a-box/kubernetes/v0.2/validated_models.md +++ b/docs/gpt-in-a-box/kubernetes/v0.2/validated_models.md @@ -1,6 +1,6 @@ # Validated Models for Kubernetes Version -GPT-in-a-Box has been validated on a curated set of HuggingFace models Information pertaining to these models is stored in the ```llm/model_config.json``` file. +GPT-in-a-Box 1.0 has been validated on a curated set of HuggingFace models Information pertaining to these models is stored in the ```llm/model_config.json``` file. The Validated Models are : diff --git a/docs/gpt-in-a-box/overview.md b/docs/gpt-in-a-box/overview.md index f9bd01f5..8f3d6c2b 100644 --- a/docs/gpt-in-a-box/overview.md +++ b/docs/gpt-in-a-box/overview.md @@ -1,6 +1,6 @@ -# Nutanix GPT-in-a-Box Documentation +# Nutanix GPT-in-a-Box 1.0 Documentation -Welcome to the official home dedicated to documenting how to run Nutanix GPT-in-a-Box. Nutanix GPT-in-a-Box is a new turnkey solution that includes everything needed to build AI-ready infrastructure. Here, you'll find information and code to run Nutanix GPT-in-a-Box on Virtual Machines or Kubernetes Clusters. +Welcome to the official home dedicated to documenting how to run Nutanix GPT-in-a-Box 1.0. Nutanix GPT-in-a-Box 1.0 is a turnkey solution that includes everything needed to build AI-ready infrastructure. Here, you'll find information and code to run Nutanix GPT-in-a-Box 1.0 on Virtual Machines or Kubernetes Clusters. This new solution includes: diff --git a/docs/gpt-in-a-box/support.md b/docs/gpt-in-a-box/support.md index f2f75c64..7ac49a3c 100644 --- a/docs/gpt-in-a-box/support.md +++ b/docs/gpt-in-a-box/support.md @@ -1,14 +1,14 @@ -# Nutanix GPT-in-a-Box Support +# Nutanix GPT-in-a-Box 1.0 Support Nutanix maintains public GitHub repositories for GPT in a box. Support is handled directly via the repository. Issues and enhancement requests can be submitted in the Issues tab of the relevant repository. Search for and review existing open issues before submitting a new issue. To report a new issue navigate to the GitHub repository: [GitHub - nutanix/nai-llm ](https://github.com/nutanix/nai-llm) -This is the official repository for the virtual machine version of Nutanix GPT-in-a-Box. +This is the official repository for the virtual machine version of Nutanix GPT-in-a-Box 1.0. [GitHub - nutanix/nai-llm-k8s](https://github.com/nutanix/nai-llm-k8s) -This is the official repository for the Kubernetes version of Nutanix GPT-in-a-Box. +This is the official repository for the Kubernetes version of Nutanix GPT-in-a-Box 1.0. The support procedure is documented in [KB 16159](https://portal.nutanix.com/page/documents/kbs/details?targetId=kA0VO0000000dJ70AI). diff --git a/docs/gpt-in-a-box/vm/v0.2/getting_started.md b/docs/gpt-in-a-box/vm/v0.2/getting_started.md index 8c3dad24..d5ac8d3e 100644 --- a/docs/gpt-in-a-box/vm/v0.2/getting_started.md +++ b/docs/gpt-in-a-box/vm/v0.2/getting_started.md @@ -1,5 +1,5 @@ # Getting Started -This is a guide on getting started with GPT-in-a-Box deployment on a Virtual Machine. You can find the open source repository for the virtual machine version [here](https://github.com/nutanix/nai-llm). +This is a guide on getting started with GPT-in-a-Box 1.0 deployment on a Virtual Machine. You can find the open source repository for the virtual machine version [here](https://github.com/nutanix/nai-llm). Tested Specifications: diff --git a/docs/gpt-in-a-box/vm/v0.3/getting_started.md b/docs/gpt-in-a-box/vm/v0.3/getting_started.md index c868c75d..2603c5fe 100644 --- a/docs/gpt-in-a-box/vm/v0.3/getting_started.md +++ b/docs/gpt-in-a-box/vm/v0.3/getting_started.md @@ -1,5 +1,5 @@ # Getting Started -This is a guide on getting started with GPT-in-a-Box deployment on a Virtual Machine. You can find the open source repository for the virtual machine version [here](https://github.com/nutanix/nai-llm). +This is a guide on getting started with GPT-in-a-Box 1.0 deployment on a Virtual Machine. You can find the open source repository for the virtual machine version [here](https://github.com/nutanix/nai-llm). Tested Specifications: diff --git a/docs/gpt-in-a-box/vm/v0.3/validated_models.md b/docs/gpt-in-a-box/vm/v0.3/validated_models.md index f92cd1dc..0f4aebd0 100644 --- a/docs/gpt-in-a-box/vm/v0.3/validated_models.md +++ b/docs/gpt-in-a-box/vm/v0.3/validated_models.md @@ -1,6 +1,6 @@ # Validated Models for Virtual Machine Version -GPT-in-a-Box has been validated on a curated set of HuggingFace models. Information pertaining to these models is stored in the ```llm/model_config.json``` file. +GPT-in-a-Box 1.0 has been validated on a curated set of HuggingFace models. Information pertaining to these models is stored in the ```llm/model_config.json``` file. The Validated Models are : diff --git a/mkdocs.yml b/mkdocs.yml index d0aa99a2..dd0265cb 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -141,7 +141,7 @@ nav: - "Manual": "anthos/install/manual/index.md" - "Amazon EKS Anywhere": - "Install": "eksa/install/index.md" - - "GPT-in-a-Box": + - "GPT-in-a-Box 1.0": - "Overview": "gpt-in-a-box/overview.md" - "Deploy on Virtual Machine": - "v0.3":