NVIDIA vGPU Software v 10.0
Hi All
Its time to plan updating your NVIDIA TESLA M6, M10, M60, P4, P6, P40, P100, V100, T4, RTX6000, RTX8000 with NVIDIA vGPU software 10.0. NVIDIA have released new drivers for vGPU 10.0.
I have in this article also included which Public Cloud instance is available with NVIDIA GPUs and which license is BYO or provided by the public cloud provider such as Alibaba, Azure, AWS, GCP, Alibaba.
For a list of validated server platforms, refer to NVIDIA vGPU Certified Servers.
Important:
- Citrix XenServer 7.0, 7.1 is not supported with NVIDIA Tesla T4
- NVIDIA vGPU 10.0 is supported with VMware Horizon 7.11, 7.10, 7.9, 7.8, 7.7, 7.6, 7.5, 7.4, 7.3, 7.2, 7.1, 7.0, 6.2
- NVIDIA vGPU 10.0 is only supported with Citrix Virtual Apps & Desktops 7.15, 7 1808, 7 1903, 7 1906, 7 1909, 7 1912 in HDX 3D Pro mode
- If you are a customer using XenServer 7.2, 7.3, 7.4, 7.5 its no longer supported with NVIDIA vGPU 10.0 and should plan upgrading to Citrix Hypervisor 8.1
This release includes the following software:
- NVIDIA vGPU Manager version 440.43 for the Citrix Hypervisor, VMware vSphere, RHEL KVM, Nutanix AHV
- NVIDIA Windows driver version 441.66
- NVIDIA Linux driver version 440.43
New Features in Release 10.0
- Support for NVIDIA® GRID™ Virtual PC and GRID Virtual Applications on Quadro RTX 6000 and Quadro RTX 8000 GPUs
- Increase in the maximum number of virtual display heads supported by -1Q, -2B, and -1B4 vGPUs:
- All -1Q vGPUs now support 4 heads instead of 2 heads.
- All -2B vGPUs now support 4 heads instead of 2 heads.
- All -1B4 vGPUs now support 4 heads instead of 1 head.
- Flexible virtual display resolutions
Instead of a fixed maximum resolution per head, vGPUs now support a maximum combined resolution based on their frame buffer size. This behavior allows the same number of lower resolution displays to be used as before, but alternatively allows a smaller number of higher resolution displays to be used.
- Virtual display resolutions greater than 4096×2160
- 10-bit color
- Changes to allow cross-branch driver support in future main release branches
Note: This feature cannot be used until the next NVIDIA vGPU software main release branch is available.
The purpose of this change is to allow a release of the Virtual GPU Manager from a later main release branch to be used with the NVIDIA vGPU software graphics drivers for the guest VMs from the previous branch.
- Miscellaneous bug fixes
Hardware and Software Support Introduced in Release 10.0
- Support for passively cooled Quadro RTX 6000 and Quadro RTX 8000 GPUs
- Support for Tesla V100S PCIe 32GB GPUs
- Support for Red Hat Enterprise Linux 8.1 as a guest OS
- Support for Red Hat Enterprise Linux 8.0 and CentOS 8.0 as a guest OS
- Support for Windows 10 November 2019 Update (1909) as a guest OS
- Support for Citrix Virtual Apps and Desktops version 7 1912
- Support for Citrix Hypervisor 8.1
- Support for VMware Horizon 7.11
Features Deprecated in Release 10.0
The following table lists features that are deprecated in this release of NVIDIA vGPU software. Although the features remain available in this release, they might be withdrawn in a future release. In preparation for the possible removal of these features, use the preferred alternative listed in the table.
| Deprecated Feature | Preferred Alternative |
|---|---|
| -1B4 vGPU types | -1B vGPU types |
| -2B4 vGPU types | -2B vGPU types |
Supported NVIDIA GPUs with vGPU 10.0
- Tesla M6
- Tesla M10
- Tesla M60
- Tesla P4
- Tesla P6
- Tesla P40
- Tesla P100 PCIe 16 GB
- Tesla P100 SXM2 16 GB
- Tesla P100 PCIe 12GB
- Tesla V100 SXM2
- Tesla V100 SXM2 32GB
- Tesla V100 PCIe
- Tesla V100 PCIe 32GB
- Tesla V100S PCIe 32GB
- Tesla V100 FHHL
- Tesla T4
- RTX 6000 in displayless mode or in passive in displayless mode
- RTX 8000 in displayless mode or in passive in displayless mode
Supported Hypervisors with NVIDIA vGPU 10.0
- Citrix XenServer Citrix XenServer 7.0,7.1, 7.6, 8.0, 8.1 (supported with Tesla M6, M10, M60, P4, P6, P40, P100,V100,T4,RTX6000,RTX8000)
- VMware vSphere VMware vSphere 6.7 (supported with Tesla M6, M10, M60, P4, P6, P40, P100,V100,T4,RTX6000,RTX8000) VMware vSphere 6.5 (supported with Tesla M6, M10, M60, P4, P6, P40, P100,V100,T4,RTX5000,RTX8000) Vmware vSphere 6.0 update3, update 2, update 1, RTM b2494585 (supported with Tesla M6, M10, M60, P4, P6, P40, P100,V100,T4,RTX6000,RTX8000)
- Microsoft Hyper-V 2016 (1607, 1709, 1803) Microsoft Windows Server 2016 with Hyper-V role (supported with Tesla M6, M10, M60, P4, P6, P40, P100,T4,RTX6000,RTX8000) note: Microsoft Windows Server with Hyper-V role supports GPU pass-through over Microsoft Virtual PCI bus. This bus is supported through paravirtualized drivers.
- Microsoft Server 2019 with Hyper-V role Microsoft Windows Server 2016 with Hyper-V role (supported with Tesla M6, M10, M60, P4, P6, P40, P100,T4,RTX6000,RTX8000) note: Microsoft Windows Server with Hyper-V role supports GPU pass-through over Microsoft Virtual PCI bus. This bus is supported through paravirtualized drivers.
- Red Hat Enterprise Linux with KVM Red Hat Enterprise Linux with KVM 7.5, 7.6, 7.7, 8.0, 8.1 (vGPU supported with Tesla M6, M10, M60, P4, P6, P40, P100, V100,T4,RTX6000,RTX8000) Red Hat Enterprise Linux with KVM 7.2, 7.3,7.4 (Passthrough only supported with Tesla M6, M10, M60, P4, P6, P40, P100, V100,T4,RTX6000,RTX8000) Red Hat Enterprise Linux with KVM 7.0, 7.1 (supported with Tesla M6,M10,M60) Red Hat Virtualization (RHV) 4.1, 4.2, 4.3 (vGPU supported with Tesla M6, M10, M60, P4, P6, P40, P100, V100,T4,RTX6000,RTX8000)
- Nutanix AHV Nutanix AOS Hypervisor (AHV) 5.5, 5.6, 5.8,5.9,5.10,5.11
- (supported with Tesla M10, M60, P40, V100, T4)
Supported Cloud Services for vGPU 10.0
NVIDIA virtual GPU software is supported on several cloud services with bring your own license (BYOL) licensing and licensing provided by the cloud service.
- Alibaba Cloud
- Amazon Web Services Elastic Compute Cloud (AWS EC2)
- Google Cloud Platform (GCP)
- Microsoft Azure
Alibaba Cloud
NVIDIA vGPU Support
| GPU | Supported Alibaba Cloud ECS Instances | Supported Guest Operating Systems | NVIDIA Licensing |
|---|---|---|---|
| Tesla P4 |
ecs.vgn5i-m1.large ecs.vgn5i-m2.xlarge ecs.vgn5i-m4.2xlarge ecs.vgn5i-m8.4xlarge |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Microsoft Windows Server 2008 R2 CentOS 7.x (64-bit) Red Hat Enterprise Linux 7.5 (64-bit) SUSE Linux Enterprise Server 11 SP4/12 SP2 (64-bit) Ubuntu 16.04 LTS (64-bit) |
BYOL |
GPU Pass Through Support
| GPU | Supported Alibaba Cloud ECS Instances | Supported Guest Operating Systems | NVIDIA Licensing |
|---|---|---|---|
| Tesla P4 |
ecs.gn5i-c2g1.large ecs.gn5i-c4g1.xlarge ecs.gn5i-c8g1.2xlarge ecs.gn5i-c16g1.4xlarge ecs.gn5i-c16g1.8xlarge ecs.gn5i-c28g1.14xlarge |
Windows Server 2019 Windows Server 2016 1607, 1709 Windows Server 2012 R2 Windows Server 2008 R2 CentOS 7.x (64-bit) Red Hat Enterprise Linux 7.4/7.5 (64-bit) SUSE Linux Enterprise Server 11 SP4/12 SP2 (64-bit) Ubuntu 16.04 LTS (64-bit) |
BYOL |
| Tesla P100 |
ecs.gn5-c4g1.xlarge ecs.gn5-c8g1.2xlarge ecs.gn5-c4g1.2xlarge ecs.gn5-c8g1.4xlarge ecs.gn5-c28g1.7xlarge ecs.gn5-c8g1.8xlarge ecs.gn5-c28g1.14xlarge ecs.gn5-c8g1.14xlarge |
||
| Tesla T4 |
ecs.gn6i-c4g1.xlarge ecs.gn6i-c8g1.2xlarge ecs.gn6i-c16g1.4xlarge ecs.gn6i-c24g1.6xlarge ecs.gn6i-c24g1.12xlarge ecs.gn6i-c24g1.24xlarge ecs.gn6i-c32g1.8xlarge ecs.gn6i-c48g1.12xlarge ecs.gn6i-c72g1.18xlarge |
||
| Tesla V100 |
ecs.gn6v-c8g1.2xlarge ecs.gn6v-c8g1.8xlarge ecs.gn6v-c8g1.16xlarge |
Amazon Web Services Elastic Compute Cloud (AWS EC2)
| GPU | Supported AWS EC2 Instances | Supported Guest Operating Systems | NVIDIA Licensing |
|---|---|---|---|
| Tesla M60 |
g3.4xlarge g3.8xlarge g3.16xlarge g3s.xlarge |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Red Hat Enterprise Linux 7.x (64-bit) Ubuntu 16.04 LTS (64-bit) |
Provided by AWS |
| Tesla M60 |
g3.4xlarge g3.8xlarge g3.16xlarge g3s.xlarge |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Red Hat Enterprise Linux 7.x (64-bit) Ubuntu 14.04 LTS/16.04 LTS/18.04 LTS (64-bit) |
BYOL |
| Tesla V100 |
P3.2xlarge P3.8xlarge P3.16xlarge |
Related AWS EC2 Documentation
Linux Accelerated Computing Instances Windows Accelerated Computing Instances
Google Cloud Platform (GCP)
| GPU | Supported GCP Instances | Supported Guest Operating Systems | NVIDIA Licensing |
|---|---|---|---|
| Tesla P4 | Any predefined machine type Any custom machine type that can be created in a zone |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Microsoft Windows Server 2008 R2 Red Hat Enterprise Linux 7.x (64-bit) Ubuntu 16.04 LTS/18.04 LTS (64-bit) |
Provided by GCP |
| Tesla P100 | |||
| Tesla T4 | |||
| Tesla P4 | Any predefined machine type Any custom machine type that can be created in a zone |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Microsoft Windows Server 2008 R2 Red Hat Enterprise Linux 7.x (64-bit) Ubuntu 16.04 LTS/18.04 LTS (64-bit) |
BYOL |
| Tesla P100 | |||
| Tesla T4 | |||
| Tesla V100 |
Related GCP Documentation
NVIDIA and Google Cloud Platform GPUs on Compute Engine
Microsoft Azure
Only GPU pass through is supported on Microsoft Azure.
GPU Pass Through Support
| GPU | Supported Microsoft Azure VM Sizes | Supported Guest Operating Systems | NVIDIA Licensing |
|---|---|---|---|
| Tesla M60 |
NV6 NV12 NV24 NV6s_v2 NV12s_v2 NV24s_v2 |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Microsoft Windows 10 Red Hat Enterprise Linux 7.x (64-bit) SUSE Linux Enterprise Server 12 SP2 Ubuntu 18.04 LTS (64-bit) |
Provided by Microsoft Azure |
| Tesla M60 |
NV6 NV12 NV24 NV6s_v2 NV12s_v2 NV24s_v2 |
Microsoft Windows Server 2019 Microsoft Windows Server 2016 1607, 1709 Microsoft Windows Server 2012 R2 Microsoft Windows 10 Microsoft Windows 8.1 Microsoft Windows 7 Red Hat Enterprise Linux 7.x (64-bit) SUSE Linux Enterprise Server 12 SP2 Ubuntu 16.04 LTS/18.04 LTS (64-bit) |
BYOL |
| Tesla P40 |
ND6s ND12s ND24s |
||
| Tesla P100 |
NC6s_v2 NC12s_v2 NC24s_v2 |
||
| Tesla V100 |
NC6s_v3 NC12s_v3 NC24s_v3 |
Related Microsoft Azure Documentation
- GPU optimized virtual machine sizes
- NVIDIA GPU Driver Extension for Windows
- NVIDIA GPU Driver Extension for Linux
- Install NVIDIA GPU drivers on N-series VMs running Windows
- Install NVIDIA GPU drivers on N-series VMs running Linux
Related NVIDIA Knowledge Base Articles
Known issue: Microsoft Azure Linux image fails to acquire an NVIDIA virtual GPU software license
Supported Hypervisor with migration of vGPU 10.0 across hypervisors
- XenMotion with vGPU is supported with Citrix XenServer 7.6, 8.0, 8.1
- vMotion with vGPU is supported with VMware vSphere 6.7 CU2, CU3
Supported VMware vSphere Hypervisor (ESXi) releases:
- Release 6.7 U2, U3 and compatible updates support vMotion with vGPU and suspend-resume with vGPU.
- Release 6.7 supports only suspend-resume with vGPU.
- Releases earlier than 6.7 do not support any form of vGPU migration.
Supported guest OS releases: Windows and Linux
This release of NVIDIA vGPU software provides support for the following NVIDIA GPUs on Citrix XenServer, running on validated server hardware platform
- Tesla M6
- Tesla M10
- Tesla M60
- Tesla P4
- Tesla P6
- Tesla P40
- Tesla P100 PCIe 16 GB (XenMotion with vGPU is not supported.)
- Tesla P100 SXM2 16 GB (XenMotion with vGPU is not supported.)
- Tesla P100 PCIe 12GB (XenMotion with vGPU is not supported.)
- Tesla V100 SXM2 (XenMotion with vGPU is not supported.)
- Tesla V100 SXM2 32GB (XenMotion with vGPU is not supported.)
- Tesla V100 PCIe (XenMotion with vGPU is not supported.)
- Tesla V100 PCIe 32GB (XenMotion with vGPU is not supported.)
- Tesla V100 FHHL (XenMotion with vGPU is not supported.)
- Tesla T4
- RTX6000
- RTX8000
Quadro Virtual Workstation on Microsoft Azure
Supported Microsoft Azure VM Sizes
This release of Quadro Virtual Workstation is supported with the Microsoft Azure VM sizes listed in the table. Each VM size is configured with a specific number of NVIDIA GPUs in GPU pass through mode.
NCv2 Series VM Sizes
| VM Size | NVIDIA GPU | Quantity |
|---|---|---|
| NC6 v2 | Tesla P100 | 1 |
| NC12 v2 | Tesla P100 | 2 |
| NC24 v2 | Tesla P100 | 4 |
NCv3 Series VM Sizes
| VM Size | NVIDIA GPU | Quantity |
|---|---|---|
| NC6 v3 | Tesla V100 | 1 |
| NC12 v3 | Tesla V100 | 2 |
| NC24 v3 | Tesla V100 | 4 |
ND Series VM Sizes
| VM Size | NVIDIA GPU | Quantity |
|---|---|---|
| ND6 | Tesla P40 | 1 |
| ND12 | Tesla P40 | 2 |
| ND24 | Tesla P40 | 4 |
Note: If an attempt is made to use Quadro Virtual Workstation with an unsupported VM size, a warning is displayed at console login time that the VM size is unsupported.
Guest OS Support
Quadro Virtual Workstation is available on Microsoft Azure images preconfigured with a choice of 64-bit Windows releases and Linux distributions as a guest OS.
Windows Guest OS Support
Quadro Virtual Workstation is available on Microsoft Azure VMs preconfigured only with following 64-bit Windows releases as a guest OS:
Note:
If a specific release, even an update release, is not listed, it’s not supported.
- Windows 7
- Windows 10
- Windows Server 2016
- Windows Server 2019
Linux Guest OS Support
Quadro Virtual Workstation is available on Microsoft Azure VMs preconfigured only with the following Linux releases as a guest OS:
Note:
If a specific release, even an update release, is not listed, it’s not supported.
- Ubuntu 18.04 LTS
What is MULTI-vGPU
Supported Hypervisor with Multiple vGPU support
Following Hypervisors is supported with assigning multiple vGPU to a single VM:
- VMware vSphere 6.7CU3
- Citrix Hypervisor 8.1
- Nutanix AHV 5.5, 5.8, 5.9, 5.10, 5.10.1, 5.10.4, 5.11
- RHEL KVM 7.5, 7.6, 8.0
- RHV 4.2, 4.3
The assignment of more than one vGPU device to a VM is supported only on a subset of vGPUs and Red Hat Enterprise Linux with KVM releases and Nutanix AHV releases.
Supported vGPUs profile with (Multiple vGPU support functionality)
Only Q-series vGPUs that are allocated all of the physical GPU’s frame buffer are supported.
| GPU Architecture | Board | vGPU |
|---|---|---|
| Turing | Tesla T4 | T4-16Q |
| T4-16C | ||
| Quadro RTX 6000 | RTX6000-24Q | |
| Quadro RTX 8000 | RTX8000-48Q | |
| Volta | Tesla V100 SXM2 32GB | V100DX-32Q |
| V100D-32C | ||
| Tesla V100 PCIe 32GB | V100D-32Q | |
| V100D-32C | ||
| Tesla V100 SXM2 | V100X-16Q | |
| V100X-16C | ||
| Tesla V100 PCIe | V100-16Q | |
| V100-16C | ||
| Tesla V100 FHHL | V100L-16Q | |
| V100L-16C | ||
| Pascal | Tesla P100 SXM2 | P100X-16Q |
| P100X-16C | ||
| Tesla P100 PCIe 16GB | P100-16Q | |
| P100-16C | ||
| Tesla P100 PCIe 12GB | P100C-12Q | |
| P100C-12C | ||
| Tesla P40 | P40-24Q | |
| P40-24C | ||
| Tesla P6 | P6-16Q | |
| P6-16C | ||
| Tesla P4 | P4-8Q | |
| P4-8C | ||
| Maxwell | Tesla M60 | M60-8Q |
| Tesla M10 | M10-8Q | |
| Tesla M6 | M6-8Q |
Maximum vGPUs per VM
NVIDIA vGPU software supports up to a maximum of four vGPUs per VM on VMware vSphere, Citrix Hypervisor, AHV, RHV or Red Hat Enterprise Linux with KVM.
Whats new in NVIDIA vGPU 10.0- 440.43-440.43-441.66
NVIDIA have released a new version of GRID 10.0 – 440.43-440.43-441.66 for NVIDIA vGPU (Tesla M6, M10, M60, P4, P6, P40, P100,V100,T4,RTX6000,RTX8000 platform)
Included in this release is
- NVIDIA Virtual GPU Manager versions 440.43 for Citrix XenServer 7.0
- NVIDIA Virtual GPU Manager versions 440.43 for Citrix XenServer 7.1
- NVIDIA Virtual GPU Manager versions 440.43 for Citrix XenServer 7.6
- NVIDIA Virtual GPU Manager versions 440.43 for Citrix XenServer 8.0
- NVIDIA Virtual GPU Manager versions 440.43 for Citrix XenServer 8.1
- NVIDIA Virtual GPU Manager version 440.43 for VMware vSphere 6.0 Hypervisor (ESXi)
- NVIDIA Virtual GPU Manager version 440.43 for VMware vSphere 6.5 Hypervisor (ESXi)
- NVIDIA Virtual GPU Manager version 440.43 for VMware vSphere 6.7 Hypervisor (ESXi)
- NVIDIA Virtual GPU Manager version 440.43 for Nutanix AHV 5.5, 5.8, 5.9, 5.10, 5.10.1, 5.11
- NVIDIA Virtual GPU Manager version 440.43 for Red Hat Enterprise Linux with KVM 7.0, 7.1, 7.2, 7.5, 7.6, 8.0
- NVIDIA Virtual GPU Manager version 440.43 for Red Hat Virtualization RHV 4.1, 4.2, 4.3
- NVIDIA Linux drivers for vGPU version 440.43
- NVIDIA Windows drivers for vGPU version 441.66
Important: (best practice)
The vGPU Manager and Windows guest VM drivers must be installed together. Older VM drivers will not function correctly with this release of vGPU Manager. Similarly, older vGPU Managers will not function correctly with this release of Windows guest drivers
Windows Guest OS support in NVIDIA vGPU 10.0 – 441.66
NVIDIA vGPU 441.66 supports following Windows release as a guest OS
- Microsoft Windows 7 (64bit)
- Microsoft Windows 8 (64bit)
- Microsoft Windows 8.1 (64bit)
- Microsoft Windows 10 (64bit) (1507, 1511, 1607, 1703, 1709, 1803, 1809, 1903, 1909)
- Microsoft Windows Server 2012 R2
- Microsoft Windows Server 2016 (1607, 1709)
- Microsoft Windows Server 2019
Linux Guest OS support in NVIDIA vGPU 10.0 – 440.43
NVIDIA vGPU 440.43 supports following Linux distributions as a guest OS only on supported Tesla GPUs
- Red Hat Enterprise Linux 7.0-7.7, 8.0, 8.1
- CentOS 7.0-7.6, 8.0
- Ubuntu 18.04 LTS
- Ubuntu 16.04 LTS
- Ubuntu 14.04 LTS
Important driver notes to NVIDIA vGPU 10.0
In pass-through mode, GPUs based on the Pascal architecture support only 64-bit guest operating systems. No 32-bit guest operating systems are supported in pass-through mode for these GPUs.
- ESXi 6.0 Update 3 is required for pass-through mode on GPUs based on the Pascal architecture.
- Only Tesla M6 is supported as the primary display device in a bare-metal deployment.
- Red Hat Enterprise Linux with KVM 7.0 and 7.1 are supported only on Tesla M6, Tesla M10, and Tesla M60 GPUs.
- Red Hat Enterprise Linux with KVM supports Windows guest operating systems only under specific Red Hat subscription programs. For details, see Certified guest operating systems for Red Hat Enterprise Linux with KVM.
Guide – Update existing NVIDIA vGPU Manager (Hypervisor)
Citrix Hypervisor (aka XenServer)
NVIDIA vGPU Manager 440.43 for Citrix XenServer 7.0 & 7.1
If you have a NVIDIA M6, M10, M60, P4, P6, P40, P100 vGPU manager installed in Citrix XenServer. Upgrade with one of below methodology:
Methodology 1 – the manual way “No GUI”
Upgrading an existing installation of the NVIDIA vGPU driver on Citrix XenServer 7, use the rpm -U command to upgrade:
If you have NVIDIA TESLA M6 / M10 / M60 / P4 / P6 / P40 / P100 / V100 / T4/RTX6000/RTX8000
[root@localhost ~]
# rpm -Uv NVIDIA-vGPU-xenserver-7.0-440.43.x86_64.rpm (#if you have for XenServer 7)
[root@localhost ~]
# rpm -Uv NVIDIA-vGPU-xenserver-7.1-440.43.x86_64.rpm (#if you have for XenServer 7.1)
Preparing packages for installation…
The recommendation from NVIDIA is to shutdown all VMs using a GPU. The machine does continue to work during the update, but since you need to reboot the XenServer itself, it’s better to gracefully shutdown the VMs. So after your VMs have been shutdown and you upgraded the NVIDIA driver, you can reboot your host.
[root@localhost ~]
# xe host-disable
[root@localhost ~]
# xe host-reboot
Methodology 2 – the “GUI” way
Select Install Update… from the Tools menu Click Next after going through the instructions on the Before You Start section Click Add on the Select Update section and open NVIDIA’s XenServer Supplemental Pack ISO
If you have NVIDIA M6/M10/M60/P4/P6/P40/P100/V100/T4/RTX6000/RTX8000 select following file:
“NVIDIA-vGPU-xenserver-7.0-440.43.x86_64.iso ” (#if you have XenServer 7)
“NVIDIA-vGPU-xenserver-7.1-440.43.x86_64.iso ” (#if you have XenServer 7.1)
Click Next on the Select Update section In the Select Servers section select all the XenServer hosts on which the Supplemental Pack should be installed on and click Next Click Next on the Upload section once the Supplemental Pack has been uploaded to all the XenServer hosts Getting Started Click Next on the Prechecks section Click Install Update on the Update Mode section Click Finish on the Install Update section
After the XenServer platform has rebooted, verify that the vGPU package installed and loaded correctly by checking for the NVIDIA kernel driver in the list of kernel loaded modules.
Validate from putty or XenCenter CLI
run lsmod | grep nvidia
Verify that the NVIDIA kernel driver can successfully communicate with the vGPU physical GPUs in your system by running the nvidia-smi command, which should produce a listing of the GPUs in your platform:
Check driver version is 440.43, if it is then your host is ready for GPU awesomeness and make your VM rock.
NVIDIA vGPU Manager 440.43 for Citrix XenServer 7.6 or Citrix Hypervisor 8.0, 8.1
If you have a NVIDIA vGPU M6, M10, M60, P4, P6, P40, P100, T4, RTX6000,RTX8000 vGPU manager installed in Citrix XenServer. Upgrade with one of below methodology:
Methodology 1 – the manual way “No GUI”
Upgrading an existing installation of the NVIDIA driver on Citrix XenServer 7.6, use the rpm -U command to upgrade:
If you have NVIDIA TESLA M6/M10/M60/P4/P6/P40/P100/V100/T4/RTX6000/RTX8000
[root@localhost ~]
# rpm -Uv NVIDIA-vGPU-xenserver-7.6-440.43.x86_64.rpm
Preparing packages for installation…
The recommendation from NVIDIA is to shutdown all VMs using a GPU. The machine does continue to work during the update, but since you need to reboot the XenServer itself, it’s better to gracefully shutdown the VMs. So after your VMs have been shutdown and you upgraded the NVIDIA driver, you can reboot your host.
[root@localhost ~]
# xe host-disable
[root@localhost ~]
# xe host-reboot
Methodology 2 – the “GUI” way
Select Install Update… from the Tools menu Click Next after going through the instructions on the Before You Start section Click Add on the Select Update section and open NVIDIA’s XenServer Supplemental Pack ISO
If you have NVIDIA GRID M6/ M10/M60/P4/P6/P40/P100/V100/T4/RTX6000/RTX8000 select following file:
“NVIDIA-vGPU-xenserver-7.6-440.43.x86_64.iso ” if XenServer 7.6
Click Next on the Select Update section In the Select Servers section select all the XenServer hosts on which the Supplemental Pack should be installed on and click Next Click Next on the Upload section once the Supplemental Pack has been uploaded to all the XenServer hosts Getting Started Click Next on the Prechecks section Click Install Update on the Update Mode section Click Finish on the Install Update section
After the XenServer platform has rebooted, verify that the GRID package installed and loaded correctly by checking for the NVIDIA kernel driver in the list of kernel loaded modules.
Validate from putty or XenCenter CLI
run lsmod | grep nvidia
Verify that the NVIDIA kernel driver can successfully communicate with the GRID physical GPUs in your system by running the nvidia-smi command, which should produce a listing of the GPUs in your platform:
Check driver version is 440.43 if it is then your host is ready for GPU awesomeness and make your VM rock.
NVIDIA vGPU Manager 440.43 for VMware vSphere 6.0
To update the NVIDIA GPU VIB, you must uninstall the currently installed VIB and install the new VIB.
To uninstall the currently installed VIB:
- Stop all virtual machines using 3D acceleration.
- Place the ESXi host into Maintenance mode.
- Open a command prompt on the ESXi host.
- Stop the xorg service by running the command:/etc/init.d/xorg stop
- Remove the NVIDIA VMkernel driver by running the command:vmkload_mod -u nvidia
- Identify the NVIDIA VIB name by running this command:esxcli software vib list | grep NVIDIA
- Remove the VIB by running the command:esxcli software vib remove -n nameofNVIDIAVIBYou can now install a new NVIDIA GPU VIB
- Use the esxcli command to install the vGPU Manager package:
If you have NVIDIA GRID TESLA M6 / M10 / M60 / P4 / P6 / P40 / P100 / v100 / T4 / RTX6000 / RTX8000 select following file:
[root@lesxi ~]
esxcli software vib install -v /NVIDIA-vGPU-VMware_ESXi_6.0_Host_Driver_440.43-1OEM.600.0.0.2494585.vib
After the ESXi host has rebooted, verify that the GRID package installed and loaded correctly by checking for the NVIDIA kernel driver in the list of kernel loaded modules.
[root@lesxi ~]
# vmkload_mod -l | grep nvidia
Preparing packages for installation…
Validate
run nvidia-smi
Verify that the NVIDIA kernel driver can successfully communicate with the GRID physical GPUs in your system by running the nvidia-smi command, which should produce a listing of the GPUs in your platform:
Check driver version is 440.43 if it is then your host is ready for GPU awesomeness and make your VM rock.
NVIDIA vGPU Manager 440.43 for VMware vSphere 6.5
To update the NVIDIA GPU VIB, you must uninstall the currently installed VIB and install the new VIB.
To uninstall the currently installed VIB:
- Stop all virtual machines using 3D acceleration.
- Place the ESXi host into Maintenance mode.
- Open a command prompt on the ESXi host.
- Stop the xorg service by running the command:/etc/init.d/xorg stop
- Remove the NVIDIA VMkernel driver by running the command:vmkload_mod -u nvidia
- Identify the NVIDIA VIB name by running this command:esxcli software vib list | grep NVIDIA
- Remove the VIB by running the command:esxcli software vib remove -n nameofNVIDIAVIBYou can now install a new NVIDIA GPU VIB
- Use the esxcli command to install the vGPU Manager package:
If you have NVIDIA GRID TESLA M6 / M10 / M60 / P4 / P6 / P40 / P100 / v100 / T4 / RTX6000 / RTX8000 select following file:
[root@lesxi ~]
esxcli software vib install -v /NVIDIA-vGPU-VMware_ESXi_6.5_Host_Driver_440.43-1OEM.650.0.0.2494585.vib
After the ESXi host has rebooted, verify that the GRID package installed and loaded correctly by checking for the NVIDIA kernel driver in the list of kernel loaded modules.
[root@lesxi ~]
# vmkload_mod -l | grep nvidia
Preparing packages for installation…
Validate
run nvidia-smi
Verify that the NVIDIA kernel driver can successfully communicate with the GRID physical GPUs in your system by running the nvidia-smi command, which should produce a listing of the GPUs in your platform:
Check driver version is 440.43 if it is then your host is ready for GPU awesomeness and make your VM rock.
NVIDIA vGPU Manager 430.46 for VMware vSphere 6.7
To update the NVIDIA GPU VIB, you must uninstall the currently installed VIB and install the new VIB.
To uninstall the currently installed VIB:
- Stop all virtual machines using 3D acceleration.
- Place the ESXi host into Maintenance mode.
- Open a command prompt on the ESXi host.
- Stop the xorg service by running the command:/etc/init.d/xorg stop
- Remove the NVIDIA VMkernel driver by running the command:vmkload_mod -u nvidia
- Identify the NVIDIA VIB name by running this command:esxcli software vib list | grep NVIDIA
- Remove the VIB by running the command:esxcli software vib remove -n nameofNVIDIAVIBYou can now install a new NVIDIA GPU VIB
- Use the esxcli command to install the vGPU Manager package:
If you have NVIDIA TESLA M6 / M10 / M60 / P4 / P6 / P40 / P100 / v100 / T4 / RTX6000 / RTX8000 select following file:
[root@lesxi ~]
esxcli software vib install -v /NVIDIA-vGPU-VMware_ESXi_6.7_Host_Driver_440.43-1OEM.650.0.0.2494585.vib
After the ESXi host has rebooted, verify that the GRID package installed and loaded correctly by checking for the NVIDIA kernel driver in the list of kernel loaded modules.
[root@lesxi ~]
# vmkload_mod -l | grep nvidia
Preparing packages for installation…
Validate
run nvidia-smi
Verify that the NVIDIA kernel driver can successfully communicate with the NVIDIA physical GPUs in your system by running the nvidia-smi command, which should produce a listing of the GPUs in your platform:
Check driver version is 440.43 if it is then your host is ready for GPU awesomeness and make your VM rock.
Update existing NVIDIA vGPU Driver for (Virtual Machine)
When the hypervisor NVIDIA vGPU manager is updated, next is updating the Virtual Machines vGPU driver.
The vGPU driver for Windows 10/2012r2/2016/2019 is available with NVIDIA vGPU download. This is available for both M6/M10/M60/P4/P6/P40/P100/V100/T4/RTX6000/RTX8000
Update your Golden Images and reprovisioning the new virtual machines with updated vGPU drivers, if you have stateless machines update vGPU drivers on each.
#HINT – Express upgrade of drivers is the recommended option according to the setup. If you use the “Custom” option, you will have the option to do a “clean” installation. The downside of the “clean installation” is that it will remove all profiles and custom settings. The pro of using the clean installation option is that it will reinstall the complete driver, meaning that there will be no old driver files left on the system. I most of the time recommends using a “Clean” installation to keep it vanilla 🙂
#HINT (Citrix Virtual Apps & Desktop 7.15/1906/1909/1912 customers)
The NVIDIA vGPU API provides direct access to the frame buffer of the GPU, providing the fastest possible frame rate for a smooth and interactive user experience. If you install NVIDIA drivers before you install a VDA with HDX 3D Pro, NVIDIA vGPU is enabled by default.
To enable NVIDIA vGPU on a VM, disable Microsoft Basic Display Adapter from the Device Manager. Run the following command and then restart the VDA: NVFBCEnable.exe -enable -noreset
If you install NVIDIA drivers after you install a VDA with HDX 3D Pro, NVIDIA vGPU is disabled. Enable NVIDIA vGPU by using the NVFBCEnable tool provided by NVIDIA.
To disable NVIDIA vGPU, run the following command and then restart the VDA: NVFBCEnable.exe -disable -noreset
Source
https://docs.nvidia.com/grid/index.html
NVIDIA Virtual GPU Software Supported Products
NVIDIA Virtual GPU Software Quick Start Guide
NVIDIA Tesla M6/M10/M60/P4/P6/P40/P100/V100/T4/RTX6000/RTX8000 – sources
vGPU vGPU Manager + Drivers are only available to customers and NVIDIA NPN partners for M6/M10/M60/P4/P6/P40/P100/V100/T4/RTX6000/RTX8000
Download if you are a NPN partner
Download if you are a vGPU M6, M10, M60, P4, P6, P40, P100, V100, T4, RTX6000, RTX8000 customer