Nvidia LLM Developer Kit

$10,999.00

Run Llama, Mistral, Falcon, Claude, Phi, Mixtral, and other LLMs accelerated by the Nvidia RTX A6000 48gb GPU, on-device.  Perfect for rapid development of large language models locally, or for running LLM applications serving responses to users quickly at the edge.

Category:

Description

The Nvidia LLM Developer Kit is a small PC specifically designed for working with Large Language Models, either for local development and fine-tuning using GPU-accleration to speed up machine learning engineer tasks and workflows, or for use as an edge AI LLM inference server.

  • Intel Core i9-14900k CPU
  • Nvidia RTX A6000 48gb GPU
  • 192gb DDR5 Memory
  • 8 TB NVMe PCIe4.0, Ubuntu 22.04 Jammy

Additional information

Weight 10 lbs
Dimensions 20 × 16 × 16 in