• Overview

  NVIDIA L4 Tensor Core GPU

  The breakthrough universal accelerator for efficient video, AI, and graphics.

  Accelerate Video, AI, and Graphics Workloads

  The NVIDIA L4 Tensor Core GPU powered by the NVIDIA architecture delivers universal, energy-efficient acceleration for video, AI, visual computing, graphics, virtualization, and more. Packaged in a low-profile form factor, L4 is a cost-effective, energy-efficient solution for high throughput and low latency in every server, from the edge to the data center to the cloud.

  Experience Real-Time AI Video Pipeline Performance

  Transform video applications with the power of NVIDIA L4. Whether streaming live to millions of viewers, enabling users to build creative stories, or delivering immersive augmented and virtual reality (AR/VR) experiences, servers equipped with L4 allow hosting up to 1,040 concurrent AV1 video streams at 720p30 for mobile users.

  With fourth-generation Tensor Cores and 1.5X larger GPU memory, NVIDIA L4 GPUs paired with theCV-CUDA® library take video content-understanding to a new level. L4 delivers 120X higher AI video performance than CPU-based solutions, letting enterprises gain real-time insights to personalize content, improve search relevance, detect objectionable content, and implement smart-space solutions.

  Consume Less Energy and Space With L4

  As AI and video become more pervasive, the demand for efficient, cost effective computing is increasing more than ever. NVIDIA L4 Tensor Core GPUs deliver up to 120X better AI video performance, resulting in up to 99 percent better energy efficiency and lower total cost of ownership compared to traditional CPU-based infrastructure. This lets enterprises reduce rack space and significantly lower their carbon footprint, while being able to scale their data centers to many more users. The energy saved by switching from CPUs to NVIDIA L4s in a 2 megawatt (MW) data center can power nearly 2,000 homes for one year or match the carbon offset from 172,000 trees grown over 10 years.

  Accelerate Generative AI Performance

  Generative AI for images and text makes customer lives more convenient and experiences more immersive across all industries. NVIDIA L4 supercharges compute-intensive generative AI inference by delivering up to 2.5X higher performance compared to the previous GPU generation. And with 50 percent more memory capacity, L4 enables larger image generation, up to 1024x768, which wasn't possible on the previous GPU generation.

  Optimize Graphics Performance

  With third-generation RT Cores and AI-poweredNVIDIA Deep Learning Super Sampling 3(DLSS 3), NVIDIA L4 delivers over 4X higher performance for AI-based avatars, NVIDIA Omniverse™ virtual worlds, cloud gaming, and virtual workstations. These capabilities enable creators to build real-time, cinematic-quality graphics and scenes for immersive visual experiences not possible with CPUs.

  Accelerate Workloads Efficiently and Sustainably

  NVIDIA L4 is an integral part of theNVIDIA data center platform. Built for video, AI,NVIDIA RTX virtual workstation (vWS), graphics, simulation, data science, and data analytics, the platform accelerates over 3,000 applications and is available everywhere at scale, from data center to edge to cloud, delivering both dramatic performance gains and energy-efficiency opportunities.

  Optimized for mainstream deployments, L4 delivers a low-profile form factor operating in a 72W low-power envelope, making it an efficient, cost-effective solution for any server or cloud instance from NVIDIA's partner ecosystem

• Specifications

  FP32	30.3 TFLOPS
  TF32 Tensor Core	120 TFLOPS | Sparsity
  FP16 Tensor Core	242 TFLOPS | Sparsity
  BFLOAT16 Tensor Core	242 TFLOPS | Sparsity
  FP8Tensor Core	485 TFLOPS | Sparsity
  INT8 Tensor Core	485 TOPS | Sparsity
  GPU Memory	24GB
  GPU Memory Bandwidth	300 GB/s
  Display Connectors	None | vGPU Only
  NVENC | NVDEC	2 | 4 | 4| JPEG Decoders | AV1 Encode and Decode
  Form Factor	Single Slot | Low-Profile
  System Interconnect	PCIe Gen4 x16 | 64GB/s
  Thermal Solution	Passive
  Maximum Power Consumption	72 W
  Server Options	Partner and NVIDIA-Certified Systems with 1-8 GPUs

1. 3D Rendering & Visualization: Ideal for software like Autodesk Maya, Blender, and Cinema 4D, accelerating real-time ray tracing.

2. AI Development: Tensor Cores enhance training and inferencing for AI and deep learning models.

3. Medical Imaging: Useful for advanced visualization in radiology and surgical planning.

4. Virtual Production: Works well in environments like Unreal Engine for virtual sets and real-time compositing.