Rent NVIDIA L40S GPUs on Demand from $0.72/hr

The A100 is better suited for training workloads thanks to its HBM2e memory and higher memory bandwidth. The L40S, on the other hand, excels at inference and mixed AI+graphics workloads with its 48GB GDDR6 memory, 3rd generation RT Cores for ray tracing, and lower cost per hour. If your primary use case is inference or visual computing, the L40S offers significantly better value.

Yes, the L40S is excellent for LLM inference. With 48GB of GDDR6 memory, it can handle models up to 30B parameters comfortably. It delivers high throughput with INT8 and FP16 precision support, making it ideal for production LLM deployment at a lower cost than H100. For inference-heavy workloads, the L40S provides outstanding price-performance.

The L40S uniquely combines strong AI acceleration with professional graphics capabilities, including 3rd generation RT Cores for ray tracing and hardware video encode/decode. It is the only data center GPU that offers both powerful AI inference performance and full graphics capabilities, making it ideal for workloads that require both AI and visual computing, such as AI-powered video editing, generative visual content, and virtual production.

Yes, the L40S can handle training for small to medium-sized models effectively. However, its GDDR6 memory bandwidth is lower than HBM found in A100 and H100, so for large-scale training workloads, those GPUs are better choices. The L40S truly excels at inference, where its 48GB memory and strong INT8/FP16 performance provide excellent throughput at a competitive price.

The L40S features hardware NVENC/NVDEC engines supporting H.264, H.265, and AV1 codecs at up to 8K resolution. This makes it perfect for cloud gaming, live streaming, video transcoding, and video analytics workloads. The combination of AI acceleration and hardware video processing enables advanced use cases like real-time video analytics and AI-powered content creation.

The L40S has 48GB of memory compared to 24GB on the RTX 4090, along with ECC memory support and data center-grade reliability. This makes the L40S significantly better for production inference workloads where uptime and memory capacity matter. The RTX 4090 is a more affordable option for development and experimentation, but the L40S is the clear choice for deployment at scale.

There's no minimum! Spheron charges by the hour with per-minute billing granularity. Rent an L40S for just an hour to test your workload, or keep it running for months. You only pay for what you use with no long-term contracts or commitments.

Yes, the 48GB of GDDR6 memory allows you to run 2-3 smaller models (around 7B parameters each) or 1 larger model (up to 30B parameters) simultaneously. The L40S also supports NVIDIA MPS (Multi-Process Service) for efficient multi-process GPU sharing, enabling you to serve multiple models concurrently with optimized resource utilization.

L40S GPUs are currently available in US Region, Europe, and Canada. We're continuously expanding capacity and regions. Check our app or contact sales for specific region requirements.

Our platform is plug-and-play for standard deployments. For 100+ GPU clusters, you get dedicated support via Slack or Discord, plus sourcing assistance. Enterprise customers get dedicated support channels and SLA guarantees.

Dedicated L40S instances are non-interruptible, run on a 99.99% SLA, and bill per-minute at the on-demand rate. Spot instances run on spare capacity at meaningfully lower rates but can be preempted when dedicated demand rises. Use spot for fault-tolerant workloads: batch inference, LoRA fine-tuning with checkpointing every 15-30 minutes, or video transcoding jobs that can resume. Use dedicated for customer-facing inference endpoints, live streaming pipelines, and any SLA-bound serving workload. Both tiers live in the same control plane, so you can mix them across a project.