Together AI H100 Pricing Options
All available H100 instance types on Together AI, sorted by lowest hourly rate.
| Region | Instance | Type | Price/hr | GPUs | vCPUs | RAM |
|---|---|---|---|---|---|---|
| US | H100 (Reserved Instances) | On-Demand | $1.9900/hr Cheapest | 1× GPU | — | — |
| US | H100 (on-demand) | On-Demand | $1.9900/hr | 1× GPU | — | — |
About Together AI H100 Cloud Pricing
Together AI provides GPU cloud infrastructure alongside their model inference platform, offering both raw compute and optimized model serving for popular open-source LLMs.
Why Choose Together AI for H100
- Optimized inference for popular open-source models
- Fine-tuning API for custom model training
- Competitive inference pricing per token
- Built-in model catalog with one-click deployment
Best suited for: Teams deploying open-source LLMs (Llama, Mistral, etc.) who want optimized inference without managing GPU infrastructure directly.
H100 Technical Overview
The H100 SXM5 variant with NVLink delivers up to 3.35 TB/s aggregate GPU-to-GPU bandwidth, making it the standard for large-scale distributed training. The PCIe variant trades interconnect bandwidth for broader server compatibility.
Pricing Analysis
Together AI's cheapest H100 option starts at $1.9900/hr, which is 45% below the market average of $3.6501/hr. Together AI currently offers on-demand pricing only for H100. This means no commitment required, but you won't access the deeper discounts available from reserved or spot pricing.
Note: Together AI's strength is their inference optimization layer — for raw GPU compute, specialized providers may offer better pricing.
Market context: H100 is the most in-demand GPU in the cloud market as of 2026. Prices have stabilized after the 2024 shortage, but availability still varies significantly by provider and region.
Top Alternatives to Together AI for H100
Side-by-side cost comparison vs the cheapest Together AI H100 rate ($1.9900/hr).
| Provider | Price/hr | Type | vs Together AI |
|---|---|---|---|
| Vast.ai | $1.4900/hr | Spot | -25% cheaper vs Together AI |
| Corvex | $1.5900/hr | Reserved | -20% cheaper vs Together AI |
| DataCrunch | $1.6500/hr | Spot | -17% cheaper vs Together AI |
| CoreWeave | $1.7900/hr | Reserved | -10% cheaper vs Together AI |
| Shadeform | $1.7900/hr | On-Demand | -10% cheaper vs Together AI |
Calculate Your Exact H100 Cost
Enter your hours, job type, and GPU count. Our calculator compares Together AI against all 32 providers instantly.
Frequently Asked Questions
Not sure which GPU configuration fits your budget?
Get a personalized recommendation based on your monthly budget, workload, and real pricing data from all 58 providers.
Is a reserved contract worth it here?
Get the break-even math for Together AI H100 — calculated from real 90-day pricing data, not an LLM.