Together AI

Functions 4.6/10

On-demand dedicated endpoints billed per minute: A100 40GB $2.40/hr, A100 80GB $2.59/hr, H100 80GB $3.36/hr (up to ~43% off legacy). Also serverless token APIs and clusters (H100 f

Together AI scores 4.6/10 for free value in Functions. The main constraint: Paid — H100 80GB $3.36/hr; A100 80GB $2.59/hr; A100 40GB $2.40/hr. On-demand dedicated endpoints billed per minute: A100 40GB $2.40/hr, A100 80GB $2.59/hr, H100 80GB $3.36/hr (up to ~43% off legacy). Also serverless token APIs and clusters (H100 from $5.49/hr).

Category Functions Kind Paid plan

Free value score

4.6 / 10

Show the math

Overall 4.6/10

value = 4.6/100

weighted_components_v1

Invocation value 1/10

value = 0.01 ×

fixed_log_v1

Runtime fit 8.2/10

value = 8.2/100

policy_score_v1

Deploy friction 8/10

value = 8/100

policy_score_v1

Key metrics

H100 $3.36/h

A100 $2.59

40GB $2.40

What you get

Paid — H100 80GB $3.36/hr; A100 80GB $2.59/hr; A100 40GB $2.40/hr. On-demand dedicated endpoints billed per minute: A100 40GB $2.40/hr, A100 80GB $2.59/hr, H100 80GB $3.36/hr (up to ~43% off legacy). Also serverless token APIs and clusters (H100 from $5.49/hr).

A100 80GB at $2.59/hr and H100 at $3.36/hr for dedicated endpoints is competitive for guaranteed-capacity inference with no queue.

Sources

"A100 SXM 40GB, $2.40/hour, -20% ; A100 SXM 80GB, $2.59/hour, -20% ; H100 80GB, $3.36/hour, -43%"
https://www.together.ai/blog/on-demand-dedicated-endpoints
"NVIDIA HGX H100 $5.49 ... NVIDIA HGX H200 $6.79"
https://www.together.ai/pricing

paid value serverless-functions

Open service ← All Functions