Independent marketplace for cloud provider accounts across 22 providers

Cloud Journal

AI Infrastructure

Illustration of an AWS account calling several foundation models through a single Bedrock endpoint
AI Infrastructure

Amazon Bedrock Overview: Foundation Models on AWS

Amazon Bedrock puts foundation models from several vendors behind one AWS API. This overview covers model access, the Converse API,…

6 min read
Illustration of an Azure resource group containing an Azure OpenAI resource with named model deployments
AI Infrastructure

Azure OpenAI Service: What It Is and How Access Works

Azure OpenAI Service hosts OpenAI models as an Azure resource. This overview explains the resource and deployment model, deployment types,…

5 min read
Illustration of a Google Cloud project containing Vertex AI model, training and serving components
AI Infrastructure

Google Vertex AI Overview

Vertex AI is a suite of Google Cloud services sharing one project and one set of IAM roles. This overview…

6 min read
Illustration of a cloud GPU instance serving streaming language model responses to concurrent users
AI Infrastructure

Running LLM Inference on Cloud GPUs

Self-hosting a language model means owning the serving stack. This guide covers whether the model fits in accelerator memory, choosing…

6 min read
Illustration of embeddings plotted in a vector space with a nearest neighbor query returning matches
AI Infrastructure

Vector Databases in the Cloud

Vector search turns relevance into a geometry problem. This guide explains what a vector store must do, how index families…

6 min read
Illustration of two meters tracking request rate and token consumption against an AI API quota
AI Infrastructure

Rate Limits and Quotas for Cloud AI APIs

Cloud AI APIs meter both requests and tokens, and the token meter is usually the one that stops you. This…

6 min read
Illustration contrasting a multi node training cluster with a fleet of independent inference replicas
AI Infrastructure

AI Training vs Inference Infrastructure

Training is a throughput bound batch job and inference is a latency bound service, and almost every infrastructure difference follows…

6 min read
Illustration of a cloud cost breakdown showing accelerator hours, token usage and storage for an AI workload
AI Infrastructure

The Cost of AI Workloads in the Cloud

AI bills are shaped by expensive units, allocation based billing and token metered APIs. This guide covers idle capacity, prompt…

6 min read
Illustration of three routes to building an AI application across different cloud providers
AI Infrastructure

Choosing a Cloud for AI Development

There is no single best cloud for AI, only a best fit for your route. This guide separates managed model…

6 min read