Tech Stack

AI Engineering (AIE) builds apps using existing foundation models. No building from scratch. Big companies create these models. Foundation models got powerful. APIs made them easy to use. AIE exploded.

3️⃣ Three Layers

Three layers make the AI stack:

1. Application Layer- Product companies turn capabilities into user value

2. Infrastructure Layer - Infra companies make capabilities accessible and scalable

3. Model Layer - Model companies create foundational capabilities

AI Engineering focuses on the Application layer.

Product Companies build user-facing apps. Deploy fast. Iterate based on feedback.

Infrastructure Companies provide tools for product teams. B2B focus. Built for scale and reliability.

• Inference Providers serve models through APIs. Together AI, Cohere, Amazon Bedrock, Hugging Face, Google Vertex AI, Replicate, Fireworks AI.

• Database Providers serve AI-optimised retrieval. Pinecone, Weaviate, Qdrant, Chroma.

• Observability Providers monitor and evaluate performance. Galileo, Phoenix, Langfuse, Opik, LangSmith.

Model Companies create foundation models. Google, Meta, Anthropic, OpenAI, Mistral AI, xAI, Stability AI.