What we can attribute directly
LinkedIn published its journey building a GenAI application technology stack.
The account describes reusable platform layers for application teams.
Read LinkedIn Engineering — GenAI stack Primary source · last checked 26 Aug 2026The operating envelope
Fast product iteration, multiple models, grounding, safety, evaluation, cost, and enterprise reliability.
Model teams, platform owners, operators, downstream product systems, and people affected by decisions.
Versioned data, configs, traces, artifacts, deployments, and outcomes aligned on one timeline.
Every team reinvents prompts, retrieval, model access, evaluation, and production controls.
Trace the system before naming the bug.
- 01
Producers emit versioned data or model artifacts.
- 02
A platform validates, computes, stores, schedules, or routes them.
- 03
Training or inference consumes the exact declared version.
- 04
Telemetry joins the decision to system, data, and model identity.
- 05
Operators compare outcomes, stop conditions, and the last known-good path.
Follow the evidence boundary by boundary.
Symptoms
Every team reinvents prompts, retrieval, model access, evaluation, and production controls.
Investigation
Trace prompt version, retrieval corpus, model route, policy checks, tool calls, citations, and feedback for one answer.
An answer loses a citation after a model change. List every non-weight artifact needed to reproduce it.
Open investigation scaffold
- Write the earliest known-bad timestamp.
- Compare exact identities on either side of that boundary.
- Find the smallest affected slice and a known-good counterexample.
- Separate mitigation from root-cause confirmation.
Repair the contract, not only the symptom.
Treating the provider call as the application leaves critical behavior unversioned and unobservable.
Standardize gateways, orchestration, retrieval contracts, evaluation, safety policy, and trace context.
Rollout
Start with a small set of high-value primitives; test escape hatches and version every behavior-changing layer.
Reason about the tempting shortcuts.
- One giant framework that owns product logic.
- Judging releases only by a general chatbot score.
Make recurrence visible early.
End-to-end trace and cost
Define owner, slice, normal range, alert persistence, and the exact mitigation the alert should trigger.
Grounding/citation quality
Define owner, slice, normal range, alert persistence, and the exact mitigation the alert should trigger.
Safety and fallback outcomes
Define owner, slice, normal range, alert persistence, and the exact mitigation the alert should trigger.
A GenAI platform manages evidence and behavior across many versioned layers.
Carry this pattern into assignments as a design constraint and into incident reviews as a hypothesis—not as proof about an unpublished system.