Writing the security packet for an AI feature
Security review does not fail because the system is risky. It fails because nobody could describe the risk. Five artefacts turn a three-month review into a two-week one.
Playbooks
Step-by-step guides for rolling AI out inside an organisation.
Tools in this category
Nothing here yet. The next crawl fills this up.
Notes in this category
How to choose a reranker without a benchmark harness
You do not need a public leaderboard to choose a reranker. You need queries with known correct passages, a way to measure position, and the discipline to include unanswerable quer…
Prompt versioning without a platform
You do not need a prompt management product to stop shipping prompt changes blind. A file, a version identifier and one rule about out-of-band edits cover most of what a platform…
An on-call runbook for an LLM service
Classic latency and error alerting does not see the failures that matter here: quality decay, provider degradation, silent context growth. A runbook has to name the signals first.
Moving a prototype onto managed inference
A prototype built against one vendor API carries assumptions that surface on a managed platform. Settle them before the first request so the migration is configuration, not a rewr…
How to scope a thirty-day AI discovery
A discovery phase that produces a slide deck is a cost centre. The one that produces three measured facts — document reality, permission reality, workflow reality — pays for itsel…
How to build an evaluation set from real traffic
Most evaluation sets are written from documentation and measure the documentation. Building one from logs, tickets and abandonments takes a week and is the highest-leverage task a…
A chunking strategy you can defend in review
Chunk size is usually set by a library default and defended by nothing. Choose it from the documents themselves, and be able to explain the choice to someone who will ask why.
How to run a cost review before scaling inference
Before adding capacity or switching models, walk the request once and price every stage. Most cost reviews find the money in context size, retries and caching, not in the model ch…
How to run an AI pilot that survives procurement
The demo goes well. The users are happy. Then legal asks where the data went, security asks who can see what, and finance asks what it costs per month. If you have not prepared fo…
What a forward-deployed engineer actually does all day
The title sounds like research. The job is mostly data plumbing, security questionnaires, and convincing a department head that the pilot will not embarrass them — which is exactl…