Fathom
Context and Knowledge

Context and Knowledge

Intermediate

Getting the right information in front of the model at the right time, and making the answer checkable afterwards. Most quality problems that look like model problems are context problems, and most context problems are product decisions wearing an engineering costume.

#LessonThe question it answers
01Context EngineeringWhat goes in the window, what it costs, and what gets lost in the middle?
02Retrieval and GroundingWhat does retrieval actually fix, and what does it not?
03Chunking, Ranking and RecallWhich retrieval decisions are product decisions?
04Citations and ProvenanceHow do you make an answer checkable by the person reading it?
05Measuring Retrieval SeparatelyWhy must recall and faithfulness be measured apart?
06Knowledge That Goes StaleWhat is the half life of a wrong answer, and how do you invalidate?
07Memory and PersonalisationSession, user and organisation memory as a product surface
08Permissions Inside RetrievalHow do you stop the model citing something this user may not see?
09Structured Data and Tools Instead of TextWhen is a query better than a document?
10When Finetuning Is the AnswerRarely. What do you do instead, and what is the exception?
11The Context Budget as a Product DecisionWho decides how many documents, and on what basis?
12Worked: A Grounded AssistantOne real retrieval product, from corpus to citation

↑↓ navigate↵ openesc close

drag to pan · scroll to zoom