FM Application Design
Selecting a pre-trained model: the criteria that matter
Designing an FM application starts before you write a prompt: it starts by picking the right model from a catalog, because every later decision (cost, latency, what you can even fit in a request) is downstream of that one choice. The instinct the exam keeps punishing is "reach for the biggest, most capable model"; the skill it rewards is reading a use case and matching it to the model whose cost, modality, latency, and context window actually fit. Amazon Bedrock[1] exposes many foundation models[2] (Amazon Nova and Titan, Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Stability AI) behind a single API, so you compare candidates without re-architecting or managing servers. The selection criteria the AIF-C01 blueprint calls out map to concrete questions you must answer for your use case:
- Cost. Bedrock on-demand pricing scales with the number of input tokens plus output tokens processed, so a longer prompt or a more verbose answer costs more, and a larger model costs more per token than a smaller one. Check the current rate card on Amazon Bedrock pricing[3]. The exam-correct instinct is that bigger is not automatically better: a smaller or distilled model is the right answer when unit cost and speed dominate a narrow task.
- Modality. Match the model to the input and output the task needs: text-only, image generation (diffusion-family models such as Stability AI), or multimodal models that accept an image plus text and return text. A text-only model cannot serve an image use case no matter how capable it is.
- Latency. Larger, higher-capability models respond more slowly. Interactive, real-time experiences (chat, autocomplete) push you toward a smaller, faster model; an offline batch summarization job can tolerate a slower, stronger one.
- Multi-lingual support. If the application must understand or generate non-English languages, confirm the candidate model is trained for them; not all models cover the same language set.
- Model size and complexity. Capability generally rises with size, but so do cost and latency: this is the central trade-off, not a free lunch.
- Input/output length and context window. The context window is a hard ceiling: the prompt and the generated completion share one finite token budget. A model whose window is too small will truncate a long document regardless of how capable it otherwise is, which is the design reason RAG (introduced in RAG: grounding the model on your data below) retrieves only relevant chunks rather than pasting whole corpora.
- Customization path. Decide up front whether the use case will be served by prompting alone, by RAG, or by fine-tuning a custom model[4]: not every model supports fine-tuning, so this can rule candidates in or out.
- Prompt caching. For workloads that resend a large, stable context (a long system prompt, a fixed document) across many requests, prompt caching[5] lets Bedrock reuse the cached portion so you are not billed full price to reprocess the same tokens every call: a direct cost and latency lever on supported models.
- Responsibility and compliance. Provider, licensing, content-safety behavior, and regulatory fit are selection criteria too; a model that cannot meet a compliance constraint is disqualified whatever its benchmark scores.
Inference parameters: tuning randomness and length
Once a model is chosen, inference parameters[6] shape how it generates, at request time, without retraining and without changing a single model weight. They fall into two groups: parameters that govern randomness, and a parameter that caps length. The figure groups them that way: the randomness controls (temperature, top-p, top-k) in one box, the length cap in the other. A critical exam point: none of these add knowledge or fix a wrong answer; they only control sampling and size.
Randomness controls. A model produces a probability distribution over the next token; these parameters decide how that distribution is sampled.
- Temperature flattens or sharpens the distribution. A low temperature near 0 makes the model favor its single most-likely token, producing focused, repeatable, effectively deterministic output, the right setting for extraction, classification, or any task that needs the same answer every time. A high temperature widens the distribution and yields more varied, creative output, suited to brainstorming or diverse phrasings. (Even at temperature 0, output is not guaranteed byte-identical, but it is as deterministic as the model gets.)
- Top-p (nucleus sampling) restricts sampling to the smallest set of tokens whose cumulative probability reaches p. Lowering top-p shrinks the candidate pool to only the most probable tokens, reducing variability.
- Top-k restricts sampling to the k most-likely tokens. Lowering k narrows the pool the same way.
Temperature, top-p, and top-k are complementary levers on the same goal: narrow them together for consistency, loosen them together for creativity.
Length control.
- The maximum-token / response-length parameter caps how long the completion can be. This directly bounds both latency and cost (you pay per output token), but it does not improve answer quality. It only limits output size, and setting it too low truncates a legitimately long answer mid-sentence.
The exam pattern is clean: "needs a single consistent, reproducible answer" → lower temperature (and top-p/top-k); "needs creative or varied output" → raise them; "control cost or cut off run-on answers" → set the max-token limit; "answer is factually wrong / out of date" → none of these parameters help, because that is a grounding problem solved by RAG or fine-tuning, not a sampling setting.
RAG: grounding the model on your data with embeddings
Retrieval Augmented Generation (RAG)[7] is the design pattern for making an FM answer from your private, current data instead of only its frozen training knowledge, without retraining or fine-tuning. Because you update the data store rather than the model weights, RAG is how you serve information that changes often (policies, catalogs, ticket histories) and how you cut hallucination by grounding answers in retrievable source text.
The pipeline, end to end (the figure below models the AWS RAG architecture diagram on that What is RAG page):
- Chunk. Source documents are split into passages small enough to retrieve precisely and fit the context window.
- Embed. Each chunk is converted by an embedding model into a vector: a fixed-length list of numbers that places semantically similar text near each other in vector space.
- Store. Those vectors land in a vector store that supports similarity (nearest-neighbour) search.
- Retrieve. At query time the user's question is embedded with the same model, and the most semantically similar chunks are pulled from the store.
- Augment & generate. The retrieved chunks are inserted into the prompt as grounding context, and the FM answers from them, ideally citing the source passages.
This is why RAG retrieves only the relevant chunks rather than stuffing an entire corpus into a maximal context window: it is cheaper, lower-latency, and keeps the model focused. Amazon Bedrock Knowledge Bases[8] is the managed AWS service that implements this whole pipeline (ingestion, chunking, embedding, storage, and retrieval) so you do not build and operate it yourself; you point it at a data source and a vector store and it handles the rest.
Business framing for the exam: RAG fits when answers must come from private or frequently changing documents, when you want citations to source text, and when fine-tuning would be too slow or too costly to keep current. It does not fit when the goal is to teach the model a durable style, format, or domain behavior. That is fine-tuning's job, because RAG injects changing facts at query time, it does not change how the model behaves.
AWS vector stores for RAG embeddings, and when each fits
RAG needs somewhere to store and similarity-search the embeddings, and a recurring AIF-C01 objective is identifying which AWS services can hold vectors in a vector database. AWS deliberately supports vectors across several managed services so you can keep embeddings next to data you already run, and Amazon Bedrock Knowledge Bases[8] can use these as its underlying vector store[9]. The selection logic is "keep vectors near the data and skills you already have":
- Amazon OpenSearch Service[10] (including OpenSearch Serverless) provides a k-NN vector engine and is the common default for a new, purpose-built RAG workload. Choose it when you do not already have a database the vectors must live in and you want a search-native store.
- Amazon Aurora PostgreSQL-Compatible Edition[11] supports vectors via the
pgvectorextension. Choose it when relational operational data already lives in PostgreSQL and you want embeddings and business data in one database instead of standing up a separate store. (Plain Amazon RDS for PostgreSQL also has thepgvectorextension as a database, but Aurora PostgreSQL is the PostgreSQL store Bedrock Knowledge Bases lets you select.) - Amazon Neptune Analytics[12] adds vector search to graph data (GraphRAG). Choose it when your knowledge is already a graph (relationships between entities) and you want similarity search over it.
- Third-party and serverless stores. Knowledge Bases also supports the cost-effective Amazon S3 Vectors store and the third-party stores Pinecone, Redis Enterprise Cloud, and MongoDB Atlas; pick these when you already operate one of them or want S3-priced vector storage.
- Amazon Kendra[13] is a managed intelligent-search service that can act as the retriever for RAG without you managing a raw vector index at all. Connect a Kendra index when you want managed enterprise search as the retrieval layer rather than operating your own vector engine.
The exam tests the mapping, not deep internals: "already run Aurora PostgreSQL, want vectors alongside" → Aurora PostgreSQL with pgvector; "graph data" → Neptune Analytics; "new RAG project, no existing DB" → OpenSearch Serverless; "want managed search as the retriever" → Kendra.
Agents for multi-step tasks. The store above answers where retrieved facts live; the next design building block answers what an FM can do beyond a single answer. A single FM call returns text for one prompt; an agent turns that into autonomous multi-step work: the model plans a sequence of actions, calls external tools or APIs, queries knowledge bases, and reasons over intermediate results before answering. Amazon Bedrock Agents[14] is the managed capability for this: it connects an FM to action groups[15] backed by AWS Lambda functions or APIs and to Knowledge Bases, so the agent can both retrieve grounding data and take real actions, for example, look up an order and then issue a refund. Reserve agentic AI for genuinely multi-step or tool-dependent requests; a single lookup or one generation does not need an agent's planning overhead. The Model Context Protocol (MCP) is an emerging open standard for connecting models to external tools and data sources in this same agentic pattern.
Cost trade-offs across customization approaches
A core Task 3.1 objective is explaining the cost trade-offs of the different ways to customize an FM. The four approaches form a ladder from cheapest/lowest-effort to most expensive/highest-effort (modeled below on the AWS custom-model[4] customization guidance), and the design skill is picking the lowest rung that meets the requirement:
- In-context learning / prompt engineering changes only the prompt. Model weights are untouched, no extra infrastructure, lowest cost and effort. It is the first thing to try for formatting, tone, and simple steering. Its limit: the model still knows only its training data plus whatever you type into each prompt.
- Retrieval Augmented Generation (RAG) adds retrieved external context to the prompt; weights are still untouched. Moderate cost and effort: you need an embedding step and a vector store such as Bedrock Knowledge Bases[8]. It is the strongest lever for grounding answers in private, large, or frequently changing knowledge and for reducing hallucination, and it stays current because you update the data store, not the weights.
- Fine-tuning updates the model's weights on your curated, labeled examples to teach durable style, format, or domain behavior. Highest cost and effort short of pre-training: it needs quality labeled data and a custom-model training run[4], and the result is frozen at training time. It goes stale until you retrain. Fine-tuning adapts behavior; it does not supply live facts.
- Pre-training builds a foundation model from scratch on a vast corpus. This is the most expensive option by far and is essentially never the AI-practitioner answer: the whole point of an FM is to reuse an expensive pre-trained base rather than fund another one.
The decisive distinction the exam leans on: RAG vs fine-tuning. Need live, changing, or private facts with citations? → RAG (update data, not weights). Need the model to internalize a fixed behavior, style, or format that rarely changes? → fine-tuning. Need it both grounded and behaving a certain way? → they are complementary, not mutually exclusive.
Exam-pattern recognition: design-decision stems
Task 3.1 questions are almost always disguised design decisions. Read the requirement keyword in the stem and let it select the answer; the distractors are usually right tools for the wrong requirement.
RAG vs fine-tuning vs prompting.
- Stem says private / internal / frequently changing data, must cite sources, reduce hallucination, no retraining → RAG (Amazon Bedrock Knowledge Bases). Update the vector store, not the weights.
- Stem says teach a durable style, tone, format, or domain behavior; specialized vocabulary; consistent persona → fine-tuning (a custom model).
- Stem says quick formatting, tone steering, a one-off task, cheapest option, no infrastructure → prompt engineering / in-context learning.
- Stem says build a model from scratch → almost never correct for an AI practitioner; pre-training is the most costly path and contradicts reusing an FM.
Vector-store selection. (These are the stores Bedrock Knowledge Bases lets you select.)
- "already use Amazon Aurora PostgreSQL, want embeddings in the same database" → pgvector on Aurora PostgreSQL.
- "new RAG workload, no existing database, want a search-native vector engine" → Amazon OpenSearch Serverless (OpenSearch Service managed clusters are also supported).
- "graph data / relationships" → Amazon Neptune Analytics. "MongoDB / document-style data, already on MongoDB Atlas" → MongoDB Atlas. "managed enterprise search as the retriever" → Amazon Kendra. "lowest-cost serverless vector storage" → Amazon S3 Vectors.
Inference-parameter tuning.
- "output must be consistent / reproducible / focused / the same every time" → lower temperature (and lower top-p / top-k).
- "more creative / varied / diverse output" → raise temperature (and top-p / top-k).
- "control cost or limit response length / stop run-on answers" → set the maximum-token (response-length) parameter, and remember it does not improve quality.
- "answer is factually wrong or out of date" → a trap if an option says "change temperature"; the fix is RAG or fine-tuning, because parameters tune sampling, not knowledge.
Multi-step / agent stems.
- "plan several dependent steps, call external APIs or tools, then act (look up then update/refund)" → Amazon Bedrock Agents (agentic AI; action groups + Knowledge Bases; MCP for tool connectivity).
- "one prompt-and-response or a single lookup is enough" → an agent is over-engineering; a plain FM call (or RAG) is the right, cheaper answer.
Model-selection stems. Watch for the "largest / most capable model for everything" distractor: the correct answer weighs cost, latency, modality, context window, and customization against the task, and a smaller or distilled model is often right when speed and unit cost dominate. "Long document keeps getting truncated" → the context window is too small (or use RAG to retrieve only relevant chunks). "Same large fixed context resent on every call, cut cost/latency" → prompt caching.
FM customization approaches: prompt engineering vs. RAG vs. fine-tuning
| Aspect | Prompt engineering / in-context learning | Retrieval Augmented Generation (RAG) | Fine-tuning |
|---|---|---|---|
| What it changes | Only the prompt; model weights untouched | Adds retrieved external context to the prompt; weights untouched | Updates the model's weights on your examples |
| Data freshness | Limited to what you type into each prompt | Always current: answers from the live vector store you keep updated | Frozen at training time; stale until you retrain |
| Cost / effort | Lowest; no extra infrastructure | Moderate; needs embeddings + a vector store (e.g. Bedrock Knowledge Bases) | Highest; needs curated labeled data and a training run |
| Reduces hallucination | Somewhat, via better instructions | Strongly, by grounding answers in retrieved source data | Indirectly, by adapting behavior: does not supply live facts |
| Best for | Quick tasks, formatting, and steering tone | Answering from private, large, or frequently changing knowledge | Teaching durable style, format, or domain behavior |
Decision tree
Sharp facts the exam loves — give these one last read before exam day.
Cheat sheet
Sharp facts the exam loves — scan these before test day.
- Bedrock exposes many FMs behind one API
Amazon Bedrock is a fully managed, serverless service that serves foundation models from many providers (Amazon Nova and Titan, Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Stability AI, and others) through a single API. Because there are no servers to run and the API is shared, you can compare candidate models and swap one for another without re-architecting the application. The provider roster changes often, so name a representative subset rather than treating any list as exhaustive.
- Bigger model is not automatically the right model
Model selection weighs cost, latency, modality, context window, customization path, language coverage, and compliance against the specific task, not raw capability alone. A smaller or distilled model is the correct answer when unit cost and speed dominate a narrow, well-scoped task, and a larger model only earns its keep when the task genuinely needs the extra capability.
Trap Reaching for the largest or most capable model for every workload, when a cheaper, faster small model meets a narrow task at lower cost.
5 questions test this
- A healthcare startup must deploy a generative AI assistant that fits within a tight memory and compute budget for a single, well-scoped…
- A startup must deploy a generative AI feature that runs at a low cost per request and responds with low latency, but it cannot tolerate a…
- An online retailer runs millions of product-categorization requests each day through a large foundation model (FM) on Amazon Bedrock.…
- A retail company is building a real-time customer service chatbot on Amazon Bedrock. The chatbot must return responses to users as quickly…
- A company is designing a multi-agent system on Amazon Bedrock with a supervisor agent coordinating three specialized sub-agents for…
- Bedrock cost scales with input plus output tokens
Bedrock on-demand pricing is token-based, charged per token processed with separate rates for input (prompt) tokens and output (completion) tokens. A longer prompt or a more verbose answer therefore costs more, and a larger model costs more per token than a smaller one, making prompt length, response length, and model choice all direct cost levers. Use the Bedrock pricing page as the only authoritative source for actual per-token figures.
Trap Assuming only output tokens are billed, when input (prompt) tokens are charged too, so a long fixed context drives cost even with short answers.
- Match the model's modality to the task
Model selection must match input and output modality: text-only, image generation (diffusion-family models such as Stability AI), or multimodal models that accept image plus text and return text. A text-only model cannot serve an image use case no matter how capable it otherwise is, so modality is a hard filter applied before any quality comparison.
Trap Picking a model on benchmark quality first and modality second, when a text-only model can never serve an image task however capable it is.
- Larger models trade capability for higher latency
Larger, higher-capability models generally respond more slowly, so latency is a first-class selection criterion. Interactive, real-time experiences such as chat or autocomplete push toward a smaller, faster model, whereas an offline batch summarization job can tolerate a slower, stronger one without hurting the user.
Trap Choosing the strongest model for a real-time chat or autocomplete feature, when its higher latency degrades the interactive experience a smaller model would keep fast.
- Context window is a hard shared token ceiling
The context window is a finite token budget that the prompt and the generated completion must share, a hard ceiling, not a soft guideline. A model whose window is too small truncates a long document regardless of its capability, so a recurring symptom of "the long document keeps getting cut off" points to an undersized context window, or to using RAG to retrieve only the relevant chunks instead of stuffing the whole document in.
Trap Treating the context window as covering only the input prompt, when the generated completion shares the same token budget, so a long answer can exhaust it too.
4 questions test this
- A law firm wants to use Amazon Bedrock to summarize lengthy contracts that can be several hundred pages long, with each contract submitted…
- A company wants its Amazon Bedrock assistant to answer questions accurately from a 500-page technical manual that is too large to fit in…
- A company wants a foundation model to answer questions using a large library of technical documents. The library is far too large to fit in…
- A financial services company is evaluating whether to use few-shot prompting or fine-tuning for adapting a foundation model deployed…
- Confirm multi-lingual support per model
Language coverage is an explicit selection criterion because models do not all support the same languages. An application that must understand or generate non-English text needs a model trained on those languages, which can rule a candidate in or out before cost or latency even enter the decision.
Trap Assuming any capable FM handles every language, when language coverage varies per model and an unsupported language rules a candidate out before cost or latency matter.
- Not every model supports fine-tuning customization
The intended customization path (prompting, RAG, or fine-tuning) is itself a model-selection criterion, because not every Bedrock model can be fine-tuned. Deciding the customization approach up front can disqualify candidate models that support only prompting and retrieval, so settle the approach before settling the model.
Trap Selecting a model on capability and assuming you can fine-tune it later, when not every Bedrock model supports fine-tuning and the choice can lock you out.
- Prompt caching reuses a large stable context
Prompt caching lets Bedrock cache a static prefix of the prompt (a long system prompt or a fixed document resent across many queries) and skip recomputing it on later calls, so cached-read tokens bill at a reduced rate and latency drops. It is the cost-and-latency lever when the same large, unchanging context is resent on every request; the cached prefix must stay byte-identical between calls or the cache misses.
Trap Expecting prompt caching to help when the reused context changes between calls, since the cached prefix must stay byte-identical or every request misses the cache.
- Inference parameters tune sampling, not knowledge
Inference parameters shape how a model samples and how long it generates at request time, without retraining or changing any weight. They add no knowledge and cannot fix a wrong answer: a factually wrong or out-of-date response is a grounding problem solved by RAG or fine-tuning, never by nudging temperature. Treat these parameters as controls over randomness and length only.
Trap Raising or lowering temperature to fix a factually wrong answer, when sampling parameters change variability and length but never the model's knowledge.
- Lower temperature gives focused deterministic output
Temperature reshapes the next-token probability distribution: a low value near 0 steepens it so the model favors its highest-probability tokens, giving focused, repeatable, more-deterministic output, the right setting for extraction, classification, or any task needing a consistent answer. A high temperature flattens the distribution toward lower-probability tokens for more varied, creative output.
Trap Raising temperature to make output more accurate or consistent, when higher temperature increases randomness and a low value is what gives focused, repeatable answers.
13 questions test this
- A media company is using Amazon Bedrock to generate creative marketing copy for advertising campaigns. The team wants the model to produce…
- A company is developing a multiple-choice quiz application using Amazon Bedrock foundation models. The application requires consistent and…
- A financial services company is building a document classification application using Amazon Bedrock. The application must consistently…
- A data analytics company is testing different foundation models in Amazon Bedrock for a text summarization application. The team wants to…
- A machine learning engineer is building a customer service chatbot using Amazon Bedrock. The chatbot needs to provide consistent and…
- A company uses Amazon Bedrock to power a customer support knowledge assistant. The team notices that the model returns varied and creative…
- A healthcare company is using Amazon Bedrock to build an application that analyzes patient symptoms and provides diagnostic suggestions to…
- A financial services company is building a customer support chatbot using Amazon Bedrock. The chatbot must provide consistent and accurate…
- A financial services company is using Amazon Bedrock to generate investment research reports. The reports require factual accuracy and…
- A data analytics company is using Amazon Bedrock to generate executive summaries from financial reports. The team notices that the model…
- A financial services company uses Amazon Bedrock to build a document analysis application. The application must extract specific data…
- A legal technology company is using Amazon Bedrock to generate contract clauses. The company requires highly consistent and predictable…
- A financial services company is using Amazon Bedrock to generate standardized regulatory compliance reports. The reports must follow…
- Top-p (nucleus) caps cumulative probability mass
Top-p, or nucleus sampling, restricts sampling to the smallest set of most-likely tokens whose cumulative probability reaches p: for p = 0.8, only the top 80% of the probability mass. Lowering top-p removes lower-probability tokens and shrinks the candidate pool, reducing output variability in the same direction as a lower temperature.
Trap Reading top-p as a fixed count of tokens, when it bounds cumulative probability mass so the candidate pool size varies with the distribution's shape.
- Top-k limits sampling to the k likeliest tokens
Top-k restricts sampling to the k most-likely next tokens: set k = 50 and the model only considers the 50 most probable candidates. Lowering k narrows the pool and reduces variability, the same direction as lowering temperature or top-p; the three are complementary randomness levers, narrowed together for consistency and loosened together for creativity.
Trap Confusing top-k with top-p, when top-k caps a fixed count of tokens while top-p caps a cumulative probability share.
- Max-tokens caps length but not quality
The maximum-response-length parameter caps how many tokens the completion can contain, directly bounding both latency and output cost since you pay per output token. It does not improve answer quality, and setting it too low truncates a legitimately long answer mid-sentence. Use it to control cost or stop run-on responses, not to make answers better.
Trap Raising max-tokens expecting a higher-quality answer, when the parameter only bounds response length and cost, not correctness.
- RAG grounds an FM on private current data
Retrieval Augmented Generation feeds an FM relevant information from your own data sources at query time, improving the relevance and accuracy of answers without retraining or fine-tuning. Because you update the data store rather than the model weights, RAG serves frequently changing or private information and reduces hallucination by grounding each answer in retrievable source text. Managed implementations also return citations so accuracy can be checked.
Trap Assuming RAG retrains or updates the model's weights with your data, when it leaves the weights untouched and injects retrieved text into the prompt at query time.
17 questions test this
- A pharmaceutical company wants a generative AI assistant to answer staff questions using proprietary research data that must not be used to…
- A company wants a foundation model (FM) to answer employee questions using internal policy documents that are updated every week. The…
- A company wants its Amazon Bedrock assistant to answer questions accurately from a 500-page technical manual that is too large to fit in…
- A company wants a foundation model to answer questions using a large library of technical documents. The library is far too large to fit in…
- A startup has no existing database infrastructure and limited engineering resources. The startup wants to connect an Amazon Bedrock…
- A company wants to build an application that uses a foundation model (FM) in Amazon Bedrock to answer employee questions based on the…
- A company wants a foundation model on Amazon Bedrock to answer employee questions using a product catalog that is updated several times per…
- A team wants to understand why Retrieval Augmented Generation (RAG) helps a foundation model produce more accurate answers about a…
- An online retailer wants a foundation model to recommend products using a catalog that changes daily. The retailer wants to keep responses…
- A retail company already has product catalog and FAQ content stored in Amazon S3. The company wants a generative AI chatbot to answer…
- A company wants a generative AI assistant that only answers employee questions by retrieving information from a static collection of…
- A company is comparing FM customization strategies in Amazon Bedrock. The company wants to ground model responses in its own documents and…
- A company's product catalog changes weekly, and an assistant built on a foundation model frequently returns outdated information. The…
- A financial services company wants its generative AI assistant to answer employee questions using the company's internal policy documents,…
- A healthcare provider wants a generative AI assistant to answer clinician questions strictly from its internal medical reference library…
- An insurance company wants a generative AI assistant to answer employee questions by referencing an external repository of policy…
- A financial services company wants its Amazon Bedrock chatbot to answer questions by using an internal policy library that is updated…
- RAG pipeline: chunk, embed, store, retrieve, augment
The RAG pipeline runs end to end: chunk source documents into passages, embed each chunk into a vector with an embedding model, and store the vectors in a vector store; then at query time embed the user question with the same model, retrieve the most similar chunks, and augment the prompt with them so the FM generates a grounded answer. Retrieving only the relevant chunks rather than stuffing the whole corpus is what keeps RAG cheaper and lower-latency than enlarging the prompt.
Trap Augmenting the prompt with the whole corpus instead of the retrieved chunks, which erases the cost and latency advantage RAG gets from retrieving only relevant passages.
- Embeddings place similar text near each other
An embedding is a fixed-length numeric vector produced by an embedding model that places semantically similar text close together in vector space. Retrieval then runs nearest-neighbour similarity search over those vectors (performed by the vector store, not the embedding model) and the query must be embedded with the same model used for the stored chunks, or the distances are meaningless.
Trap Embedding stored documents and live queries with two different embedding models, which puts them in incomparable vector spaces and breaks retrieval.
3 questions test this
- A company is building a Retrieval Augmented Generation (RAG) application that must perform semantic similarity (k-NN) searches across…
- A company already operates an Amazon OpenSearch Service domain for application log analytics. The company now wants to add large-scale…
- A streaming media company is building a new semantic search feature for its catalog and must store hundreds of millions of content…
- Bedrock Knowledge Bases is managed RAG
Amazon Bedrock Knowledge Bases is the managed AWS service that implements the whole RAG pipeline (ingestion, chunking, embedding, storage, and retrieval) so you do not build and operate it yourself; you point it at a data source and a vector store and it handles the rest, returning citations with each answer. It is the answer for "ground an FM on our documents without building RAG infrastructure," and a knowledge base can also be attached to a Bedrock agent.
Trap Standing up your own chunking, embedding, and vector-retrieval pipeline when Bedrock Knowledge Bases delivers the same managed RAG without building the infrastructure.
20 questions test this
- A pharmaceutical company wants a generative AI assistant to answer staff questions using proprietary research data that must not be used to…
- A financial services company is building a customer support chatbot using Amazon Bedrock Knowledge Bases with documents stored in Amazon…
- A financial services company wants to build an internal assistant that answers employee questions by using the company's private policy…
- A company currently pastes an entire 80-page employee handbook into every Amazon Bedrock prompt so the model can answer HR questions. Input…
- A company wants its Amazon Bedrock assistant to answer questions accurately from a 500-page technical manual that is too large to fit in…
- A company wants a foundation model to answer questions using a large library of technical documents. The library is far too large to fit in…
- A startup has no existing database infrastructure and limited engineering resources. The startup wants to connect an Amazon Bedrock…
- A company wants to build an application that uses a foundation model (FM) in Amazon Bedrock to answer employee questions based on the…
- A logistics company wants a generative AI application that lets a user state a goal in natural language, after which the application…
- A company wants a foundation model on Amazon Bedrock to answer employee questions using a product catalog that is updated several times per…
- A company is building a RAG application and wants the LEAST operational effort to ingest documents, chunk them, generate embeddings, store…
- A retail company already has product catalog and FAQ content stored in Amazon S3. The company wants a generative AI chatbot to answer…
- A company wants a generative AI assistant that only answers employee questions by retrieving information from a static collection of…
- A company is comparing FM customization strategies in Amazon Bedrock. The company wants to ground model responses in its own documents and…
- A compliance team uses a foundation model in Amazon Bedrock to answer questions about regulatory documents that are revised frequently. The…
- A legal firm is building a document research assistant using Amazon Bedrock Knowledge Bases. The application must display which source…
- A healthcare provider wants a generative AI assistant to answer clinician questions strictly from its internal medical reference library…
- An insurance company wants a generative AI assistant to answer employee questions by referencing an external repository of policy…
- A financial services company wants its Amazon Bedrock chatbot to answer questions by using an internal policy library that is updated…
- A marketing company needs its Amazon Bedrock assistant to always respond in the company's distinctive brand voice and to reference product…
- Vector store options across AWS managed services
Bedrock Knowledge Bases lets you select from several vector stores: Amazon OpenSearch Serverless and OpenSearch Service managed clusters, Amazon Aurora PostgreSQL via the pgvector extension, Amazon Neptune Analytics for graph data (GraphRAG), the cost-effective Amazon S3 Vectors store, and the third-party stores Pinecone, Redis Enterprise Cloud, and MongoDB Atlas; you can also connect an Amazon Kendra index for managed retrieval instead of a raw vector store. The exam tests mapping a scenario to the right store, not deep internals.
Trap Selecting plain Amazon RDS for PostgreSQL or DocumentDB as a Knowledge Bases vector store. They hold vectors as databases but are not selectable stores; only Aurora PostgreSQL is.
4 questions test this
- A news organization is building a semantic search application where newly published article embeddings must become searchable almost…
- A logistics company stores highly connected data that represents relationships between shipments, locations, and customers as a graph. The…
- A company already operates an Amazon OpenSearch Service domain for application log analytics. The company now wants to add large-scale…
- A retail company already runs its transactional application data on Amazon Aurora PostgreSQL-compatible edition. The company wants to add…
- OpenSearch is the default new-RAG vector engine
Amazon OpenSearch Service, including OpenSearch Serverless, provides a k-NN vector engine and is the common default for a new, purpose-built RAG workload. Choose it when no existing database has to hold the vectors and you want a search-native store. The Bedrock console can even create an OpenSearch Serverless store for you automatically.
Trap Reaching for OpenSearch when relational data already lives in PostgreSQL, where co-locating embeddings via Aurora pgvector fits better than a separate search-native store.
5 questions test this
- A company needs a scalable search service that can store vector embeddings and also support traditional keyword search for a retrieval…
- A news organization is building a semantic search application where newly published article embeddings must become searchable almost…
- A company is building a Retrieval Augmented Generation (RAG) application that must perform semantic similarity (k-NN) searches across…
- A company already operates an Amazon OpenSearch Service domain for application log analytics. The company now wants to add large-scale…
- A streaming media company is building a new semantic search feature for its catalog and must store hundreds of millions of content…
- pgvector keeps embeddings beside PostgreSQL data
Amazon Aurora PostgreSQL-Compatible Edition supports embeddings through the pgvector extension and is the PostgreSQL store you select for a Bedrock Knowledge Base. Choose it when relational operational data already lives in PostgreSQL and you want embeddings and business data in one database rather than a separate vector store. Note that plain RDS for PostgreSQL supports pgvector as a database but is not a selectable Knowledge Bases store, only Aurora is.
Trap Selecting RDS for PostgreSQL as the Knowledge Bases pgvector store, when only Aurora PostgreSQL is a selectable store despite RDS also supporting the extension.
- Neptune for vectors over graph data
Amazon Neptune Analytics adds vector similarity search to graph data, the basis of GraphRAG in Bedrock Knowledge Bases. Choose it when your knowledge is already a graph of relationships between entities and you want similarity search over that graph rather than standing up a separate vector engine.
Trap Standing up a separate vector engine when the knowledge is already a graph of entity relationships that Neptune Analytics can search in place via GraphRAG.
2 questions test this
- Kendra is managed retrieval without a raw vector index
Amazon Kendra is a managed intelligent enterprise-search service that can act as the retriever for RAG without you operating a raw vector index at all. Choose it when you want managed enterprise search as the retrieval layer instead of provisioning and tuning your own vector engine.
Trap Provisioning and tuning a raw vector engine for enterprise search when Kendra acts as a managed RAG retriever without one.
- Customization ladder from cheapest to most expensive
The FM customization approaches form a cost/effort ladder: prompt engineering and in-context learning (cheapest, weights untouched), then RAG (moderate, needs embeddings and a vector store), then fine-tuning (high, needs labeled data and a training run), then pre-training from scratch (most expensive by far). The design skill is choosing the lowest rung that meets the requirement rather than reaching past it.
Trap Climbing straight to fine-tuning when prompt engineering or RAG, the cheaper lower rungs, already meet the requirement without touching weights.
4 questions test this
- A company is evaluating ways to customize a foundation model in Amazon Bedrock. The company wants to understand which approach generally…
- A company is comparing FM customization approaches on Amazon Bedrock and wants to understand which approach is the MOST resource-intensive…
- A startup has a very limited budget and wants a foundation model on Amazon Bedrock to use a small set of reference information when…
- A company is using Amazon SageMaker JumpStart to deploy a foundation model for customer intent classification. After implementing few-shot…
- Pre-training from scratch is almost never the answer
Pre-training builds a foundation model from scratch on a vast corpus and is by far the most expensive option, in data, compute, and time. It is essentially never the AI-practitioner answer, because the whole point of using an FM is to reuse an expensive pre-trained base rather than fund another one, so "train a model from scratch" in a stem is almost always a distractor.
Trap Choosing pre-training a model from scratch when prompting, RAG, or fine-tuning would meet the requirement at a fraction of the cost.
3 questions test this
- A company is comparing FM customization approaches on Amazon Bedrock and wants to understand which approach is the MOST resource-intensive…
- A healthcare technology company has thousands of labeled prompt-response pairs and wants a foundation model to consistently adopt its…
- For which scenario is starting from a pre-trained model in Amazon SageMaker JumpStart MOST appropriate instead of building a model from…
- RAG vs fine-tuning: facts versus behavior
RAG supplies live, changing, or private facts with citations by updating the data store, not the weights; fine-tuning teaches a durable style, format, persona, or domain behavior by updating the weights, and goes stale until retrained. RAG injects facts at query time without changing behavior; fine-tuning changes behavior without supplying live facts. They are complementary, and many real designs use both rather than choosing one.
Trap Fine-tuning a model to inject frequently changing facts, when RAG updates a data store without a retraining run and keeps answers current.
6 questions test this
- An online retailer wants a foundation model to recommend products using a catalog that changes daily. The retailer wants to keep responses…
- A financial services company wants a foundation model on Amazon Bedrock to consistently produce customer communications that match the…
- A legal services firm wants an Amazon Bedrock foundation model to consistently use the firm's specialized legal terminology, reasoning…
- A media company wants its Amazon Bedrock model to consistently respond in a specific brand voice and structured output format across all…
- A compliance team uses a foundation model in Amazon Bedrock to answer questions about regulatory documents that are revised frequently. The…
- A marketing company needs its Amazon Bedrock assistant to always respond in the company's distinctive brand voice and to reference product…
- Bedrock Agents perform multi-step tool-using tasks
An agent turns a single FM response into autonomous multi-step work: the model breaks a request into steps, calls external APIs or tools, queries knowledge bases, and reasons over intermediate results before answering. Amazon Bedrock Agents is the managed capability that connects an FM to action groups (backed by AWS Lambda functions or APIs) and to Knowledge Bases, so one agent can both retrieve grounding data and take real actions, for example, look up an order and then issue a refund.
Trap Reaching for RAG when the task also has to take real actions like issuing a refund, since RAG only retrieves grounding data while a Bedrock agent calls tools too.
13 questions test this
- An insurance company wants an assistant that, from a single customer request, looks up an existing claim's status, retrieves the policy…
- A logistics company already uses a foundation model with a knowledge base to answer shipping policy questions. The company now wants the…
- An insurance company wants a generative AI application that lets employees ask a question in plain language and then automatically…
- An IT operations team wants a generative AI solution where an employee can describe a problem in plain language, and the solution then…
- A travel company wants to build an AI assistant that, within one customer conversation, looks up a loyalty point balance, books a flight,…
- A retail company wants to build a generative AI assistant that can accept a customer request in natural language, then automatically break…
- A logistics company wants a generative AI application that lets a user state a goal in natural language, after which the application…
- A company already runs a generative AI application on Amazon Bedrock that answers single-turn questions. The company now wants to add the…
- A development team needs a generative AI solution that can reason about a user request, determine the actions required, and call external…
- A media company needs a feature that summarizes a single news article into one paragraph when a user clicks a button. Each request is…
- A travel company is building an assistant on Amazon Bedrock that must interpret a user request, break it into steps, call internal booking…
- Which statement BEST describes the role of an AI agent in a generative AI application?
- A company already uses a single-turn foundation model through Amazon Bedrock to summarize documents. The company now wants the model to…
- Reserve agents for genuinely multi-step work
An agent's planning and orchestration overhead is over-engineering for a single prompt-and-response or a one-shot lookup; reserve it for genuinely multi-step or tool-dependent requests. When one generation answers the question, a plain FM call is correct; when one retrieval answers it, RAG is the cheaper correct answer.
Trap Wrapping a single prompt-and-response in a Bedrock agent, adding planning overhead and cost where one plain FM call would do.
11 questions test this
- A company wants a foundation model on Amazon Bedrock to rewrite a single block of customer-provided text in a more professional tone when a…
- A logistics company already uses a foundation model with a knowledge base to answer shipping policy questions. The company now wants the…
- An insurance company wants a generative AI application that lets employees ask a question in plain language and then automatically…
- An IT operations team wants a generative AI solution where an employee can describe a problem in plain language, and the solution then…
- A travel company wants to build an AI assistant that, within one customer conversation, looks up a loyalty point balance, books a flight,…
- A retail company wants to build a generative AI assistant that can accept a customer request in natural language, then automatically break…
- A company already runs a generative AI application on Amazon Bedrock that answers single-turn questions. The company now wants to add the…
- A media company needs a feature that summarizes a single news article into one paragraph when a user clicks a button. Each request is…
- A travel company is building an assistant on Amazon Bedrock that must interpret a user request, break it into steps, call internal booking…
- Which statement BEST describes the role of an AI agent in a generative AI application?
- A company already uses a single-turn foundation model through Amazon Bedrock to summarize documents. The company now wants the model to…
- MCP is the open standard for tool connectivity
The Model Context Protocol (MCP) is an open standard for connecting AI models and applications to external tools, data sources, and workflows, the standardized integration layer for the agentic pattern. The AIF-C01 blueprint lists it under the role of agents in multi-step tasks, alongside Amazon Bedrock Agents and agentic AI.
- Prompt routing directs requests to the right model
Amazon Bedrock intelligent prompt routing exposes one serverless endpoint that routes each request to a different model within the same model family, predicting per-request which model gives the best response and routing accordingly to balance quality and cost: a cheaper, faster model for simple prompts, a stronger one for hard prompts. It chooses among models in one family (for example Claude Haiku versus Claude Sonnet), not across unrelated providers.
Trap Expecting prompt routing to pick across unrelated providers, when it routes only among models within one family such as Claude Haiku versus Claude Sonnet.
3 questions test this
- A company's single generative AI application on Amazon Bedrock handles requests that vary widely in difficulty. The company wants the…
- A travel company operates one generative AI application on Amazon Bedrock that receives customer requests of widely varying difficulty. The…
- A healthcare information company runs a single generative AI application on Amazon Bedrock that answers patient questions ranging from…
- Knowledge Bases metadata filtering narrows retrieval
In Amazon Bedrock Knowledge Bases you can attach metadata (such as product version, document type, business unit, or project ID) to documents and apply matching filters at query time, so retrieval returns a well-defined subset of the semantically relevant chunks instead of everything that merely matches. It pre-filters before the similarity search, improving relevance and personalizing results, for example, returning only the current software version or one team's documents.
Trap Relying on the FM to ignore stale or other teams' chunks after retrieval, when metadata filtering excludes them before the similarity search returns them at all.
5 questions test this
- A healthcare organization is implementing a RAG-based application using Amazon Bedrock Knowledge Bases to help physicians access patient…
- A company is building a customer support chatbot using Amazon Bedrock Knowledge Bases. The knowledge base contains product documentation…
- A technology company has deployed Amazon Bedrock Knowledge Bases with product documentation spanning multiple software versions. Users…
- A healthcare company uses Amazon Bedrock Knowledge Bases to build a question-answering application for medical professionals. The company…
- A healthcare organization is implementing a RAG application using Amazon Bedrock Knowledge Bases to allow doctors to query patient records…
References
- What is Amazon Bedrock?
- Supported foundation models in Amazon Bedrock
- Amazon Bedrock Pricing
- Customize your model to improve its performance for your use case
- Prompt caching for faster model inference
- Influence response generation with inference parameters
- What is RAG (Retrieval-Augmented Generation)?
- Retrieve data and generate AI responses with Amazon Bedrock Knowledge Bases
- Supported vector stores for Amazon Bedrock Knowledge Bases
- Amazon OpenSearch Serverless vector search collections
- Working with Amazon Aurora PostgreSQL as a vector database for Amazon Bedrock
- Vector similarity search in Amazon Neptune Analytics
- What is Amazon Kendra?
- Automate tasks in your application using AI agents (Amazon Bedrock Agents)
- How Amazon Bedrock Agents works (action groups)