When a company wants to “use AI with their data,” they often ask: “Do we need to train a model?” In most cases, no. Training (fine-tuning) is expensive, requires expertise, and above all, it’s not the best way to ensure that AI correctly cites procedures, price lists, and updated FAQs.<\/p>\n
This is where RAG (Retrieval-Augmented Generation) comes in: an approach that allows a language model to consult your documents before responding.<\/p>\n
Why “training the model” isn’t the answer
\nFine-tuning is useful when you want to structurally change behaviors and style (e.g., labeling, a very specific tone, a repetitive task). But if the issue is “it needs to know our updated policies,” fine-tuning is inefficient:<\/p>\n
Every change requires a new cycle;
\nyou risk “incorporating” obsolete information;
\nyou don’t have timely citations of the document.<\/p>\n
RAG, on the other hand, uses documents as an updated external source.<\/p>\n
What is RAG in simple terms?
\nRAG = Search + Generation.<\/p>\n
When you ask a question, the system searches your documents for relevant passages (retrieval).
\nThen the model generates the answer using those passages as context.
\nThe goal isn’t to “make the AI \u200b\u200ban expert”: it’s to make it answer with evidence.<\/p>\n
Components: Documents, Chunks, Embeddings, Vector DB
\nTo make a RAG work well, you need to address three aspects.<\/p>\n
1) Documents<\/p>\n
PDFs, wikis, manuals, email templates, policies: all are fine, but better if:<\/p>\n
updated;<\/p>\n
versioned;
\nstructured (titles, sections).
\n2) Chunking<\/p>\n
Documents are broken into chunks. If the chunks are too large, you recover useless content; if they’re too small, you lose context.<\/p>\n
Practical guidelines:<\/p>\n
Chunk 300\u2013800 words (depends on the domain);
\n10\u201320% overlap to avoid breaking concepts;
\nstore titles and paragraphs as metadata.
\n3) Embeddings<\/p>\n
Embeddings are numerical representations that capture “semantic similarity.” Your query is transformed into an embedding and compared with those of the chunks to find the most similar ones.<\/p>\n
For you, in practice, this means: if you ask for “return policy,” the system also finds chunks that mention “returned merchandise” or “RMA,” even if they don’t use the same word.<\/p>\n
Vector database<\/p>\n
It is used to store and search for embeddings efficiently (even a simple database can suffice initially, but for scaling, a dedicated solution is recommended).<\/p>\n
Retrieval: how to find the right chunks
\n“Na\u00efve” retrieval takes the top-k most similar chunks. In your company, it’s worth improving:<\/p>\n
Metadata and filters: department=support, language=IT, version=2026.
\nRe-ranking: A second phase that reorders results with a more precise model.
\nHybrid search: Combining keyword and semantic search.
\nExample: For a product catalog, brand\/model filters increase precision and reduce hallucinations.<\/p>\n
Prompts and citations: How to make output reliable
\nA robust RAG doesn’t just say “here’s the answer”: it also includes where it comes from. Two useful techniques:<\/p>\n
Explicitly ask: “Cite sources with document title and section.”
\nConstraint: “If you don’t find it in the documents, say you don’t know and ask for clarification.”
\nYou can also force a format:<\/p>\n
Short answer
\nRelevant passages (quote)
\nNext actions
\nCommon mistakes and quality checklists
\nTypical errors:<\/p>\n
Dirty documents (scanned PDFs with no text). Solution: OCR.
\nContextless chunks (tables only). Solution: Add titles and supporting rows.
\nUnversioned data: AI fishes out old policies. Solution: “valid_from\/valid_to” metadata.
\nTop-k too low: poor recovery. Solution: Increase and use re-ranking.
\nPermissive prompt: the model “completes” with imagination. Solution: rules and citations.
\nQuick checklist:<\/p>\n
Does it always retrieve the right sources on 20 test questions?
\nDo the answers cite real sections?
\nIf a document is missing, does the AI \u200b\u200badmit it?
\n5-step mini-project for an SME
\nSelect 30\u201350 core documents.
\nClean and structure (titles, versions, OCR).
\nChunking + embedding + indexing.
\nTest queries: 50 real questions (support\/sales).
\nDeploy to production with logging and feedback loop.
\nRAG is the bridge between “generic AI” and “AI useful in the enterprise.” You don’t need to be a big tech company: you need organized documents and a simple but well-controlled pipeline.<\/p>\n","protected":false},"excerpt":{"rendered":"
When a company wants to “use AI with their data,” they often ask: “Do we need to train a model?” In most cases, no. Training…<\/p>\n","protected":false},"author":10,"featured_media":20471,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"obx_sintesi":"RAG, or Retrieval-Augmented Generation, lets a language model search your company documents for relevant passages and then generate an answer using them as context, so the AI answers with evidence from your own sources. It is the right choice when the need is up-to-date policies, price lists or FAQs, because fine-tuning requires a new cycle for every change and gives no citations.","obx_punti":"[\"Split documents into chunks of 300 to 800 words with 10 to 20 percent overlap, storing titles and paragraphs as metadata\", \"Improve basic top-k retrieval with metadata filters such as department, language and version, a re-ranking phase and hybrid keyword plus semantic search\", \"Instruct the model to cite document title and section, and to say it does not know when the answer is not in the documents\"]","obx_faq":"[{\"q\": \"What is RAG in AI in simple terms?\", \"a\": \"RAG stands for Retrieval-Augmented Generation and works as search plus generation. When you ask a question, the system first searches your documents for the relevant passages, then the language model writes the answer using those passages as context. The aim is not to make the AI an expert but to make it answer with evidence drawn from your PDFs, wikis, manuals and policies.\"}, {\"q\": \"RAG vs fine-tuning: which one should a company use?\", \"a\": \"Use fine-tuning when you want to change a model's behavior or style structurally, for example labeling tasks or a very specific tone. Use RAG when the model needs to know updated policies, price lists or FAQs: fine-tuning would require a new training cycle for every change, risks baking in obsolete information and cannot cite the document, while RAG reads an external, current source each time.\"}, {\"q\": \"What are embeddings and a vector database in RAG?\", \"a\": \"Embeddings are numerical representations that capture semantic similarity. Your question is turned into an embedding and compared with the embeddings of the document chunks to find the closest ones, so a query about a return policy also finds passages mentioning returned merchandise or RMA. A vector database stores and searches these embeddings efficiently; a simple database can suffice at first, but a dedicated solution is recommended for scaling.\"}, {\"q\": \"What are the most common RAG mistakes?\", \"a\": \"Typical errors are scanned PDFs with no text layer, fixed with OCR; chunks without context, fixed by adding titles and supporting rows; unversioned data that lets the AI retrieve old policies, fixed with valid_from and valid_to metadata; a top-k that is too low, fixed by increasing it and adding re-ranking; and a permissive prompt that lets the model fill gaps with imagination, fixed with rules and citations.\"}, {\"q\": \"How can a small business start a RAG project?\", \"a\": \"A five-step mini-project works for an SME: select 30 to 50 core documents; clean and structure them with titles, versions and OCR where needed; run chunking, embedding and indexing; test with 50 real questions from support and sales; then deploy to production with logging and a feedback loop. Before going live, check that 20 test questions always retrieve the right sources and that answers cite real sections.\"}]","obx_fonti":"[]","obx_revisione":"","footnotes":""},"categories":[3710],"tags":[],"yst_prominent_words":[],"class_list":["post-21260","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ai-en"],"_links":{"self":[{"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/posts\/21260","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/comments?post=21260"}],"version-history":[{"count":1,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/posts\/21260\/revisions"}],"predecessor-version":[{"id":22160,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/posts\/21260\/revisions\/22160"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/media\/20471"}],"wp:attachment":[{"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/media?parent=21260"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/categories?post=21260"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/tags?post=21260"},{"taxonomy":"yst_prominent_words","embeddable":true,"href":"https:\/\/www.ottobix.com\/en\/wp-json\/wp\/v2\/yst_prominent_words?post=21260"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}