Demo_page_Background.svg

Your One-Stop Knowledge Hub

AI and Document Processing Glossary

The one-stop place to explore document AI and automation terminology, from core processing concepts to advanced workflows and runtime execution.

AI, LLMs & Generative AI

Learn about Core AI & ML concepts, LLM & GenAI basics needed to understand document intelligence, Prompting, grounding, and reliability

Accuracy vs Confidence

Accuracy measures the frequency at which an artificial intelligence model provides the correct answer based on established ground truth data. Confidence represents the statistical probability assigned by the model to its own specific output. These two metrics are not always aligned because a model can produce a false statement with a very high confidence score. Distinguishing between them is vital for developers who need to implement safety thresholds in high stakes automation environments.

AI Guardrails

AI Guardrails refer to the architectural constraints and safety policies integrated into generative systems to ensure outputs remain helpful and harmless. These frameworks act as a filter for both incoming user queries and outgoing model responses to prevent the generation of biased or restricted content. By implementing these digital boundaries organizations can deploy large language models while maintaining strict compliance with corporate ethics and regional data privacy regulations.

Artificial Intelligence (AI)

Artificial Intelligence is a broad branch of computer science focused on building smart machines capable of performing tasks that typically require human cognition. This includes the ability to learn from experience and solve complex problems through logic. Modern AI has moved beyond simple programmed instructions to sophisticated systems that can understand natural language and recognize visual patterns. It serves as the foundational technology for modern automation and data driven decision-making.

Confidence Scoring

Confidence Scoring is a quantitative method used by machine learning models to communicate how certain they are about a specific prediction or classification. This score is usually expressed as a probability value between zero and one. In professional applications these scores allow system administrators to set automated triggers where the AI will hand off a task to a human expert if the internal certainty falls below a pre-determined level of reliability for that specific operation.

Context Window

The Context Window defines the total amount of text data a model can consider at any single point in time during a conversation. It functions similarly to human short term memory by allowing the system to reference earlier parts of a document or dialogue. A larger window is essential for analyzing lengthy legal contracts or maintaining consistency in long form technical writing. If the information exceeds this limit the model begins to lose track of the earliest parts of the interaction.

Deep Learning

Deep Learning is a sophisticated category of machine learning that utilizes multi layered neural networks to process data in complex ways. These layers allow the system to learn hierarchical representations such as identifying simple edges in an image before recognizing full objects. This technology is responsible for the massive leap in performance seen in speech recognition and image generation. It requires significant computational power but offers unparalleled accuracy in identifying patterns within massive datasets.

Embeddings

Embeddings are numerical representations of information where words or images are converted into long strings of numbers known as vectors. This process allows computers to understand the relationship between different concepts based on their proximity in a mathematical space. For example the word coffee and the word espresso would be positioned close together because they share a similar semantic meaning. This technology is the core component behind modern search engines and recommendation systems.

Explainable AI (XAI)

Explainable AI is a set of processes and methods that allow human users to understand and trust the results created by machine learning algorithms. Since many advanced models operate as a black box where the logic is hidden XAI aims to describe the internal reasoning in a way that is transparent. This is particularly important in regulated industries like finance and healthcare where professionals must be able to justify why an automated system reached a specific conclusion or diagnosis.

Few-Shot Learning

Few Shot Learning is a technique where a user provides a few examples within a prompt to guide the model toward a desired output style. Instead of needing thousands of data points, the model uses these few examples to understand the context or formatting requirements of the task. This makes artificial intelligence highly adaptable for niche business applications where only a limited amount of specialized data is available for training or prompt engineering purposes.

Fine-Tuning

Fine-Tuning is the process of taking a general purpose model that has already been trained on a massive dataset and further training it on a smaller specialized dataset. This process sharpens the model for specific domains such as medical research or legal analysis. While the base model provides a broad understanding of language fine-tuning ensures that the final application follows specific industry terminologies and behavioural standards required for professional enterprise deployment.

Foundation Models

Foundation Models are large scale artificial intelligence systems trained on vast and diverse data sources that can be adapted to many different downstream tasks. These models serve as the starting point for most modern AI applications because they possess a wide breadth of general knowledge. Developers can build specialized tools on top of these foundations which significantly reduces the time and cost associated with creating high performance machine learning applications from scratch.

Generative AI (GenAI)

Generative AI refers to a specific type of artificial intelligence designed to create new content such as text images and music rather than just analyzing existing data. It works by learning the underlying patterns of its training data and using that knowledge to predict the most likely sequence of information to fulfill a request. This technology is currently transforming creative workflows and software development by automating the initial stages of content creation and coding.

Hallucination

A Hallucination in the context of artificial intelligence occurs when a model generates information that is factually incorrect or entirely fabricated while appearing to be accurate. These errors happen because the system is predicting the next most likely word rather than checking a database of facts. Managing hallucinations is a primary challenge for developers who use grounding techniques and retrieval systems to ensure that the model stays tethered to verified and reliable information.

Human-in-the-Loop (HITL)

Human in the Loop is a model of interaction where human feedback is integrated into the artificial intelligence lifecycle to improve accuracy and safety. This involves humans reviewing model outputs or providing corrections during the training phase. HITL is a critical strategy for ensuring that automated systems remain aligned with human intent and ethical standards. It acts as a vital layer of oversight for high stakes applications where automated errors could have significant consequences.

Inference

Inference is the stage where a trained artificial intelligence model is put to work to process new data and generate a response. While the training phase is where the model learns its capabilities inference is the actual execution of those capabilities in a real world environment. When a user sends a message to a chatbot the model performs inference to analyze the input and produce a relevant answer based on the weights and patterns it established during its development.

Large Language Models (LLMs)

Large Language Models are advanced AI systems that have been trained on massive amounts of text to understand and generate human language with high fluency. These models utilize transformer architectures to process sequences of words and predict the most logical continuation of a thought. Their versatility allows them to translate languages and write code or summarize documents. The scale of these models refers to the billions of parameters that enable their sophisticated reasoning capabilities.

Machine Learning (ML)

Machine Learning is a subset of artificial intelligence that focuses on the development of algorithms that allow computers to learn from data without being explicitly programmed. By identifying statistical patterns within large datasets these systems can make predictions and improve their performance over time as they are exposed to more information. This technology powers everything from email spam filters to the complex recommendation engines used by major streaming services and retail websites.

Model Drift

Model Drift describes the phenomenon where the performance of an artificial intelligence system declines over time as the real world data it encounters changes. This often happens because the patterns the model learned during its initial training are no longer representative of the current environment. To combat this issue engineers must continuously monitor model outputs and perform regular updates or retraining sessions to ensure the system remains accurate and useful for its intended purpose.

Multimodal AI

Multimodal AI refers to systems that can process and integrate different types of data inputs such as text and images and audio within a single framework. This allows the model to understand context more like a human would by combining visual information with verbal descriptions. For example a multimodal system can analyze a video and provide a written summary of the events taking place. This capability is essential for building more intuitive and versatile digital assistants.

Pre-training

Pre training is the initial phase of building a large scale model where the system is exposed to a massive amount of unlabelled data to learn the basics of language and logic. During this stage the model develops a foundational understanding of how information is structured across the internet and in books. Once this general training is complete the model can then undergo more specific training to perform particular tasks which makes the overall development process more efficient.

Prompt Engineering

Prompt Engineering is the strategic process of designing and refining inputs to get the best possible results from an artificial intelligence model. It involves selecting the right words and providing clear context to guide the model toward a specific goal. Effective prompt engineering can significantly improve the quality of an output and reduce the likelihood of errors. It has become a vital skill for professionals who want to leverage the full potential of generative systems.

Prompt Grounding

Prompt Grounding is a technique used to provide an artificial intelligence model with specific and factual references to use when generating a response. By including a source document or a verified set of facts in the prompt the model is forced to base its answer on that specific information rather than its general training data. This is one of the most effective ways to reduce hallucinations and ensure that the AI provides accurate and contextually relevant information.

Prompt Templates

Prompt Templates are standardized frameworks used to structure inputs for an AI model to ensure consistency and reliability. These templates often include predefined sections for instructions and context and variables which help in automating complex tasks. By using a template organizations can ensure that every interaction with the model follows the same professional tone and formatting requirements. This is particularly useful for scaling AI solutions across a large workforce.

Retrieval-Augmented Generation (RAG)

Retrieval Augmented Generation is a framework that connects a generative AI model to an external and trusted knowledge source. When a user asks a question the system first searches the external database for relevant information and then provides that data to the model to generate a response. This approach allows the AI to provide up to date and highly specific answers without the need for constant retraining of the underlying model architecture.

Semantic Search

Semantic Search is a sophisticated data retrieval method that understands the intent and meaning behind a search query rather than just matching keywords. By analyzing the relationship between words this technology can find relevant documents even if they do not contain the exact terms used in the search box. This leads to a much more intuitive user experience and is the primary technology behind modern enterprise search tools and advanced knowledge management systems.

System Prompt

A System Prompt is a high level instruction that sets the fundamental behavior and persona of an artificial intelligence model for a given session. It is established at the beginning of the interaction and dictates the rules the model must follow such as the language it should use or the specific role it should play. This hidden layer of instruction ensures that the AI stays within its professional boundaries and maintains a consistent tone of voice for the user.

Temperature

Temperature is a hyperparameter used during the sampling process of a language model to control the balance between predictability and variety. When the temperature is set to a low value the model will consistently choose the most probable next word which leads to very stable and repetitive text. When the temperature is increased the model explores less common word choices which can result in more diverse and creative writing. It is a key tool for customizing the model behavior.

Tokenization

Tokenization is the process of converting a string of text into smaller units called tokens which the artificial intelligence model can then process mathematically. These tokens can represent individual words or parts of words or even punctuation marks. Understanding tokenization is important for developers because models are often limited by the number of tokens they can handle in a single request. It also directly impacts the cost and efficiency of running large language models.

Vector Search

Vector Search is a mathematical method for finding similar items in a large dataset by comparing their positions in a high dimensional space. Because items with similar meanings are stored as vectors that are close to each other the system can quickly retrieve relevant information based on conceptual similarity. This is a massive improvement over traditional database searches and is essential for powering long term memory and document retrieval in modern generative AI systems.

Vision-Language Models (VLMs)

Vision Language Models are a specialized type of AI designed to understand the relationship between images and text. These models can perform complex tasks like describing the contents of a photograph or answering questions about a diagram or reading text within a picture. By bridging the gap between visual and linguistic data VLMs enable computers to interact with the world in a more comprehensive way which is vital for applications like autonomous systems and accessibility tools.

Zero-Shot Learning

Zero Shot Learning refers to the ability of an artificial intelligence model to perform a task without having seen any specific examples of that task during its training or in the prompt. This capability demonstrates the deep generalized knowledge that large language models possess. For example a model might be able to translate a sentence into a rare language or solve a unique logic puzzle simply by understanding the instructions provided by the user in natural language.

Document AI & IDP

Understand the various terms associated with Document AI and Intelligent Document Processing. Learn about document classification, comparison, spitting and much more.

Adaptive Content Intelligence

Adaptive Content Intelligence refers to sophisticated systems that employ machine learning to refine their understanding of data based on user interactions and evolving environmental contexts. Unlike static systems these models learn from corrections and new information to improve how they categorise and extract value from unstructured data. This ensures that an organisation remains agile as its internal content types and business requirements shift over time.

Cross-Document Comparison

Cross Document Comparison is the systematic process of analysing multiple files simultaneously to identify similarities and differences or logical contradictions between them. This is a critical function within legal and procurement departments where professionals must ensure that terms across various contracts remain consistent. By automating this comparison AI reduces the risk of human oversight and significantly accelerates the verification process for large document batches.

Document AI

Document AI is a specialised field of artificial intelligence that focuses on the automated processing and comprehension of digital and physical documents. It combines various technologies such as computer vision and natural language processing to transform unstructured text into structured data. This allows businesses to automate high volume workflows like invoice processing or mortgage applications whilst maintaining a high degree of accuracy and operational efficiency.

Document Analysis

Document Analysis involves the deep examination of a file to extract meaningful insights and structured data from its contents. This process goes beyond simple text recognition to understand the underlying structure of a document such as identifying tables and headers and signatures. By breaking down a document into its constituent parts AI can help organisations turn static paperwork into actionable intelligence that can be utilised for reporting or further automation.

Document Classification

Document Classification is the automated process of assigning a category or label to a document based on its content and structure. For example a system might automatically sort incoming files into folders for invoices or CVs or legal notices. This is achieved through machine learning models that recognise the unique patterns and vocabulary associated with different file types which helps organisations manage and organise their digital archives at scale.

Document Comparison

Document Comparison is the practice of evaluating two or more versions of a file to detect changes or additions or deletions in the text. This is an essential tool for version control and quality assurance in professional writing and legal drafting. Automated comparison tools can highlight even the smallest discrepancies between drafts which ensures that no unauthorised changes are made and that the final version of a document meets all required standards.

Document Indexing

Document Indexing is the process of tagging files with specific metadata and keywords to make them easily searchable and retrievable within a database. By creating a structured map of the information contained in a vast library of documents AI allows users to find the exact information they need in seconds. This eliminates the need for manual searching and ensures that critical business data is always accessible for decision making and regulatory compliance.

Document Lifecycle Management

Document Lifecycle Management refers to the end to end oversight of a document from its initial creation and storage to its eventual archiving or destruction. This framework ensures that information is handled securely and efficiently at every stage of its existence. By implementing AI driven lifecycle management, organisations can automate the retention and disposal of records which reduces storage costs and ensures compliance with data privacy laws.

Document Splitting

Document Splitting is an automated technique used to break down large and complex files into smaller and more manageable segments. This is particularly useful when dealing with long PDF files that contain several different reports or invoices bundled together. By intelligently identifying the boundaries between sections AI can separate these components into individual files which makes them easier to process and route to the correct departments.

Document Summarization

Document Summarisation uses natural language processing to condense a long piece of text into a concise and accurate summary that captures the most important points. This technology allows busy professionals to quickly grasp the core message of a report or legal brief without reading the entire document. Advanced models can generate both extractive summaries that use existing sentences and abstractive summaries that rewrite the information in a new format.

Document Understanding

Document Understanding is the comprehensive ability of an AI system to interpret the context and meaning of a document in a way that mimics human comprehension. This involves not only reading the words but also understanding the relationship between them and the intent of the author. This high level capability is what enables sophisticated AI assistants to answer complex questions about a document or provide nuanced advice based on the information it contains.

Document Versioning

Document Versioning is the process of tracking and managing different iterations of a file as it is edited and updated over time. This ensures that every change is recorded and that previous versions can be retrieved if necessary. In collaborative environments versioning prevents data loss and confusion by clearly labelling which version of a document is the most current and authoritative, which is essential for maintaining accuracy in technical and legal projects.

Intelligent Document Processing (IDP)

Intelligent Document Processing is a technology that leverages AI to automate the extraction and validation of data from various document formats. IDP goes beyond traditional scanning by using machine learning to handle semi structured and unstructured data like emails and handwritten forms. This allows organisations to integrate document data directly into their business systems which dramatically reduces the need for manual data entry and improves overall throughput.

Intelligent Document Reader (IDR / IDP)

An Intelligent Document Reader is the specific software component or tool used within an IDP framework to scan and interpret information from files. These readers use advanced optical character recognition and natural language processing to identify relevant fields like dates and amounts and names. By acting as the digital eyes of a business process an IDR can convert messy physical paperwork into clean and structured digital data for automated analysis and storage.

Multi-Document Question Answering

Multi Document Question Answering is a capability where an AI system can synthesise information from across several different sources to answer a single query. Instead of looking at just one file the system scans an entire library of documents to find the relevant pieces of information and combines them into a cohesive response. This is incredibly valuable for research and knowledge management where the answer to a question may be spread across multiple reports.

Natural Language Processing (NLP)

Natural Language Processing is the foundational technology that allows computers to understand and interpret and generate human language. It is the bridge between human communication and computer code. NLP enables a wide range of applications from sentiment analysis and language translation to the sophisticated chatbots we use today. By breaking down language into its grammatical and semantic parts NLP allows machines to interact with humans in a natural and intuitive way.

Universal File Intelligence

Universal File Intelligence refers to the ability of a system to understand and manage all types of files across an entire enterprise regardless of their format or location. This provides a holistic view of an organisation's data landscape by connecting disparate silos of information. With universal intelligence businesses can apply consistent security policies and search across all their data and gain deeper insights into how information is being used across different departments.

Data Extraction, OCR & File Intelligence

Are you overwhelmed when you come across terms like OCR, HTR, Metadata, Key-Value pair extraction ? Don't worry, you're in the right place.

Confidence Threshold

A Confidence Threshold is a pre-defined numerical limit set by developers to determine whether an AI output should be accepted or flagged for manual review. If the model's internal certainty score for a specific piece of data falls below this level the system will automatically trigger a verification workflow. This ensures that only high-quality data enters the corporate database whilst maintaining a balance between total automation and necessary human oversight.

Contextual Data Extraction

Contextual Data Extraction involves the use of machine learning to pull specific information from a document by understanding the surrounding text and layout. Rather than looking for a fixed position on a page the AI identifies the relationship between different words to locate the correct data point. This approach is far more robust than traditional methods as it can accurately find information even when the document format or template varies significantly between different suppliers.

Data Validation

Data Validation is the critical process of checking extracted information against external databases or predefined logical rules to ensure its accuracy and integrity. For example, an AI system might cross-reference an extracted total amount against the individual line items to confirm the mathematics are correct. This step is essential for preventing erroneous data from entering downstream business systems and is a cornerstone of reliable intelligent document processing workflows.

Document Parsing

Document Parsing refers to the method of analysing a file to break it down into its constituent parts for easier data manipulation and storage. The system examines the syntax and structure of the document to distinguish between paragraphs and tables and headers. This allows the software to convert a complex and unstructured document into a structured format like JSON or XML which can then be easily read and processed by other enterprise software applications.

Entity Extraction

Entity Extraction is a natural language processing technique used to automatically identify and categorise key elements within a text such as names of people and organisations and locations or dates. By recognising these specific entities the AI can quickly map out the core facts of a document. This is highly effective for automating the sorting of correspondence or for building a searchable database of key stakeholders mentioned across thousands of archived corporate files.

Extraction Accuracy

Extraction Accuracy is a performance metric that measures the precision with which an AI model identifies and captures data from a document compared to the actual information present. High accuracy is vital for maintaining trust in automated systems especially when dealing with financial figures or legal clauses. It is often measured at both the character and field level to provide a comprehensive view of how well the system is performing in real-world scenarios.

Field-Level Extraction

Field Level Extraction refers to the targeted process of capturing specific data points from a document such as an invoice number or an expiry date or a total amount due. Unlike full-text recognition this method focuses only on the individual fields required for a particular business process. By isolating these specific variables the AI can transform a visual document into a set of clean and structured data points that are ready for immediate use in accounting or CRM software.

File Metadata

File Metadata is the supplementary information that describes the characteristics of a digital document rather than its actual written content. This typically includes the file size and the date of creation and the author and the specific file format used. Effective management of metadata is crucial for large-scale document indexing and digital forensics as it allows administrators to filter and organize vast quantities of information without having to open and read every individual file.

Handwritten Text Recognition (HTR)

Handwritten Text Recognition is an advanced form of technology that allows AI systems to read and digitise cursive or printed handwriting from scanned documents. Unlike traditional OCR which is designed for machine-printed text, HTR must account for the immense variety in human writing styles and slant and pressure. This capability is essential for modernising historical archives or processing handwritten application forms and medical notes that were previously impossible to automate.

Key-Value Pair Extraction

Key Value Pair Extraction is a method used to identify the relationship between a label and its associated data point within a document. For example the word Total might be the key whilst the numerical value of 500 pounds is the associated value. This technique is fundamental for processing semi-structured documents like forms and receipts where the information is presented in a clear label and response format that the AI can easily map to a database.

Line Item Extraction

Line Item Extraction involves the detailed capture of individual rows of data from tables found within documents such as the specific products listed on a purchase order. This is a complex task because it requires the AI to understand both the horizontal and vertical relationships between various cells. Automating line item capture is essential for detailed spend analysis and inventory management as it provides a granular level of data that simple document-level extraction cannot.

Metadata Extraction

Metadata Extraction is the automated process of pulling descriptive information about a document directly from its contents or its digital properties. This might involve identifying the document type and the language used or the primary topics discussed within the text. By automatically generating this descriptive data organisations can significantly improve their document searchability and ensure that every file is correctly tagged for long-term retention and compliance.

Multi-Format Document Processing

Multi Format Document Processing refers to the capability of an AI system to ingest and understand a wide variety of file types including PDFs and JPEGs and Word documents or even scanned images. A robust processing engine must be able to normalise these different formats into a single unified stream of data. This allows a business to use one central platform to handle all incoming communications regardless of how the customer or supplier chose to send the information.

Optical Character Recognition (OCR)

Optical Character Recognition is the foundational technology used to convert different types of documents such as scanned paper files or photos of text into editable and searchable data. By recognising the shapes of characters and translating them into digital code OCR acts as the first step in almost all document automation workflows. Modern OCR systems often use deep learning to handle distorted text or low-resolution images with a high degree of precision.

Semi-Structured Data

Semi Structured Data refers to information that does not reside in a fixed database but still contains some level of organisational patterns or tags. Common examples include emails and invoices or forms, where the layout might vary but the same core data points are usually present. Processing this type of data requires more flexible AI models than those used for structured data, as the system must be able to adapt to different visual templates and naming conventions.

Structured Data

Structured Data is information that is highly organised and easily searchable within a fixed format such as a spreadsheet or a SQL database. This data is typically formatted in a way that makes it immediately readable by computers without the need for complex interpretation. In the context of document processing the ultimate goal is often to transform unstructured text into structured data so that it can be used for automated reporting and analytical processing.

Table Extraction

Table Extraction is the sophisticated process of identifying and capturing the data contained within tabular structures across one or multiple pages. This requires the AI to recognize the borders and columns and rows whilst correctly associating headers with their respective values. Successful table extraction is vital for processing financial statements and laboratory reports where the most important information is often trapped within complex and varying grid formats.

Unstructured Data

Unstructured Data refers to information that has no pre-defined model or organisational framework such as a long-form legal contract or an open-ended survey response. This represents the majority of data within a typical organisation and is historically the most difficult to process automatically. Advanced natural language processing is required to extract meaning from this text and turn it into a format that can be used for business intelligence and strategic decision making.

Zonal OCR

Zonal OCR is a specific type of text recognition where the software is programmed to look only at particular geographic zones or coordinates on a page. This is highly effective for processing large volumes of documents that follow a rigid and identical template such as a standard government form. Whilst it is faster and requires less processing power than full-page AI it is less flexible because it cannot adapt if the information on the page shifts or if the template changes.

Automation, Workflow & Runtime Processing

Explore

Batch Processing

Batch processing is an efficiency-focused method where large volumes of documents or data tasks are collected and processed simultaneously in a single group rather than individually. This approach is typically used for non-urgent tasks such as end-of-day financial reconciliations or monthly payroll runs. By aggregating these tasks, organisations can optimise their computational resources and ensure high-throughput performance during off-peak hours without requiring constant manual intervention.

Data Mapping

Data Mapping is the structural process of establishing relationships between two distinct data models to ensure that information moves accurately from a source to a target destination. In document automation this involves defining how an extracted field like an invoice number corresponds to a specific database column in an ERP system. Precise mapping is essential for maintaining data integrity and ensuring that automated workflows correctly categorise and store information for future retrieval.

Data Validation

Data Validation refers to the automated checks and logical rules applied to extracted information to ensure it is accurate and formatted correctly before it enters a system of record. This might involve verifying that a date is valid or that a total amount matches the sum of individual line items. Effective validation reduces the risk of corrupt data or "garbage in garbage out" scenarios which is vital for maintaining the reliability of automated business intelligence.

Dataset

A Dataset is a structured collection of related data points used to train and evaluate machine learning models for document processing tasks. These collections contain both the raw input files and the corresponding "ground truth" labels that tell the model what it should be looking for. High-quality datasets are the foundation of successful AI because the breadth and variety of the information they contain directly influence how well the resulting model performs in real-world scenarios.

Dataset Versioning

Dataset Versioning is the practice of tracking and managing different iterations of a dataset as new information is added or labels are refined over time. This allows developers to revert to previous versions if a new training run produces unexpected results or to audit the exact data used to train a specific model version. Maintaining a clear version history is crucial for reproducibility in AI research and for meeting strict regulatory requirements regarding algorithmic transparency.

Document Automation

Document Automation is the comprehensive use of software and artificial intelligence to manage the entire lifecycle of a document from intake and data extraction to final storage. By removing the need for manual data entry and physical filing organisations can significantly reduce operational costs and eliminate human error. This technology enables businesses to scale their administrative capacity without increasing headcount whilst improving the speed and accuracy of their core processes.

Downstream Record Creation

Downstream Record Creation is the final step in an automated workflow where the verified data extracted from a document is used to automatically generate a new entry in a secondary system like a CRM or accounting platform. Instead of a staff member typing in details the AI populates the necessary fields directly. This ensures that the primary data source and the enterprise system remain perfectly synchronised which accelerates business cycles and improves overall data visibility.

Event-Driven Automation

Event Driven Automation is a reactive programming model where specific actions are triggered by a particular change in state or the arrival of new information. For example the moment a new email attachment is detected the system automatically initiates a document extraction workflow. This approach allows for near real-time processing and ensures that business systems respond instantly to external inputs rather than waiting for a scheduled batch window to occur.

Exception Handling

Exception Handling is the strategic process of managing errors or edge cases that fall outside the normal automated path of a workflow. In document AI this often involves identifying documents that are unreadable or fields that fail validation checks. By building robust handling mechanisms developers can ensure that the system gracefully manages failures by logging the error or rerouting the task to a human specialist rather than allowing the entire automated process to stall.

Human Review Queues

Hyperautomation is a strategic business approach that involves the disciplined use of multiple technologies like AI and machine learning and robotic process automation to automate as many business processes as possible. It goes beyond simple task automation to look at entire end-to-end workflows. The goal of hyperautomation is to create a fully integrated digital ecosystem where systems can identify and automate tasks autonomously, which leads to unprecedented levels of operational efficiency.

Hyperautomation

Hyperautomation is a strategic business approach that involves the disciplined use of multiple technologies like AI and machine learning and robotic process automation to automate as many business processes as possible. It goes beyond simple task automation to look at entire end-to-end workflows. The goal of hyperautomation is to create a fully integrated digital ecosystem where systems can identify and automate tasks autonomously, which leads to unprecedented levels of operational efficiency.

Post-Processing Actions

Post Processing Actions are the final technical steps taken after data has been extracted from a document to prepare it for final use. This might include formatting text to a specific standard or translating values or running custom scripts to enrich the data with information from other systems. These actions ensure that the raw output from an AI model is refined into a "production-ready" format that meets the exact requirements of the target enterprise application.

Runtime Variables

Runtime Variables are dynamic values that are captured or calculated while an automated process is actively running rather than being pre-defined. These might include the current timestamp or the specific filename being processed, or a unique transaction ID generated during the workflow. Using these variables allows an automation script to be flexible and context-aware as it can make decisions based on the specific circumstances of the individual task it is currently performing.

Straight-Through Processing (STP)

Straight Through Processing is the "gold standard" of automation where a document or transaction is handled from start to finish without any human intervention whatsoever. For STP to be successful the AI must achieve 100 per cent accuracy and pass all validation checks automatically. Achieving high STP rates is a primary goal for modern enterprises as it represents the maximum possible efficiency and allows staff to focus entirely on high-value strategic work.

Workflow Automation

Workflow Automation refers to the design and execution of a sequence of automated tasks that follow a pre-defined set of business rules. Unlike simple task automation which handles a single step workflow, automation manages the entire path of a project from initiation to completion. This ensures that every task is performed in the correct order and that information is passed seamlessly between different stakeholders and systems without the need for manual tracking.

Orchestration

Orchestration is the high-level management and coordination of multiple automated systems and services to work together as a cohesive whole. While automation refers to a single task orchestration looks at the "big picture" of how various bots and AI models and databases interact across an entire enterprise. It involves managing the dependencies and timing between these different elements to ensure that complex multi-step processes are executed reliably and at scale.

Trigger

A Trigger is the specific event or condition that signals an automated workflow to begin its execution. In a document-heavy environment, a trigger could be the arrival of a new file in a cloud storage folder or an API call from an external application or a specific time of day. Triggers are the "on-switch" for automation, and they allow businesses to build self-sustaining systems that react instantly to changes in the environment without needing a human to start the process.

Retry Logic

Retry Logic is a built-in safety mechanism that automatically attempts to re-execute a failed task a certain number of times before giving up or raising an error. This is particularly useful for handling temporary issues, such as a brief network outage or a busy server. By implementing intelligent retry intervals or "exponential back off" developers can improve the resilience of their automated systems and prevent minor technical hiccups from causing a total failure of the workflow.

Salesforce Document AI, OCR & GenAI

Understand Salesforce terms and concepts. Explore terms like Agentforce, Einstein OCR, Einstein Studio, Vector Search and many more.

Agentforce

Agentforce is the next generation of autonomous AI agents within the Salesforce ecosystem designed to support employees and customers by executing tasks independently. Unlike traditional chatbots these agents can reason through complex problems and make decisions based on real-time data from across the Customer 360 platform. This represents a shift from reactive AI to proactive digital workers that can handle entire business processes without requiring constant human guidance.

Agentforce Actions

Agentforce Actions are the specific capabilities or tasks that an autonomous agent is authorised to perform such as updating a record or sending an email or querying an external database. These actions serve as the "hands" of the agent allowing it to interact directly with the Salesforce metadata and various business logic flows. By defining these actions precisely administrators can control exactly what an agent is allowed to do within the platform to ensure safety and compliance.

Agentforce Skills

Agentforce Skills represent a collection of related actions and knowledge sets that define the core competency of a specific AI agent. For example a Service Agent Skill might include the ability to look up cases and summarise knowledge articles and initiate a refund process. By grouping these abilities into skills developers can build highly specialised agents that excel in specific business domains like sales or customer support or financial services.

Agentforce Retrieval (RAG)

Agentforce Retrieval is the implementation of Retrieval-Augmented Generation within the Salesforce platform which allows agents to pull relevant facts from across the Data Cloud to inform their responses. By retrieving the most up-to-date and specific data before generating a reply the agent ensures its output is grounded in reality rather than just relying on pre-trained knowledge. This significantly reduces hallucinations and ensures the agent provides contextually accurate information.

Agentforce Orchestration

Agentforce Orchestration is the management layer that governs how multiple AI agents and automated workflows interact to complete a complex business objective. It ensures that tasks are passed between agents in the correct sequence and that human intervention is requested when necessary. This high-level coordination allows organisations to build sophisticated digital workforces where various specialised agents collaborate seamlessly to resolve customer issues or manage lead lifecycles.

Salesforce Document AI (Data Cloud)

Salesforce Document AI within Data Cloud is a comprehensive suite of tools designed to extract and process data from unstructured documents directly into the Salesforce ecosystem. By leveraging the power of Data Cloud these tools can transform PDFs and images into actionable insights that can be used for segmentation and personalisation. This integration ensures that document data is not siloed but is instead part of the unified customer profile accessible across the entire platform.

Einstein OCR

Einstein OCR is the optical character recognition service built into the Salesforce platform that allows developers to extract text from images and documents with high precision. It uses deep learning models to recognise alphanumeric characters in various fonts and layouts, which is essential for digitising business documents like receipts or IDs. This foundational technology enables further automated processes such as lead generation from business cards or automated invoice verification.

Einstein Document Models

Einstein Document Models are pre-trained machine learning architectures specifically designed to recognise and extract data from common business documents. These "out-of-the-box" models are optimised for specific use cases and require no additional training from the user to begin providing value. They are ideal for organisations looking to quickly implement document automation for standard files without the complexity of building custom AI models from the ground up.

Einstein Custom Document Models

Einstein Custom Document Models allow organisations to train the Salesforce AI engine on their own unique document types that may not follow a standard industry format. By providing a small set of labelled examples users can teach Einstein how to identify and extract specific fields that are unique to their business. This flexibility is vital for companies dealing with proprietary forms or highly specialised legal documents that require a bespoke extraction logic.

Intelligent Document Reader (IDR)

The Intelligent Document Reader is a Salesforce feature that automates the extraction of data from documents to reduce manual data entry and improve processing speed. It is often used in health and public sector clouds to handle forms and applications by mapping extracted data points directly to Salesforce objects. This tool allows administrative staff to focus on verification and decision-making rather than the tedious task of transcribing information from paper to digital systems.

Business Card Reader

The Business Card Reader is a specialised Einstein tool that uses mobile camera technology and OCR to extract contact information from business cards and instantly create Lead or Contact records. It identifies key fields such as name and phone number and email address and company title with high accuracy. This mobile-first feature is designed for sales professionals in the field allowing them to capture prospects and initiate follow-up sequences without delay.

Invoice OCR

Invoice OCR is a purpose-built extraction model within Salesforce designed specifically to handle the complexities of financial billing documents. It is capable of identifying and extracting critical fields such as invoice numbers and tax amounts and line items and vendor details. By automating the intake of invoices businesses can streamline their accounts payable processes and ensure that payments are made accurately and on time while reducing the potential for human error.

Einstein Studio

Einstein Studio is the central hub within Salesforce for managing the lifecycle of AI models including those created within Salesforce and those brought in from external providers. It provides a user-friendly interface for data scientists and administrators to experiment with and deploy and monitor machine learning models. This unified environment makes it easier for organisations to scale their AI initiatives by providing a clear overview of all available models and their current performance.

Einstein Studio Model Deployment

Einstein Studio Model Deployment is the process of taking a trained machine learning model and making it active and accessible for use within Salesforce applications. This step involves configuring the model to interact with live data flows and ensuring it meets the necessary performance benchmarks. Once a model is deployed it can be called by flows or agents or custom code to provide real-time predictions and insights across the Salesforce platform.

Einstein Studio External Models

Einstein Studio External Models refers to the "Bring Your Own Model" capability that allows businesses to integrate AI models hosted on external platforms like Amazon SageMaker or Google Vertex AI. This allows organisations to leverage their existing data science investments directly within the Salesforce interface. By connecting these external models to Salesforce data companies can use their bespoke algorithms to power predictions and automation without moving their data.

Model Versioning (Einstein)

Model Versioning within Einstein is the systematic tracking of different iterations of a machine learning model to ensure transparency and reliability. As models are retrained with new data or updated parameters developers can save them as distinct versions to compare their performance. This is essential for maintaining a stable production environment as it allows administrators to roll back to a previous version if a new update performs poorly or introduces unintended biases.

Model Monitoring (Einstein)

Model Monitoring in Einstein involves the continuous observation of an active AI model's performance to detect issues such as accuracy decay or data drift. Salesforce provides dashboards that track how well the model is predicting outcomes in the real world compared to its training benchmarks. This ongoing oversight is critical for ensuring that AI-driven decisions remain accurate and trustworthy over time allowing teams to intervene and retrain models as needed.

Prompt Builder

Prompt Builder is a declarative tool in Salesforce that allows administrators to create and manage the instructions given to Large Language Models. It enables users to build sophisticated prompts that incorporate dynamic data from Salesforce records to ensure the AI output is contextually relevant. By providing a safe and structured way to engineer prompts it allows businesses to implement generative AI features like email drafting or record summarisation without writing code.

Prompt Builder with File Inputs

Prompt Builder with File Inputs is an advanced feature that allows users to include the content of uploaded documents directly into a generative AI prompt. This capability enables the model to reason across specific files such as a customer's contract or a technical manual to provide highly specific answers. This significantly expands the utility of generative AI by allowing it to "read" and act upon the unstructured information contained within business documents.

System Prompts (Salesforce)

System Prompts in the Salesforce ecosystem are the foundational instructions that define the persona and rules and constraints for an AI agent or model. These prompts are managed by administrators and are not visible to the end-user ensuring that the AI remains professional and stays within its intended functional boundaries. They act as the "constitution" for the AI's behaviour across every interaction ensuring consistency and safety across the organisation.

Prompt Templates

Prompt Templates are reusable frameworks within the Salesforce platform that standardise how prompts are constructed for specific business tasks. These templates include placeholders for dynamic data allowing the same prompt logic to be applied across different records and users. By using templates organisations can ensure that their generative AI outputs maintain a consistent tone and structure while significantly reducing the time required to deploy new AI features.

Grounded Generation (Salesforce)

Grounded Generation is the process of ensuring that a generative AI's output is based strictly on verified data from the Salesforce environment rather than general knowledge alone. By "grounding" the prompt with specific record details or document text the system provides responses that are factually accurate and relevant to the specific customer. This is a key safety feature that minimises the risk of hallucinations and ensures the AI provides actionable business value.

Vector Search in Salesforce

Vector Search in Salesforce is a retrieval method that uses mathematical embeddings to find information based on its semantic meaning rather than just keyword matches. This allows the system to understand the intent behind a user's query and retrieve the most relevant documents or records even if the exact words do not match. It is a foundational technology for powering modern AI search and Retrieval-Augmented Generation within the Data Cloud.

AI Search with Document Indexing

AI Search with Document Indexing is a feature that scans and maps the contents of unstructured files to make them fully searchable within the Salesforce platform. By indexing every word and concept within a document the system can provide intelligent search results that point users directly to the specific information they need. This eliminates the need for manual file sorting and ensures that knowledge trapped in PDFs and documents is easily accessible to all users.

Search Index (Data Cloud)

The Search Index in Data Cloud is a high-performance database structure that organises both structured and unstructured data to facilitate rapid and accurate retrieval. It acts as the "brain" for Salesforce's search capabilities, allowing for complex queries across trillions of data points in real-time. Maintaining an up-to-date search index is vital for ensuring that AI agents and users always have access to the most current information available in the ecosystem.

Chunking (Salesforce)

Chunking is the process of breaking down long documents into smaller and more manageable pieces of text before they are converted into vector embeddings. This is necessary because Large Language Models have limits on how much information they can process at once. By intelligently splitting a document into logical sections, Salesforce ensures that the most relevant "chunks" can be retrieved and used to ground AI responses without exceeding technical constraints.

Re-Ranking (Salesforce Search)

Re-Ranking is a multi-stage search process where the most relevant results from an initial search are further refined and re-ordered using advanced machine learning models. The system evaluates the initial "hits" for their contextual relevance to the user's specific query and moves the most useful information to the top. This ensures that when an AI agent or a user performs a search they are presented with the highest-quality information first, saving time and improving accuracy.

Unstructured Data Processing (Data Cloud)

Unstructured Data Processing in Data Cloud refers to the ingestion and transformation of data that does not fit into traditional tables such as call transcripts and emails and PDFs. Salesforce uses AI to parse this information and extract key insights which are then mapped to unified customer profiles. This allows organisations to gain a 360-degree view of their customers by including every interaction regardless of whether it was a formal record or a casual email.

Data Cloud Semantic Index

The Data Cloud Semantic Index is a specialised indexing layer that stores data as vector embeddings to enable meaning-based retrieval. Unlike a traditional index that looks for words it looks for concepts allowing for much more "human-like" search capabilities. This is the core technology that enables Agentforce and other AI features to find relevant information across the vast amount of data stored in Data Cloud making it the foundation for modern AI applications.

Data Cloud Real-Time Ingestion

Data Cloud Real-Time Ingestion is the ability of the platform to capture and process data the moment it is generated from any source, such as a website click or a sensor reading. This ensures that the data used by AI models and agents is always current up to the second. In a document context, this means that as soon as a file is uploaded it can be indexed and made available for search and extraction, allowing for truly responsive and automated business workflows.

Data Cloud Activation

Data Cloud Activation is the process of taking the unified insights and segments generated within Data Cloud and "activating" them across other Salesforce apps or external platforms. For example an AI-generated insight about a customer's document preferences can be sent to Marketing Cloud to trigger a personalised campaign. This turns static data into proactive action ensuring that the value of AI-processed information is felt across the entire customer journey.

Einstein for Flow

Einstein for Flow is a generative AI feature that allows administrators to create complex business process automations using natural language descriptions. Instead of manually dragging and dropping elements a user can simply describe the desired outcome and Einstein will suggest a pre-built flow structure. This significantly lowers the barrier to entry for building advanced automations and accelerates the digitisation of manual document and data workflows.

Flow AI Actions

Flow AI Actions are dedicated building blocks within the Salesforce Flow Builder that allow for the direct integration of AI capabilities like text summarisation or sentiment analysis. These actions can be inserted into any automated business process to add a layer of intelligence without requiring custom code. For instance a flow can be designed to automatically detect the sentiment of an incoming customer document and route it to the appropriate team based on the AI's finding.

Flow Orchestration

Flow Orchestration is a tool that allows for the coordination of complex and multi-step business processes that involve multiple people and different systems. It manages the "handoff" between automated steps and manual tasks ensuring that everyone knows when it is their turn to act. In a document processing scenario orchestration can manage the path from initial document intake and AI extraction to final human approval and record updates in a seamless sequence.

Post-Extraction Actions

Post-Extraction Actions are the automated steps taken immediately after data has been pulled from a document to ensure it is useful for the business. This might include clean-up tasks like formatting dates or more complex logic like looking up a corresponding record in Salesforce to link the new data. These actions ensure that the raw output of an OCR or document model is refined into a high-quality data point that is ready for immediate use in business reports.

Einstein Trust Layer

The Einstein Trust Layer is a secure architecture within Salesforce designed to protect sensitive data while using generative AI. It includes features like data masking and zero-retention policies to ensure that customer information is never used to train external models. This allows businesses to use the power of Large Language Models with the confidence that their data remains private and compliant with global security standards and corporate ethics.

Prompt Audit Logs

Prompt Audit Logs are a security and compliance feature that records every interaction between a user and a generative AI model including the original prompt and the model's response. These logs allow administrators to monitor how AI is being used across the organisation and to ensure that users are following safety guidelines. This transparency is essential for troubleshooting and for providing a clear audit trail in regulated industries that require strict oversight of automated systems.

Data Masking (AI)

Data Masking for AI is a critical security process within the Einstein Trust Layer that automatically hides or replaces sensitive information like names or credit card numbers before it is sent to an AI model. This ensures that the model can still understand the context of the request without ever seeing the actual private data. Once the AI generates a response, the masked data is safely re-inserted ensuring the final output is useful, but the process remains entirely secure.

Model Access Controls

Model Access Controls are the security settings that determine which users or systems are allowed to view and use specific AI models within an organisation. By applying these permissions administrators can ensure that sensitive or specialised models are only accessible to authorised personnel. This prevents the misuse of AI and ensures that different departments only interact with the models that are relevant to their specific roles and data access levels.

Compliance, Security & Enterprise Readiness

Audit Trails

Audit Trails are chronological records that provide documentary evidence of the sequence of activities that have affected at any time a specific operation or event. In the context of AI and document processing these trails track every interaction from the moment a file is uploaded to the final data export. This transparency is vital for troubleshooting and for providing a clear historical record during regulatory inspections or internal security reviews to ensure accountability.

Compliance

Compliance refers to the state of meeting specific regional and international standards and laws regarding data handling and business conduct. For organisations using intelligent document processing this involves adhering to strict rules about how information is stored and processed and shared. Maintaining compliance ensures that a company avoids significant legal penalties and maintains its professional reputation by following the highest standards of data governance and ethical operations.

Data Processing Agreement (DPA)

A Data Processing Agreement is a legally binding contract between a data controller and a data processor that outlines the rights and obligations of each party regarding the handling of personal data. Under frameworks like the GDPR, a DPA is mandatory to ensure that any third party service provider manages information according to the same strict security standards as the original organisation. This document provides the legal foundation for secure business partnerships in the digital age.

Data Residency

Data Residency refers to the physical or geographic location where an organisation's data is stored and processed. Many nations have strict laws requiring that the personal information of their citizens remains within the country's borders to ensure local legal protections apply. For global businesses choosing an AI provider with flexible data residency options is essential for operating legally across different jurisdictions whilst maintaining high speed access to their information.

Encryption at Rest

Encryption at Rest is a security measure that protects data stored on physical or virtual disks by converting it into unreadable code that can only be decrypted with a specific key. This ensures that even if a storage device is stolen or a server is compromised the information contained within the files remains entirely secure. This is a foundational requirement for modern data security and is a core component of maintaining trust in cloud based document processing systems.

Encryption in Transit

Encryption in Transit protects information as it moves across a network, such as when a document is uploaded from a local computer to a cloud server. By using secure protocols like TLS, the data is shielded from interception or tampering by unauthorised parties during its journey. This ensures that sensitive business communications and private customer files remain confidential and intact as they travel across the internet between different applications and users.

FINRA

The Financial Industry Regulatory Authority is a private American corporation that acts as a self regulatory organisation for brokerage firms and exchange markets. Whilst it is a US based body its standards for data integrity and record keeping often influence global financial practices. Compliance with FINRA standards involves maintaining rigorous audit trails and secure document storage to ensure that financial markets operate fairly and that investor information is always protected from fraud.

GDPR

The General Data Protection Regulation is a comprehensive European Union law that sets the global benchmark for data privacy and protection. It gives individuals significant control over their personal information and imposes strict obligations on any organisation that processes the data of EU citizens. Compliance involves ensuring transparency and data minimisation and the right to be forgotten making it a critical consideration for any AI system that handles customer documents or personal files.

HIPAA

The Health Insurance Portability and Accountability Act is a standard for protecting sensitive patient data within the healthcare industry. Any organisation that deals with protected health information must ensure that all physical and electronic processes meet specific security and privacy requirements. In document AI this means implementing strict access controls and encryption to ensure that medical records and patient identities are never exposed to unauthorised individuals or systems.

Know Your Customer (KYC)

Know Your Customer is a mandatory process for financial institutions and other regulated businesses to verify the identity of their clients. This typically involves processing various identity documents such as passports and utility bills to prevent money laundering and fraud. Automated document AI significantly accelerates the KYC process by instantly extracting and validating information from these documents allowing for faster customer onboarding whilst maintaining strict regulatory compliance.

Personally Identifiable Information (PII)

Personally Identifiable Information refers to any data that can be used on its own or with other information to identify and contact or locate a specific person. This includes names and addresses and social security numbers and even biometric data. Protecting PII is the primary goal of most data privacy laws and it requires organisations to implement robust security measures such as masking and encryption to ensure that this sensitive information is never leaked or misused.

Role-Based Access Control (RBAC)

Role Based Access Control is a security strategy where system access is granted to users based on their specific role within an organisation rather than their individual identity. For example a junior clerk might only be able to view documents whilst a senior manager has the authority to approve or delete them. This simplifies the management of permissions and ensures that employees only have access to the information and tools necessary for their specific job functions.

SEC

The Securities and Exchange Commission is a large independent agency of the United States federal government responsible for protecting investors and maintaining fair and orderly functioning of the securities markets. For companies in the financial sector SEC regulations dictate how long documents must be retained and how they must be stored to prevent tampering. Maintaining SEC compliant records is a key requirement for any document management system used by publicly traded companies or financial firms.

Sensitive Data Detection

Sensitive Data Detection is an automated AI process that scans documents to identify and flag high risk information such as credit card numbers or medical codes. By automatically categorising these data points as they are ingested the system can apply additional layers of security or masking to protect them. This proactive approach helps organisations manage vast amounts of unstructured data without manually reviewing every page to identify potential privacy risks.

Single Sign-On (SSO)

Single Sign On is an authentication scheme that allows a user to log in with a single set of credentials to any of several related yet independent software systems. This improves security by reducing the number of passwords a user must remember and allows IT departments to manage access from a central location. In an enterprise environment SSO is essential for ensuring that only authorised staff can access sensitive document processing tools and their associated data.

SOC 2

SOC 2 is a voluntary compliance standard for service organisations which specifies how organisations should manage customer data based on five trust service principles which include security and availability and processing integrity and confidentiality and privacy. Achieving a SOC 2 report demonstrates that a cloud provider has undergone a rigorous independent audit of their internal controls. It is a vital mark of quality for any AI company that manages sensitive enterprise information.

Data Retention

Data Retention refers to the policies and processes that an organisation follows to determine how long information should be kept before it is deleted or archived. These policies are often driven by a combination of business needs and legal requirements. In document AI automated retention schedules ensure that files are disposed of at the correct time which reduces storage costs and helps the organisation comply with data minimisation principles under privacy laws.

Access Logs

Access Logs are detailed records that track who accessed a particular system or file and what actions they performed and at what time the event occurred. These logs are a critical component of a robust security strategy as they allow administrators to detect suspicious activity and conduct forensic investigations if a security breach is suspected. Monitoring access logs ensures that an organisation has full visibility into how its sensitive documents are being handled.

Least Privilege

The Principle of Least Privilege is a security concept which maintains that a user should be given only those privileges which are essential to perform their intended function. For example, an AI model should only have access to the specific database it needs to complete its task and nothing more. Implementing the least privilege significantly reduces the potential damage from an accident or a malicious attack by limiting the scope of access across the entire digital infrastructure.

Data Masking / Redaction

Data Masking and Redaction involve the process of obscuring or removing sensitive information from a document or dataset so that it can be used for training or testing without revealing private details. Whilst masking might replace a name with a placeholder like USER1, redaction typically involves permanently blacking out the text. These techniques are essential for sharing information with third parties or for using real world data to improve AI models whilst remaining compliant with privacy regulations.