First SOC 2 program
A credible starting point
Document allowed and prohibited inputs for each workflow, block secrets, and pass only the minimum customer context needed for the task.
AI / LLM Governance
Customer data, telemetry, secrets, credentials, regulated data, and confidential policy context are controlled, minimized, and restricted by approved workflow purpose.
Use this guide to put the control into operation, decide what records to retain, and check that an auditor can trace the evidence back to the work your team performed.
Maintained by GreenHat Security · Reviewed August 21, 2026
AI workflows accept and expose only the customer, confidential, credential, and telemetry data allowed for their approved purpose and tenant context.
First SOC 2 program
Document allowed and prohibited inputs for each workflow, block secrets, and pass only the minimum customer context needed for the task.
As the company scales
Enforce tenant-scoped retrieval, centralized input and output filters, provider-routing rules, data-loss monitoring, and automated tests for cross-customer exposure.
Identify each input, retrieved context, prompt field, output, log destination, provider, retention path, and tenant boundary.
You should end up with: Workflow-specific data-flow map
Define allowed and prohibited data categories, approved purposes, masking needs, provider restrictions, and retention behavior.
You should end up with: Enforceable input and context rules
Bind retrieval and tool calls to verified tenant and user authorization instead of relying on prompt instructions.
You should end up with: Authorization-enforced context configuration
Run cases for secret submission, prompt injection, cross-tenant retrieval, excessive context, and sensitive output leakage.
You should end up with: Boundary test results with remediation
Build the evidence set in three layers: what defines the control, who approved or reviewed it, and what proves it operated. Collect operating records when the work happens so they remain dated, attributable, correctly scoped, and traceable to the underlying activity.
Before sharing, remove unrelated personal or customer data, never expose passwords, tokens, or secret values, preserve enough source context to authenticate the record, and use the secure exchange approved for the engagement.
Documents that define the control, its scope, ownership, and expected way of working.
Confirm what the record proves
Each workflow has approved input, context, output, logging, provider, and retention rules tied to its purpose and data classifications.
Include this context
Workflow ID
Include this context
Data category
Include this context
Allowed purpose
Include this context
Provider or destination
Include this context
Protection rule
Include this context
Owner and approval date
Weak evidence to avoid
A company-wide data statement that does not identify the workflow, provider, context path, or enforceable restriction.
Confirm what the record proves
Operators and technical filters distinguish data the workflow may process from secrets, credentials, or restricted categories it must reject.
Include this context
Workflow ID
Include this context
Allowed categories
Include this context
Prohibited categories
Include this context
Examples or detection rule
Include this context
Enforcement point
Include this context
Effective version
Weak evidence to avoid
A prose list of prohibited data with no workflow scope, examples, filter, version, or enforcement location.
Dated proof that the control actually ran, such as tickets, logs, settings, exports, reports, and test results.
Confirm what the record proves
Runtime retrieval and tool access derive customer scope from trusted authorization and prevent cross-tenant context access.
Include this context
Workflow and test ID
Include this context
Authenticated tenant
Include this context
Requested tenant
Include this context
Authorization decision
Include this context
Retrieved object scope
Include this context
Result and timestamp
Weak evidence to avoid
A successful same-tenant screenshot without negative cross-tenant attempts or the authorization decision.
Confirm what the record proves
The deployed workflow applies the approved data filters, tenant binding, provider routing, logging, and retention settings.
Include this context
Workflow ID and version
Include this context
Environment
Include this context
Filter settings
Include this context
Tenant binding
Include this context
Provider route
Include this context
Deployment timestamp
Weak evidence to avoid
A configuration snippet without the workflow version, environment, deployed state, or link to approved handling rules.
Type 1
Retain current data-handling rules and deployed workflow configuration plus a recent negative tenant or prohibited-data test as of the selected date.
Type 2
Account for every production execution of scoped AI workflows during the period, including blocked, failed, and cross-tenant-denied requests, plus every handling-rule change, boundary test, and approved data exception.
Reconcile workflow execution counts across the gateway, application, authorization, and retrieval layers; account for missing traces, blocked submissions, data-loss alerts, boundary tests, and approved exceptions.
Use this checklist to prepare for procedures an auditor may perform. The exact steps and sample selection depend on your engagement scope and the service auditor's professional judgment.
Determine whether the control is designed to achieve this result: AI workflows accept and expose only the customer, confidential, credential, and telemetry data allowed for their approved purpose and tenant context.
Compare the documented owner with the intended role (AI Workflow Owner / CISO / Engineering), then compare dated records with the stated cadence: Per workflow/change; review at least annually.
Reconcile workflow execution counts across the gateway, application, authorization, and retrieval layers; account for missing traces, blocked submissions, data-loss alerts, boundary tests, and approved exceptions.
Retain current data-handling rules and deployed workflow configuration plus a recent negative tenant or prohibited-data test as of the selected date.
Account for every production execution of scoped AI workflows during the period, including blocked, failed, and cross-tenant-denied requests, plus every handling-rule change, boundary test, and approved data exception.
Documents that define the control, its scope, ownership, and expected way of working.
For each selected record, confirm it demonstrates Each workflow has approved input, context, output, logging, provider, and retention rules tied to its purpose and data classifications.
For each selected record, confirm it demonstrates Operators and technical filters distinguish data the workflow may process from secrets, credentials, or restricted categories it must reject.
Dated proof that the control actually ran, such as tickets, logs, settings, exports, reports, and test results.
For each selected record, confirm it demonstrates Runtime retrieval and tool access derive customer scope from trusted authorization and prevent cross-tenant context access.
For each selected record, confirm it demonstrates The deployed workflow applies the approved data filters, tenant binding, provider routing, logging, and retention settings.
Use the categories that apply to this control: connect any policy or design artifact to its approval or review record, then trace a selected operating record through execution, result, and any exception or remediation.
These identifiers help you navigate related Trust Services Criteria. They do not reproduce the criteria or prove that this control fully addresses them in your environment.
Confirm final scope, mappings, and testing expectations with your service auditor. SOC 2® is an AICPA trademark; GreenHat Security is not affiliated with or endorsed by AICPA.