Active

Adversarial Attack Protection

The organization shall implement protection measures against adversarial attacks on AI systems, including techniques to detect and mitigate attempts to manipulate model inputs or outputs. Protection shall include detection of adversarial inputs, implementation of defensive measures, and monitoring of attack attempts.

Requirement ID
AIG-005-R002
Parent Control
Domain Code

Requirement Details & Guidance

AIG-005-R002 · AIG-005
Why This Requirement Exists

This requirement exists to detect and mitigate adversarial attempts to manipulate AI model inputs or outputs, ensuring AI systems are governed, secured, assessed, and operated in a controlled and accountable manner.

Implementation Guidance

Establish and document the process to detect and mitigate adversarial attempts to manipulate AI model inputs or outputs. Define accountable roles, scope, required inputs and outputs, assessment or approval criteria, decision thresholds, review frequency, monitoring, reporting, exception handling, evidence requirements, and escalation paths. Apply the process across the AI lifecycle and integrate it with information security, privacy, risk, compliance, change management, incident management, and business governance as applicable.

Practical Application & Audit Readiness

AIG-005-R002 · Field Guidance

Business Examples

    Common Audit Findings

      Common Mistakes

        Best Practices & Ownership

        AIG-005 · Recommended Approach

        Recommended Practices

          Typical Owner

          Cross-Mapped Regulatory Frameworks

          Harmonized Control Mappings
          FRAMEWORK CODE FRAMEWORK NAME & DETAILS FAMILY / CATEGORY VERSION ACTION
          SEBI-CSCRF SEBI Cyber Security & Cyber Resilience Framework SEBI’s Cybersecurity and Cyber Resilience Framewor... Clause: 4.1 DE.CM: Security Continuous Monitoring
          India
          Regulation
          vLatest View →
          HIPAA Health Insurance Portability and Accountability Act HIPAA is a U.S. federal law supported by implement... Clause: § 164.312(a) Standard: Access control; § 164.308(a)(2) Standard: Risk analysis
          US
          Law
          vCurrent View →
          ISO27002 ISO/IEC 27002 ISO/IEC 27002 is a guidance standard containing a... Clause: 8.16 – Monitoring activities
          ISO
          Standard
          v2022 View →
          PCI-DSS PCI DSS PCI DSS is an industry security standard maintaine... Clause: 6.2.4 – Software engineering techniques or other
          PCI
          Standard
          v4 View →
          COBIT2019 COBIT COBIT is an enterprise governance and management f... Clause: 4.2 – Align, Plan and Organize (APO) > APO13 – Managed Security > APO13.02 – Define and manage an information security and privacy risk treatment plan.
          COBIT
          Governance Framework
          v2019 View →
          NIST-CSF NIST Cybersecurity Framework (CSF) The NIST Cybersecurity Framework provides high-lev... Clause: GV.RM – Risk Management Strategy | GV.RM-03 – Cybersecurity risk management activities and outcomes are included in enterprise risk management processes ID.RA – Risk Assessment | ID.RA-07 – Changes and exceptions are managed, assessed for risk impact, recorded, and tracked PR.PS – Platform Security | PR.PS-06 – Secure software development practices are integrated, and their performance is monitored throughout the software development life cycle
          NIST
          Framework
          v2 View →
          GDPR General Data Protection Regulation (GDPR) The General Data Protection Regulation is a bindin... Clause: Article 32(1) – Security of processing
          EU
          Regulation
          vCurrent View →
          CERT-IN CERT-In Directions The CERT-In Directions issued under India’s Inform... Clause: Annexure I(xx) – Attacks or malicious/suspicious activities affecting systems/servers/software/applications related to Artificial Intelligence and Machine Learning
          India
          Direction
          v2022 View →
          SOC2 SOC 2 Trust Services Criteria SOC 2 is an independent examination and reporting... Clause: CC6.1 – Logical and Physical Access Controls – The entity implements logical access security software, infrastructure, and architectures over protected information assets to protect them from security events to meet the entity's objectives. CC7.1 – System Operations – To meet its objectives, the entity uses detection and monitoring procedures to identify (1) changes to configurations that result in the introduction of new vulnerabilities, and (2) susceptibilities to newly discovered vulnerabilities. CC7.3 – System Operations – The entity evaluates security events to determine whether they could or have resulted in a failure of the entity to meet its objectives (security incidents) and, if so, takes actions to prevent or address such failures.
          AICPA
          Audit Framework
          vLatest View →

          Parent Domain Context

          Governance Domain Baseline
          Domain Name:
          AI Governance & Model Security (AIG)
          Purpose:
          To ensure the trustworthy, secure, and ethical development and deployment of AI.
          Scope:
          Enterprise

          Parent Control Context

          Control Baseline
          Control Name:
          AI Security & Operational Resilience (AIG-005)
          Summary:
          Establishes AI security including adversarial protection, prompt injection protection, model poisoning protection, access security, monitoring, incident response, resilience testing, review, and continuous improvement.
          Business Description:
          Establish and maintain controls to protect AI systems against adversarial attacks, model compromise, data poisoning, prompt injection, model theft, unauthorized use, operational failures, and AI-related security incidents.