Skip to main content

Risk Assessments

Risk assessments provide a structured framework for evaluating and scoring risks associated with data products. Each assessment uses a multi-category scoring model and tracks mitigation actions to completion.

Overview

Risk assessments are product-scoped — each assessment is linked to a specific data product within a space. The system supports:

  • Multi-category scoring across dimensions like bias, privacy, security, and robustness
  • Automatic risk tier computation based on severity × likelihood × impact scores
  • Mitigation tracking with owners, deadlines, priorities, and evidence
  • Product sync to update a product's risk classification from an assessment

Creating an Assessment

  1. Navigate to a product's detail page
  2. Open the Risk Assessment tab
  3. Click New Assessment and select the type:
    • Initial — First-time risk evaluation
    • Pre-deployment — Before production launch
    • Periodic — Scheduled recurring review
    • Incident — Response to a specific incident

Scoring Model

Each assessment contains one or more evaluations — each representing a risk category:

DimensionScaleDescription
Severity1–5How serious is the potential harm?
Likelihood1–5How probable is the risk materialising?
Impact1–5How wide-reaching are the consequences?

Category score = Severity × Likelihood × Impact (max 125)

Overall score = Average of all category scores, normalised to 0–100

Risk Tiers

TierScore RangeDescription
🔴 Unacceptable≥ 80Requires immediate action
🟠 High≥ 50Significant risk, mitigation required
🟡 Limited≥ 25Manageable risk with monitoring
🟢 Minimal< 25Low risk, standard controls sufficient

Mitigation Actions

Each assessment can include mitigation actions to address identified risks:

  • Assign an owner and set a deadline
  • Track status through pendingin_progresscompleted
  • Attach evidence (links, issue IDs) to demonstrate completion
  • Link to platform issues for formal remediation tracking
  • Set priority levels: low, medium, high, critical

Mitigation Categories

CategoryUse Case
Bias MitigationAddressing statistical or demographic bias
RetrainingModel or pipeline retraining
Robustness TestingStress testing and edge cases
Privacy EnhancementData anonymisation, access controls
ExplainabilityImproving model interpretability
Monitoring ImprovementEnhanced alerting and dashboards
Process ChangeOrganisational or procedural changes

Completing an Assessment

When all evaluations are scored and mitigations are planned:

  1. Click Complete Assessment
  2. Review the computed risk tier (or override it)
  3. Optionally sync to product — this updates the product's risk_classification field
  4. The assessment becomes read-only after completion

Integration with Compliance

Risk assessments feed directly into compliance reporting:

  • Assessments appear in the product's Compliance section
  • Completed assessments with unacceptable or high tiers trigger visibility in compliance dashboards
  • Mitigation progress is tracked across the organisation