Skip to main content

How to configure your project

Fine-tune Aucert's test generation and execution by editing aucert.config.yaml.

Prerequisites

Common configurations

Adjust confidence threshold

The confidence threshold controls which results are flagged as failures. Lower it to catch more potential issues (with more false positives), or raise it for higher precision:

aucert.config.yaml
testing:
confidence_threshold: 0.90 # Higher = fewer results, more precise
ThresholdTrade-offBest for
0.70Catches more issues, more noiseEarly development — cast a wide net
0.85Balanced (default)Most projects
0.95Very precise, may miss subtle issuesMature apps with low false-positive tolerance

Limit test scope

Focus on specific test types for faster feedback:

aucert.config.yaml
testing:
scope:
- navigation # Screen-to-screen flows only (fastest)
ScopeWhat it testsSpeed
navigationScreen transitions, back navigation, deep linksFast (~1 min)
user-flowsEnd-to-end journeys (login → purchase → logout)Medium (~3 min)
regressionRe-runs previously failed scenariosDepends on history

Change output format

aucert.config.yaml
output:
format: junit # junit for CI/CD, json for API consumption, html for humans
screenshots: true # Include screenshot evidence at each step

Limit test generation

Cap the number of scenarios to control run time and cost:

aucert.config.yaml
testing:
max_tests: 20 # Generate at most 20 scenarios (default: 100)
timeout: 180 # Per-scenario timeout in seconds (default: 300)

Full configuration reference

See Configuration reference for every available option, environment variable overrides, and validation rules.

Example configurations

Quick PR feedback

Minimal scope for fast feedback in CI:

aucert.config.yaml
testing:
scope: [navigation]
max_tests: 10
confidence_threshold: 0.85
output:
format: junit

Comprehensive nightly testing

Full scope for thorough overnight runs:

aucert.config.yaml
testing:
scope: [navigation, user-flows, regression]
max_tests: 200
confidence_threshold: 0.80
output:
format: html
screenshots: true

What's next