Skip to main content

How to configure your project

Fine-tune Aucert's test generation and execution by editing aucert.config.yaml.

Prerequisites​

Common configurations​

Adjust confidence threshold​

The confidence threshold controls which results are flagged as failures. Lower it to catch more potential issues (with more false positives), or raise it for higher precision:

aucert.config.yaml
testing:
confidence_threshold: 0.90 # Higher = fewer results, more precise
ThresholdTrade-offBest for
0.70Catches more issues, more noiseEarly development — cast a wide net
0.85Balanced (default)Most projects
0.95Very precise, may miss subtle issuesMature apps with low false-positive tolerance

Limit test scope​

Focus on specific test types for faster feedback:

aucert.config.yaml
testing:
scope:
- navigation # Screen-to-screen flows only (fastest)
ScopeWhat it testsSpeed
navigationScreen transitions, back navigation, deep linksFast (~1 min)
user-flowsEnd-to-end journeys (login → purchase → logout)Medium (~3 min)
regressionRe-runs previously failed scenariosDepends on history

Change output format​

aucert.config.yaml
output:
format: junit # junit for CI/CD, json for API consumption, html for humans
screenshots: true # Include screenshot evidence at each step

Limit test generation​

Cap the number of scenarios to control run time and cost:

aucert.config.yaml
testing:
max_tests: 20 # Generate at most 20 scenarios (default: 100)
timeout: 180 # Per-scenario timeout in seconds (default: 300)

Full configuration reference​

See Configuration reference for every available option, environment variable overrides, and validation rules.

Example configurations​

Quick PR feedback​

Minimal scope for fast feedback in CI:

aucert.config.yaml
testing:
scope: [navigation]
max_tests: 10
confidence_threshold: 0.85
output:
format: junit

Comprehensive nightly testing​

Full scope for thorough overnight runs:

aucert.config.yaml
testing:
scope: [navigation, user-flows, regression]
max_tests: 200
confidence_threshold: 0.80
output:
format: html
screenshots: true

What's next​