evaluation

OMEN Evaluation

Deterministic test harnesses, DDIL simulation, red-team scenarios, and replay infrastructure. Inspired by DaScient ARES-E.

Contents

Directory	Description
harnesses/	Adapter and engine compliance harnesses
ddil/	DDIL connectivity scenario tests
red-team/	Adversarial and malformed-input tests
scenarios/	Record/replay scenario files

Running Tests

# Install dependencies
pip install -r requirements.txt

# Run all (no Docker required)
PYTHONPATH=.. pytest . -v -k "not docker"

# Run with Docker network impairment shim
PYTHONPATH=.. pytest . -v  # includes Docker-marked tests

Evaluation Dimensions

1. Functional correctness
2. Mission utility
3. Performance
4. DDIL resilience
5. Usability
6. Security
7. Interoperability
8. Maintainability
9. Auditability
10. Energy efficiency

Documentation

• Evaluation Framework
• ARES-E Integration
• DDIL Resilience