Skip to content

More better system testing#1146

Merged
mkarlesky merged 636 commits into
masterfrom
feature/better-system-testing
May 21, 2026
Merged

More better system testing#1146
mkarlesky merged 636 commits into
masterfrom
feature/better-system-testing

Conversation

@mkarlesky

Copy link
Copy Markdown
Member

Functionality

  • New Rake tasks that separate unit specs from system specs
  • Spec progress vs. documentation format via environment variable (for CI)
  • Preserving system spec temp directory for a build is optional via environment variable
  • Custom formatting of system test spec failure output for readability, etc.
  • System test test suite failures capture ceedling <test> logging output with debug verbosity to a log file instead of an ugly failing assertion at the console.

Reorganization

  • Unit tests separate from system tests
  • All test supporting ruby and artifacts organized in support folders
  • Common test cases reorganized to their own files with modules renamed
  • Supporting Ruby decomposed into individual classes and files

Github Actions

  • Environment variable set for RSpec reporting format
  • Upload failing system test logs as Github build artifacts

- Revised stand-in header file creation to target directories
New function that does not rely on unnecessary test-specific preprocessing steps
- Added reliance on base Include class as a first-class member of the system
- Rely on extracting all includes through make-rule dependencies preprocessor mode
- Added specific Includes.reconciliation() method
- Renaming
mkarlesky added 27 commits May 16, 2026 23:37
Activate/deactivate are only run if a virtual environment is in use (local vs. CI builds)
Removing newlines in functions can break coverage instrumentation for relative line numbering
-Broke up GCov plugin documenation into a sub-section
- Created a new Code Coverage reference section to summarize GCov option lookup
Replaced brittle handling of function signature and code_block handling for function definitions. This new approach preserves newlines throughout an extracted function, still cleans the signature for other purposes, robustly handles decorator removal from a function definition block, and updates `#line` numbering if necessary due to leading newline cleanup after decoractor removal.
- Added system test for `#include`ing .c files in tests
- Smarter system test execution giving better options on displaying and logging test failures
`to_s` and `to_str` are both needed and `FileList` handling requires a means to coerce Include into a string
- New Rake tasks that separate unit specs from system specs
- Spec progress vs. documentation format via environment variable (for CI)
- Custom formatting of system test specs for readability, etc.
- System test test suite failures capture `ceedling <test>` logging output with debug verbosity to a log file instead of an ugly failing assertion at the console
- Preserving the temp directory for a build is optional via environment variable
- Unit tests separate from system tests
- All test supporting ruby and artifacts organized in support folders
- Common test cases reorganized to their own files with modules renamed
- Supporting Ruby decomposed into individual classes and files
1. Set environment variable for RSpec progress format (dots)
1. Upload system test failure logs as Github Action artifacts
Backed out system test rigging manual test accidentally committed
@mkarlesky mkarlesky merged commit c3c985a into master May 21, 2026
0 of 4 checks passed
@mkarlesky mkarlesky deleted the feature/better-system-testing branch May 26, 2026 01:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants