Skip to content

Commit 4daf3dd

Browse files
feat(v1.49.0): tests/ → test-cases/ rename, test case terminology, landing page rewrite
Phase 1 — Folder Rename: - Default output dir changed from tests/ to test-cases/ in TestsConfig, InitHandler, config template, and all fallback strings across CLI/MCP handlers - Updated CI workflow templates, test fixtures, and 20+ test files - All 1706 tests pass (514 Core + 841 CLI + 351 MCP) Phase 2 — Terminology Sweep: - Standardized "test case(s)" across 12 SKILL files, 2 agent files, 15+ docs - Updated constitution (v1.1.0), PROJECT-KNOWLEDGE, README, CLAUDE.md - Preserved compound terms (test run, test suite, test ID, test data) Phase 3 — Landing Page: - Rewrote docs/index.md with comparison table, Chat-first workflow, quick install Phase 4 — CLI-vs-Chat: - Replaced 4800-word analysis with 146-word page (Chat = recommended, CLI = engine) Breaking change: default tests.dir now "test-cases/" (zero external users)
1 parent 622e32e commit 4daf3dd

File tree

85 files changed

+1086
-855
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

85 files changed

+1086
-855
lines changed

.github/workflows/dashboard.yml.template

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ on:
2121
- main
2222
paths:
2323
# Trigger on test file changes
24-
- 'tests/**'
24+
- 'test-cases/**'
2525
# Trigger on execution report changes
2626
- 'reports/**'
2727
# Trigger on index changes

.github/workflows/deploy-dashboard.yml.template

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ on:
2323
branches:
2424
- main
2525
paths:
26-
- 'tests/**'
26+
- 'test-cases/**'
2727
- '.execution/**'
2828
- 'docs/**'
2929
- 'spectra.config.json'

.specify/memory/constitution.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
================================================================================
33
SYNC IMPACT REPORT
44
================================================================================
5-
Version Change: N/A → 1.0.0 (Initial ratification)
5+
Version Change: 1.0.0 → 1.1.0 (Terminology: tests/ → test-cases/)
66
77
Added Sections:
88
- Core Principles (5 principles)
@@ -27,7 +27,7 @@ Follow-up TODOs: None
2727

2828
All test definitions, documentation, and configuration MUST be stored in Git repositories. GitHub is the authoritative source for:
2929

30-
- Test cases as Markdown files with YAML frontmatter in `tests/{suite}/`
30+
- Test cases as Markdown files with YAML frontmatter in `test-cases/{suite}/`
3131
- Documentation in `docs/` that drives test generation
3232
- Configuration in `spectra.config.json` at repository root
3333
- Metadata indexes (`_index.json`) committed to enable deterministic builds
@@ -134,4 +134,4 @@ All changes MUST be reviewed before merge:
134134

135135
This Constitution supersedes all other practices when conflicts arise. If a pattern in existing code conflicts with these principles, new code MUST follow the Constitution and technical debt SHOULD be logged for remediation.
136136

137-
**Version**: 1.0.0 | **Ratified**: 2026-03-13 | **Last Amended**: 2026-03-13
137+
**Version**: 1.1.0 | **Ratified**: 2026-03-13 | **Last Amended**: 2026-04-12

CLAUDE.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ Auto-generated from all feature plans. Last updated: 2026-04-12
99
- System.CommandLine (CLI), Spectre.Console (terminal UX), System.Text.Json (serialization)
1010
- ASP.NET Core (MCP server), Microsoft.Data.Sqlite (state storage)
1111
- SQLite database (`.execution/spectra.db`) for execution state; file system for reports
12-
- File-based (tests/, docs/, spectra.config.json, _index.json, _index.md, profiles, .spectra/prompts/)
12+
- File-based (test-cases/, docs/, spectra.config.json, _index.json, _index.md, profiles, .spectra/prompts/)
1313
- CsvHelper (CSV import for acceptance criteria)
1414
- Dual-model verification: Generator (any provider) + Critic (any provider) via Copilot SDK
1515
- Document index (`docs/_index.md`) for pre-built documentation metadata with incremental updates
@@ -282,3 +282,6 @@ Report features:
282282

283283
<!-- MANUAL ADDITIONS START -->
284284
<!-- MANUAL ADDITIONS END -->
285+
286+
## Recent Changes
287+
- 043-terminology-folder-landing: Added C# 12, .NET 8+ + System.CommandLine, Spectre.Console, System.Text.Json

Directory.Build.props

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@
2020
<Authors>Spectra Contributors</Authors>
2121
<Company>Spectra</Company>
2222
<Product>Spectra</Product>
23-
<Description>AI-native test generation and execution framework</Description>
23+
<Description>AI-native test case generation and execution framework</Description>
2424
</PropertyGroup>
2525

2626
<!-- Shared analyzers for all projects -->

PROJECT-KNOWLEDGE.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22

33
## What is SPECTRA?
44

5-
SPECTRA is an AI-native test case generation, execution, coverage analysis, and maintenance CLI tool. It reads product documentation, extracts testable behaviors, generates structured manual test cases (as Markdown files with YAML frontmatter), executes them through an MCP server with AI agent orchestration, and produces coverage reports and dashboards.
5+
SPECTRA is an AI-native test case generation and execution framework. It reads product documentation, extracts testable behaviors, generates structured manual test cases (as Markdown files with YAML frontmatter), executes them through an MCP server with AI agent orchestration, and produces coverage reports and dashboards.
66

77
## Architecture Overview
88

@@ -123,7 +123,7 @@ spectra update-skills # Sync bundled SKILL files
123123

124124
## Test Case Format
125125

126-
Tests are Markdown files with YAML frontmatter in `tests/{suite}/`:
126+
Test cases are Markdown files with YAML frontmatter in `test-cases/{suite}/`:
127127

128128
```yaml
129129
---

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919

2020
<!-- Tagline -->
2121
<p align="center">
22-
<strong>AI-native test generation and execution framework.</strong><br>
22+
<strong>AI-native test case generation and execution framework.</strong><br>
2323
From documentation to deterministic test execution.
2424
</p>
2525

@@ -46,7 +46,7 @@ SPECTRA reads your product documentation, generates comprehensive test suites, a
4646

4747
- **AI with guardrails** — Dual-model grounding verification catches hallucinated test steps before they reach your suite.
4848

49-
- **Tests as Markdown** — Test cases are plain Markdown files with YAML frontmatter. They live in GitHub, versioned alongside your code.
49+
- **Test cases as Markdown** — Test cases are plain Markdown files with YAML frontmatter. They live in GitHub, versioned alongside your code.
5050

5151
- **Deterministic execution** — An MCP-based execution engine provides a state machine that any AI orchestrator can drive without holding state.
5252

@@ -171,7 +171,7 @@ docs/_index.md <- Pre-built document index (incremental)
171171
|
172172
AI Test Generation CLI <- GitHub Copilot SDK (sole AI runtime)
173173
| Supports: github-models, azure-openai,
174-
tests/ <- azure-anthropic, openai, anthropic
174+
test-cases/ <- azure-anthropic, openai, anthropic
175175
|
176176
MCP Execution Engine <- Deterministic state machine
177177
|

docs/DEVELOPMENT.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ tests/
4646
├── Spectra.Core.Tests/ # Core library tests
4747
└── TestFixtures/ # Sample test data
4848
├── docs/ # Sample documentation
49-
└── tests/ # Sample test suites with _index.json
49+
└── test-cases/ # Sample test case suites with _index.json
5050
```
5151

5252
## Building
@@ -183,7 +183,7 @@ The `tests/TestFixtures/` folder contains ready-to-use sample data:
183183
dotnet run --project src/Spectra.MCP -- tests/TestFixtures
184184
```
185185

186-
Available suites in fixtures: auth (3 tests), checkout (1 test).
186+
Available suites in fixtures: auth (3 test cases), checkout (1 test case).
187187

188188
## Troubleshooting
189189

@@ -195,7 +195,7 @@ dotnet build -p:NoWarn=CA1062
195195

196196
### "Suite not found"
197197

198-
Ensure your test folder has `tests/` with suite subdirectories containing valid `_index.json` files.
198+
Ensure your test case folder has `test-cases/` with suite subdirectories containing valid `_index.json` files.
199199

200200
### "Index stale"
201201

0 commit comments

Comments
 (0)