Open
Description
PR
Done
- [CI] new command implementation for tests #4056
- [Tigron]: mocks + debugging output enhancements #4076
- [Tigron]: expect.JSON comparator and updated volume test #4079
- [Tigron]: Testing logs user experience #4080
- [Tigron]: revised Data interface #4081
- [Tigron]: allow per-command environment override #4116
- [CI]: quality of life: minor debugging output fixes #4111
Pending review
Work in progress
Test suites to rewrite
- STARTED: builder
- completion
- TODO: compose
- STARTED: container
- image
- ipfs
- STARTED: login
- network
- system
- volume
- main
Issues and features
- P0: there is currently no protection against identically named tests - since we use identifiers based on test names, this could be a problem when inadvertently identical names
- P0: remove dependency on *testing.T and replace by tig.T everywhere
- P1: requirements should be able to manipulate the environment
- P2: separate environment processing into a distinct struct for better debugability
- P1: API breaking: change comparators signature (remove
info
+tig.T
) - P0:
Manager
is evaluated before the command runs, while theComparator
in Output is evaluated after - this is confusing and prevents legit scenarios. Manager should only be evaluated after the command has run. - P0: rethink
Data
- need something to manipulate temp files ([Tigron]: revised Data interface #4081) - P1: separate cwd and temp dir
- P1: following the rewrite of Command, test.Command is now a (mostly) empty shell - cleanup / refactor
- P1: reintroduce Env, WD, etc to the command debug output
- P1: add Config/Data details to the debug output
- P1: currently, the command is executing inside data.TempDir(), so, there is no distinction between
.
andTempDir
from the command perspective. We may want to address that. - P1: missing something like
.AddCleanup()
when a routine insideSetup
does want to add additional cleaning - P2: use of data.Identifier in subtests hoping to get the parent testid may be error prone - rethink Identifier()?
Metadata
Metadata
Assignees
Labels
No labels