v0.8 ( 2023-03-13 )

• Promotion (promote and run --auto-promote):

  • Fix --no-comment for promotion that was not used
  • Add argument --no-exit to promote, to promote everything except the exit code (so that the test will still fail with exitcode)
  • Don't promote failing AT_CHECK with run-if-fail or run-if-pass

• Configuration file:

  • New config option 'project.run_from' that specifies where _autofonce/ should be created: build for build directory (default), source for source directory or config for configuration file directory

• Command Arguments and Behavior:

  • Support for range of test ids like 1-10 or 10-
  • Exit with non-zero status on failed tests
  • If testsuite location is a directory instead of a file, scan all directoies and sub-directories for files *.at containing tests, with copying enabled (AT_COPY_ALL([true])).
  • New option -o LOGFILE to specify the log file
  • New command autofonce config to print the currently read config
  • New options -T <FILE.at>, -E <env.sh> and -I <path> to describe a testsuite directly from the command-line
  • Option -k KEYWORDS: if a keyword starts is negated with -, then tests matching that keyword will not be executed (same as --not)

• Improved version of _autofonce/results.log:

  • Include all files from failed checks and honor captured files
  • New option captured_files in autofonce.toml to include some project files

• Standard Macro Language:

  • Implements AT_FAIL_IF([shell-cond])
  • To conform with namespace rules for autoconf, all macros are supported with both a AT_ and AF_ prefix, and autofonce will promote autofonce specific macros with the AF_ prefix, while using the AT_ prefix for autoconf compatible macros

• Macro language extensions (default is AF_, but AT_ is accepted:

  • Skip macro definitions with AC_DEFUN/m4_define. This is currently mostly done to allow the definition of: AC_DEFUN([AF_ENV], [$1]). Print a warning for discarding the macro definition, except for AF_ENV.

  • Add AF_ENV([env]) as a way to define a specific environment for the test (such as environment variables).

    • At toplevel, declarations by AF_ENV are added in the autofonce_env.sh file of every test.
    • At test level, declarations are added directly in all following check scripts
  • Add AF_COPY(files) to copy files from the test source directory to the test run directory
  • Add AF_LINK(files), same as AF_COPY, but symlink instead of copy
  • Add AF_COPY_ALL([true|false]). If true, used before tests, make tests copy all non .at files in their directory as if AF_COPY had been used. If false, disable copying files for following tests.
  • Add AF_LINK_ALL(), same as AF_COPY_ALL, but symlink instead of copy
  • Add AF_SUBST(variables) to replace occurrences of these env variables in the stdout/stderr. A special case is AUTOFONCE that replaces ${AUTOFONCE_RUN_DIR}/${TEST_ID}, ${AUTOFONCE_BUILD_DIR} and ${AUTOFONCE_SOURCE_DIR}.
• Add a testsuite in test/testsuite.at