Glossary of Terms

Test

A Test refers to a single automated test that checks a particular aspect of the software being verified. It typically asserts whether a specific condition or set of conditions meet the expected criteria, determining the test as passed or failed based on the outcome.

Test Run

A Test Run is an instance of executing a test. It represents the process where the test run, and the outcomes (like pass, fail, and time taken) are recorded. Test run results provide detailed insights into the functionality of a piece of software at a specific point in time.

Test Suite

A Test Suite is a collection of tests grouped together to assess various features and functionality of a given codebase (usually a project, repo or similar logical grouping). It serves as a comprehensive package for testing different parts of an application to ensure they work as expected individually and in combination.

Test Suite Run

A Test Suite Run refers to the execution of all tests within a Test Suite. It captures the collective outcomes of the suite's tests, offering an overview of the state of the software under test, and any issues needing attention at the moment of the run.

Test Suite Name

The Test Suite Name is a helpful, typically human-readable identifier for a Test Suite. It helps differentiate one test suite from another and can describe the suite's purpose, the feature it tests, or other relevant information. Naming test suites is crucial for organization and reporting.

Test Suite Run ID

The Test Suite Run ID is a unique identifier assigned to a specific Test Suite Run. It is used to track and reference individual executions of a Test Suite, allowing for detailed analysis and comparison of results over time.

CLI (Command Line Interface)

CLI, or Command Line Interface, is a text-based interface used to interact with software or operating systems. Through a CLI, users can execute commands, manage files, and run tools or applications by typing text commands into a terminal or console window.

CI (Continuous Integration)

CI, or Continuous Integration, is a software development practice where developers regularly merge their code changes into a central repository, followed by automated builds and tests. The goal of CI is to detect and fix integration errors quickly, improve software quality, and reduce the time to deliver new updates.

Container

A Container is a lightweight, standalone, executable package that includes everything needed to run a piece of software, including the code, runtime, system tools, system libraries, and settings. Containers isolate software from its environment and ensure it works uniformly despite differences for instance between development and staging.