codebolt.autotesting

Automated test management tools for creating, managing, and executing test suites, test cases, and test runs.

Available Tools

Suite Management Tools

autotesting_create_suite - Creates a new test suite with the specified name and optional description
autotesting_get_suite - Retrieves a test suite by its ID, including its associated test cases
autotesting_list_suites - Lists all available test suites with their names, descriptions, and test case counts
autotesting_update_suite - Updates an existing test suite with new name, description, or test case associations
autotesting_delete_suite - Permanently deletes a test suite by its ID
autotesting_add_case_to_suite - Adds a test case to an existing test suite
autotesting_remove_case_from_suite - Removes a test case from a test suite

Case Management Tools

autotesting_create_case - Creates a new test case with the specified key, name, steps, and optional metadata
autotesting_get_case - Retrieves a test case by its ID, including all steps and metadata
autotesting_list_cases - Lists all available test cases with their keys, names, priorities, and step counts
autotesting_update_case - Updates an existing test case with new key, name, description, steps, labels, priority, or type
autotesting_delete_case - Permanently deletes a test case by its ID

Run Management Tools

autotesting_create_run - Creates a new test run for a specified test suite
autotesting_get_run - Retrieves a test run by its ID, including status, test case results, and summary statistics
autotesting_list_runs - Lists all test runs, optionally filtered by suite ID
autotesting_update_run_status - Updates the status of a test run (pending, running, completed, or cancelled)
autotesting_update_run_case - Updates the status of a specific test case within a run
autotesting_update_run_step - Updates the status of a specific test step within a run

Tool Parameters

`autotesting_create_suite`

Creates a new test suite with the specified name and optional description. Test suites are used to group related test cases together.

Parameter	Type	Required	Description
name	string	Yes	The name of the test suite to create.
description	string	No	Optional description of the test suite.
testCaseIds	array	No	Optional array of test case IDs to include in the suite.

`autotesting_get_suite`

Retrieves a test suite by its ID, including its associated test cases.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test suite to retrieve.

`autotesting_list_suites`

Lists all available test suites with their names, descriptions, and test case counts.

Parameter	Type	Required	Description
-	-	-	No parameters required.

`autotesting_update_suite`

Updates an existing test suite with new name, description, or test case associations.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test suite to update.
name	string	No	Optional new name for the test suite.
description	string	No	Optional new description for the test suite.
testCaseIds	array	No	Optional new array of test case IDs to associate with the suite.

`autotesting_delete_suite`

Permanently deletes a test suite by its ID. This action cannot be undone.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test suite to delete.

`autotesting_add_case_to_suite`

Adds an existing test case to a test suite.

Parameter	Type	Required	Description
suiteId	string	Yes	The ID of the test suite to add the case to.
caseId	string	Yes	The ID of the test case to add.

`autotesting_remove_case_from_suite`

Removes a test case from a test suite.

Parameter	Type	Required	Description
suiteId	string	Yes	The ID of the test suite to remove the case from.
caseId	string	Yes	The ID of the test case to remove.

`autotesting_create_case`

Creates a new test case with the specified key, name, steps, and optional metadata. Test cases define individual tests that can be added to test suites.

Parameter	Type	Required	Description
key	string	Yes	Unique key identifier for the test case (e.g., "TC-001").
name	string	Yes	The name of the test case.
description	string	No	Optional description of what the test case validates.
steps	array	Yes	Array of test steps, each with content and optional order.
labels	array	No	Optional labels for categorization.
priority	string	No	Optional priority level: low, medium, high, or automated.
type	string	No	Optional test type (e.g., "functional", "regression").

`autotesting_get_case`

Retrieves a test case by its ID, including all steps and metadata.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test case to retrieve.

`autotesting_list_cases`

Lists all available test cases with their keys, names, priorities, and step counts.

Parameter	Type	Required	Description
-	-	-	No parameters required.

`autotesting_update_case`

Updates an existing test case with new key, name, description, steps, labels, priority, or type.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test case to update.
key	string	No	Optional new key for the test case.
name	string	No	Optional new name for the test case.
description	string	No	Optional new description for the test case.
steps	array	No	Optional new array of steps.
labels	array	No	Optional new labels for categorization.
priority	string	No	Optional new priority level: low, medium, high, or automated.
type	string	No	Optional new test type.

`autotesting_delete_case`

Permanently deletes a test case by its ID. This action cannot be undone.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test case to delete.

`autotesting_create_run`

Creates a new test run for a specified test suite. A test run tracks the execution and results of all test cases in the suite.

Parameter	Type	Required	Description
testSuiteId	string	Yes	The ID of the test suite to create a run for.
name	string	No	Optional name for the test run (e.g., "Sprint 1 Regression").

`autotesting_get_run`

Retrieves a test run by its ID, including status, test case results, and summary statistics.

Parameter	Type	Required	Description
id	string	Yes	The ID of the test run to retrieve.

`autotesting_list_runs`

Lists all test runs, optionally filtered by suite ID.

Parameter	Type	Required	Description
suiteId	string	No	Optional suite ID to filter runs by.

`autotesting_update_run_status`

Updates the status of a test run. Use this to mark a run as running, completed, or cancelled.

Parameter	Type	Required	Description
runId	string	Yes	The ID of the test run to update.
status	string	Yes	The new status for the test run: pending, running, completed, or cancelled.

`autotesting_update_run_case`

Updates the status of a specific test case within a test run.

Parameter	Type	Required	Description
runId	string	Yes	The ID of the test run.
caseId	string	Yes	The ID of the test case to update.
status	string	Yes	The new status for the test case: pending, running, passed, failed, or skipped.
userOverride	boolean	No	Whether this is a user override.

`autotesting_update_run_step`

Updates the status of a specific test step within a test case run.

Parameter	Type	Required	Description
runId	string	Yes	The ID of the test run.
caseId	string	Yes	The ID of the test case.
stepId	string	Yes	The ID of the test step to update.
status	string	Yes	The new status for the test step: pending, running, passed, failed, or skipped.
logs	string	No	Logs for the test step.
userOverride	boolean	No	Whether this is a user override.

Sample Usage

Create a Test Suite

const result = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_create_suite",
  {
    name: "Authentication Tests",
    description: "Tests for user authentication flows",
    testCaseIds: []
  }
);

Create a Test Case

const result = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_create_case",
  {
    key: "TC-001",
    name: "User Login Test",
    description: "Validates user login functionality",
    steps: [
      { content: "Navigate to login page", order: 1 },
      { content: "Enter valid credentials", order: 2 },
      { content: "Click login button", order: 3 },
      { content: "Verify dashboard is displayed", order: 4 }
    ],
    priority: "high",
    labels: ["authentication", "smoke"],
    type: "functional"
  }
);

Add Case to Suite and Create Test Run

// Add case to suite
const addResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_add_case_to_suite",
  {
    suiteId: "suite-123",
    caseId: "case-456"
  }
);

// Create a test run
const runResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_create_run",
  {
    testSuiteId: "suite-123",
    name: "Sprint 1 Regression"
  }
);

Manage Test Run Status

// Update test run status
const statusResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_update_run_status",
  {
    runId: "run-789",
    status: "running"
  }
);

// Update individual test case status
const caseResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_update_run_case",
  {
    runId: "run-789",
    caseId: "case-456",
    status: "passed",
    userOverride: false
  }
);

Update Test Step with Logs

const stepResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_update_run_step",
  {
    runId: "run-789",
    caseId: "case-456",
    stepId: "step-101",
    status: "passed",
    logs: "Successfully validated user credentials",
    userOverride: false
  }
);

List and Query Test Resources

// List all test suites
const suitesResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_list_suites",
  {}
);

// List all test cases
const casesResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_list_cases",
  {}
);

// List test runs for a specific suite
const runsResult = await codebolt.tools.executeTool(
  "codebolt.autotesting",
  "autotesting_list_runs",
  {
    suiteId: "suite-123"
  }
);

Test Status Values

Test Run Status:

pending - Test run is waiting to start
running - Test run is currently executing
completed - Test run has finished execution
cancelled - Test run was cancelled before completion

Test Case/Step Status:

pending - Test case or step is waiting to run
running - Test case or step is currently executing
passed - Test case or step completed successfully
failed - Test case or step failed during execution
skipped - Test case or step was skipped

Available Tools​

Suite Management Tools​

Case Management Tools​

Run Management Tools​

Tool Parameters​

autotesting_create_suite​

autotesting_get_suite​

autotesting_list_suites​

autotesting_update_suite​

autotesting_delete_suite​

autotesting_add_case_to_suite​

autotesting_remove_case_from_suite​

autotesting_create_case​

autotesting_get_case​

autotesting_list_cases​

autotesting_update_case​

autotesting_delete_case​

autotesting_create_run​

autotesting_get_run​

autotesting_list_runs​

autotesting_update_run_status​

autotesting_update_run_case​

autotesting_update_run_step​

Sample Usage​

Create a Test Suite​

Create a Test Case​

Add Case to Suite and Create Test Run​

Manage Test Run Status​

Update Test Step with Logs​

List and Query Test Resources​