Project management operations
A user with the required privilege level can configure several aspects of a project and the tests within that project, as well as move test runs between existing projects.
An audit trail of the changes to project settings is available by selecting Settings History from the left navigation bar of the project settings page.
Configuring a project from the project settings page
The project settings page enables you to modify the following configuration aspects:
Project configuration
Configuration of the model used by the project
Configuration of the test runs for the model
Configuration of the actual tests run on the model
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
Click the Project Settings gear icon on the left navigation bar.
The project settings page appears.
Edit the project settings as required and click Save .
RIME updates the project with the new settings.
List of configurable project settings
| Settings section | Setting name | Type |
|---|---|---|
| Project Info | Project Name | Text field |
| Project Description | Text field | |
| Data Type | Text field | |
| Model Task | Drop-down | |
| Ethical Considerations | Text field | |
| Intended Use Case | Text field | |
| Project Tags | Text field | |
| Production Model Info | Model Architecture | Text field |
| Created Date | Date selector | |
| Reference Dataset (training) | File path | |
| Evaluation Dataset | File path | |
| Model ID | Text field | |
| External ID | Text field | |
| Model Path | File path | |
| Model Owner | Text field | |
| Model Tester | Text field | |
| Business Owner | Text field | |
| Notes | Text field |
Deleting a project
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a set of projects.
The Delete option appears above the list of projects.
Click Delete.
A confirmation dialog box appears.
Click Remove.
The selected projects are removed from the workspace.
Project publication
Publishing a project makes that project visible from the Workspace Overview. Only the project owner can publish or unpublish the project.
Publishing a project
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
In the top right, click Share.
The Project Sharing dialog appears.
Click the Published to workspace toggle.
Click Save.
RIME changes the project’s publication status.
Setting up project alerts
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
Click Alerts next to the project name.
The Project Alerts dialog box appears.
Choose an alert delivery model.
Alert delivery
Configuration step
Email
In Email Address, type an email address and click Add.
Slack
In Webhook URL, paste the Slack webhook URL and click Add.
Slack documentation provides details on generating a Slack webhook URL.
Click Done.
Alerts are configured for this project.
Configuring test category and sensitivity
Project-level test configuration affects Stress Tests and Continuous Tests that run in that project.
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
Click the Project Settings gear icon on the left navigation bar.
The project settings page appears.
Click the Test Configuration tab at the top.
The Test Configuration page opens at the Categories and Sensitivity pane.
Select a test type.
Both Stress and Continuous tests have the same configuration elements.
Select a set of tests.
Risk category
Test types
Operational risks
Overall performance
Subset performance
Drift (continuous testing focus)
Transformations (stress testing focus)
Abnormal inputs (continuous testing focus)
Security risks
Security events
Data poisoning
Model evasion
Fairness risks
Compliance and fairness
Select an overall test sensitivity level.
Click Save Settings.
The configuration for test category and sensitivity is saved.
Configuring Continuous Testing data sources and scheduling
This procedure assumes data sources have already been configured. Consult the section on configuring an integration for details.
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
Click the Project Settings gear icon on the left navigation bar.
The project settings page appears.
Click the Test Configuration tab at the top.
The Test Configuration page opens at the Categories and Sensitivity pane.
From the left sidebar, click Continuous Test data and schedule.
The Continuous Test data and schedule pane appears.
In Connection, choose a configured data source.
In Table Name, choose a table name.
Select columns from the Timestamp Column, Label Column, and Prediction Column drop-down selectors.
In Continuous Testing Schedule, select a bin size, a rolling window, and a number of bins.
Click Save Settings.
RIME saves the configuration settings for data sources and scheduling.
Configuring individual tests
You can configure individual tests within a project.
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
Click the Project Settings gear icon on the left navigation bar.
The project settings page appears.
Click the Test Configuration tab at the top.
The Test Configuration page opens at the Categories and Sensitivity pane.
From the left sidebar, click Individual Test Config.
The Individual Test Configuration pane appears.
Unfold one of the risk categories to display individual tests in that category.
Click the pencil icon next to a test.
The Advanced Configuration pane for that test displays.
Choose where to run the test.
A specific test can run in Stress Testing, Continuous Testing, or both.
In Severity Thresholds, enter values and define conditions for each alert level.
The RIME instance generates an event each time the test result meets the value and condition.
Select an on-save action.
Update Current Run Settings & Thresholds applies the new values to a testing run that is already in progress.
Update Project Settings saves the values to the project and applies the new values to any future test runs.
Click Save Updates.
The Individual Test Configuration pane appears.
Click Save Settings.
RIME saves the updated individual test configuration.
Configuring data profiling
RIME instances perform data profiling and modify test runs according to the results.
Sign in to a RIME instance.
The Workspaces page appears.
Click a workspace.
The Workspaces summary page appears.
Select a project.
You can filter or sort the list of projects in a workspace with the Sort and Filter controls in the upper right. Click the glyph to the right of the Filter control to switch between list and card display for projects. Type a string in Search Projects… to display only projects that match the string.
The project overview page appears.
Click the Project Settings gear icon on the left navigation bar.
The project settings page appears.
Click the Test Configuration tab at the top.
The Test Configuration page opens at the Categories and Sensitivity pane.
In the Run Configuration section of the left navigation bar, click Data Profiling.
The Column Profiling page appears.
Change values and toggles as required and click Save Settings.
RIME updates the data profiling settings.