Model cards
A model card is a summary of the capabilities, datasets, limitations, and training parameters for a given machine learning model. RIME enables you to generate model cards that can be configured to show specific aspects of a given model.
Launching the Model Card Builder
The Model Card Builder can be launched from several different places in the web UI of a RIME instance.
Launching the Model Card Builder from the Stress Test page
Sign in to a RIME instance.
The Workspaces page appears.
Select a workspace.
The workspace summary page appears, listing the projects in that workspace.
Select a project.
The project summary page appears.
From the left navigation bar, click Stress Testing.
The Stress Testing page appears, listing individual test runs.
Click the Model Card page icon for a test run.
The Model Card Builder launches.
Launching the Model Card Builder from the Project overview page
This procedure launches the Model Card Builder from the Project page for
a model in production.
Sign in to a RIME instance.
The Workspaces page appears.
Select a workspace.
The workspace summary page appears, listing the projects in that workspace.
Select a project.
The project overview page appears.
At the bottom of the Production Model pane at the right, click Go to Builder.
The Model Card Builder launches.
Launching the Model Card Builder from a test run page
This procedure launches the Model Card Builder from a specific test run page.
Sign in to a RIME instance.
The Workspaces page appears.
Select a workspace.
The workspace summary page appears, listing the projects in that workspace.
Select a project.
The project overview page appears.
From the left navigation bar, click Stress Testing.
The Stress Testing page appears, listing individual test runs.
Click a test run.
The summary page for that test run appears.
At the bottom of the Stress Test Information pane, click Go to Builder.
The Model Card Builder launches.
Generating model cards with the Model Card Builder.
This procedure presumes you have launched the Model Card Builder. To edit model and
business impact metadata, go to Project Settings.
Select severity toggles from the Model Issue Severities section of the left column.
The severity levels are Alert, Warning, and Passing.
Select a set of test type toggles to include in the model card.
The model card can include Stress Testing, Continuous Testing, or both.
(Stress Testing selected) Select a set of test categories in each risk category.
The risk categories are Operational Risk, Security Risk, and Fairness Risk.
The following results are related to security test and appear with additional
test details in the model card:
Effect on model
Possible intent
Recommendations(Continuous Testing selected) Select a set of test categories in each risk category.
The risk categories are Operational Risk, Security Risk, and Fairness Risk.
The following results are related to security tests and appear with additional
test details in the model card:
Effect on model
Possible intent
Evidence
RecommendationsType information into the following data fields.
Title and Subtitle
About Data CollectionChoose an output format from the Export to… drop-down selector and click the
Export button.Export format options are JSON and PDF.
The model card is saved to local storage in the selected format.