Skip to main content

Overview

The Score entity captures the result of every data quality check performed by Prizm. It records both raw validation statistics (valid/invalid counts) and derived quality scores, along with full context about the asset, metric, and execution run that produced the result. Score is central to Prizm’s historical quality tracking, trend analysis, and root cause analysis.

Score Entity Attributes

AttributeData TypeDescriptionConstraint
score_iduuidUnique identifier for each score recordPrimary Key
metric_iduuidReference to the metric being measuredForeign Key
valuedouble precisionThe measured value of the metric
total_recordsbigintTotal number of records analyzed
valid_recordsbigintNumber of records that passed validation
invalid_recordsbigintNumber of records that failed validation
valid_percentagefloatPercentage of valid records
invalid_percentagefloatPercentage of invalid records
scorefloatCalculated quality score value
qualified_namestringFully qualified name of the asset
account_namestringAccount name associated with the asset
database_namestringDatabase where the asset is stored
schema_namestringSchema where the asset is stored
table_namestringTable name of the asset
model_namestringName of the model associated with the asset
pipeline_namestringName of the data pipeline
task_namestringName of the task within the pipeline
test_namestringName of the test applied
attribute_namestringName of the attribute being tested
asset_iduuidReference to the asset being scoredForeign Key
asset_typestringType of the asset (table, model, etc.)
metric_detail_iduuidReference to detailed metric informationForeign Key
run_iduuidReference to the pipeline runForeign Key
created_attimestampWhen the score record was created
modified_attimestampWhen the record was last modified
created_byuuidUser who created the record
modified_byuuidUser who last modified the record

Entity Relationships

AttributeReferencesRelationship
metric_idMetric.metric_idMany scores can reference a single metric definition
asset_idAsset.asset_idMany scores can be associated with a single data asset
metric_detail_idMetricDetail.metric_detail_idLinks to detailed information about the metric calculation
run_idRun.run_idAssociates the score with a specific pipeline execution run
created_byUser.user_idReferences the user who created the score record
modified_byUser.user_idReferences the user who last modified the score record

Data Flow

When a data quality check is performed, the following steps occur:
1

Metric Applied

A quality metric is applied to a data asset (referenced by asset_id).
2

Validation Executed

The metric engine scans the asset and counts valid and invalid records.
3

Score Computed

valid_percentage, invalid_percentage, and overall score are calculated.
4

Score Record Created

A new Score record is written with full context — asset, metric, run, timestamps, and personnel.
5

Exception Generation

If invalid_records > 0, Exception records are created and routed to the appropriate workflow.

Score vs. Exception

The Score entity represents the aggregate result of a quality check (e.g., “5% of records had null order IDs”). Exceptions are the individual failing records themselves. Scores drive dashboards and trends; Exceptions drive remediation workflows.

DQ Score Scope and Mapping

Scores can be computed at multiple levels of granularity:
ScopeDescription
Column-levelQuality score for a specific attribute (attribute_name is populated)
Table-levelAggregate quality score for the entire table
Asset-levelRolled-up quality score across all metrics for an asset
Domain-levelAggregated quality across all assets in a domain
Pipeline-levelQuality score associated with a specific pipeline run