Reference page for all dataset-level evals.
How to read the tables
Report
.
tests
to any Metric with standard operators like eq
(equal), gt
(greater than), etc. How Tests work.
run
, the conditions are set relative to reference.
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
TextEvals() |
| Optional:
| As in Metrics included in ValueStats |
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
ValueStats() |
| Required:
|
|
MinValue() |
| Required:
|
|
StdValue() |
| Required:
|
|
MeanValue() |
| Required:
|
|
MaxValue() |
| Required:
|
|
MedianValue() |
| Required:
|
|
QuantileValue() |
| Required:
|
|
CategoryCount() Example: CategoryCount( column="city", category="NY") |
| Required:
|
|
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
MissingValueCount() |
| Required:
|
|
InRangeValueCount() Example: InRangeValueCount( column="age", left="1", right="18") |
| Required:
|
|
OutRangeValueCount() |
| Required:
|
|
InListValueCount() |
| Required:
|
|
OutListValueCount() Example: OutListValueCount( column="city", values=["Lon", "NY"]) |
| Required:
|
|
UniqueValueCount() |
| Required:
|
|
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
DataSummaryPreset() |
| Optional:
| As in individual Metrics. |
DatasetStats() |
| None |
|
RowCount() |
| Optional: |
|
ColumnCount() |
| Optional: |
|
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
ConstantColumnsCount() |
| Optional: |
|
EmptyRowsCount() |
| Optional: |
|
EmptyColumnsCount() |
| Optional: |
|
DuplicatedRowCount() |
| Optional: |
|
DuplicatedColumnsCount() |
| Optional: |
|
DatasetMissingValueCount() |
| Required:
|
|
AlmostConstantColumnsCount() |
| Optional: |
|
ColumnsWithMissingValuesCount() |
| Optional: |
|
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
DataDriftPreset() |
| Optional:
|
|
DriftedColumnsCount() |
| Optional:
|
|
ValueDrift() |
| Required:
|
|
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
ClassificationPreset() |
| Optional: probas_threshold . | As in individual Metrics. |
ClassificationQuality() |
| Optional: probas_threshold | As in individual Metrics. |
Accuracy() |
| Optional: |
|
Precision() |
| Required:
|
|
Recall() |
| Required:
|
|
F1Score() |
| Required:
|
|
TPR() |
| Required:
|
|
TNR() |
| Required:
|
|
FPR() |
| Required:
|
|
FNR() |
| Required:
|
|
LogLoss() |
| Required:
|
|
RocAUC() |
| Required:
|
|
Dummy model quality
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
ClassificationDummyQuality() |
| N/A | N/A |
DummyPrecision() |
| N/A | N/A |
DummyRecall() |
| N/A | N/A |
DummyF1() |
| N/A | N/A |
Metric | Description | Parameters | Test Defaults | |
---|---|---|---|---|
ClassificationQualityByLabel() |
| None | As in individual Metrics. | |
PrecisionByLabel() |
| Optional:
|
| |
F1ByLabel() |
| Optional:
|
| |
RecallByLabel() |
| Optional:
|
| |
RocAUCByLabel() |
| Optional:
|
|
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
RegressionPreset |
| None. | As in individual metrics. |
RegressionQuality |
| None. | As in individual metrics. |
MeanError() |
| Required:
|
|
MAE() |
| Required:
|
|
RMSE() |
| Optional: |
|
MAPE() |
| Required:
|
|
R2Score() |
| Optional: |
|
AbsMaxError() |
| Optional: |
|
Dummy model quality
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
RegressionDummyQuality() |
| N/A | N/A |
DummyMeanError() |
| N/A | N/A |
DummyMAE() |
| N/A | N/A |
DummyMAPE() |
| N/A | N/A |
DummyRMSE() |
| N/A | N/A |
DummyR2() |
| N/A | N/A |
Metric | Description | Parameters | Test Defaults |
---|---|---|---|
RecallTopK() |
| Required:
|
|
FBetaTopK() |
| Required:
|
|
PrecisionTopK() |
| Required:
|
|
MAP() |
| Required:
|
|
NDCG() |
| Required:
|
|
MRR() |
| Required:
|
|
HitRate() |
| Required:
|
|
ScoreDistribution() |
| Required:
|
|