evidently.test_preset
Predefined Test Presets for Test Suite
class BinaryClassificationTestPreset(stattest: Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None, stattest_threshold: Optional[float] = None, probas_threshold: Optional[float] = None)
Bases:
TestPreset
Binary Classification Tests. :param stattest: statistical test for target drift test. :param stattest_threshold: threshold for statistical test for target drift test. :param probas_threshold: threshold for label calculation for prediction.
Contains:
- TestColumnValueDrift for target
- TestPrecisionScore
- TestRecallScore
- TestF1Score
- TestAccuracyScore
class BinaryClassificationTopKTestPreset(k: Union[float, int], stattest: Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None, stattest_threshold: Optional[float] = None)
Bases:
TestPreset
Binary Classification Tests for Top K threshold. :param stattest: stattest for TestColumnDrift :param stattest_threshold: threshold for stattest
Contains:
- TestColumnDrift for target
- TestPrecisionScore
- TestRecallScore
- TestF1Score
- TestAccuracyScore
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
stattest_threshold : Optional[float]
Bases:
TestPreset
Data Drift tests.
Contains tests:
- TestShareOfDriftedColumns
- TestColumnValueDrift
- TestAllFeaturesValueDrift
cat_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
cat_stattest_threshold : Optional[float]
columns : Optional[List[str]]
drift_share : Optional[float]
num_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
num_stattest_threshold : Optional[float]
per_column_stattest : Optional[Dict[str, Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]]
per_column_stattest_threshold : Optional[Dict[str, float]]
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
stattest_threshold : Optional[float]
Bases:
TestPreset
Data Quality tests.
Contains tests:
- TestAllColumnsShareOfMissingValues
- TestAllColumnsMostCommonValueShare
- TestNumberOfConstantColumns
- TestNumberOfDuplicatedColumns
- TestNumberOfDuplicatedRows
- TestHighlyCorrelatedColumns
columns : Optional[List[str]]
Bases:
TestPreset
Data Stability tests.
Contains tests:
- TestNumberOfRows
- TestNumberOfColumns
- TestColumnsType
- TestAllColumnsShareOfMissingValues
- TestNumColumnsOutOfRangeValues
- TestCatColumnsOutOfListValues
- TestNumColumnsMeanInNSigmas
columns : Optional[List[str]]
class MulticlassClassificationTestPreset(stattest: Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None, stattest_threshold: Optional[float] = None)
Bases:
TestPreset
Multiclass Classification tests.
- Parameters
stattest
– statistical test for target drift test.stattest_threshold
– threshold for statistical test for target drift test.
Contains tests:
- TestAccuracyScore
- TestF1Score
- TestPrecisionByClass for each class in data
- TestRecallByClass for each class in data
- TestNumberOfRows
- TestColumnValueDrift
- TestRocAuc
- TestLogLoss
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
stattest_threshold : Optional[float]
Bases:
TestPreset
No Target Performance tests.
- Parameters
columns
– list of columns include to tests
Contains tests:
- TestColumnValueDrift
- TestShareOfDriftedColumns
- TestColumnsType
- TestAllColumnsShareOfMissingValues
- TestNumColumnsOutOfRangeValues
- TestCatColumnsOutOfListValues
- TestNumColumnsMeanInNSigmas
- TestCustomFeaturesValueDrift
cat_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None
cat_stattest_threshold : Optional[float] = None
columns : Optional[List[str]]
drift_share : Optional[float]
num_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None
num_stattest_threshold : Optional[float] = None
per_column_stattest : Optional[Dict[str, Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]] = None
per_column_stattest_threshold : Optional[Dict[str, float]] = None
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None
stattest_threshold : Optional[float] = None
Bases:
TestPreset
Regression performance tests.
Contains tests:
- TestValueMeanError
- TestValueMAE
- TestValueRMSE
- TestValueMAPE
class BinaryClassificationTestPreset(stattest: Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None, stattest_threshold: Optional[float] = None, probas_threshold: Optional[float] = None)
Bases:
TestPreset
Binary Classification Tests. :param stattest: statistical test for target drift test. :param stattest_threshold: threshold for statistical test for target drift test. :param probas_threshold: threshold for label calculation for prediction.
Contains:
- TestColumnValueDrift for target
- TestPrecisionScore
- TestRecallScore
- TestF1Score
- TestAccuracyScore
class BinaryClassificationTopKTestPreset(k: Union[float, int], stattest: Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None, stattest_threshold: Optional[float] = None)
Bases:
TestPreset
Binary Classification Tests for Top K threshold. :param stattest: stattest for TestColumnDrift :param stattest_threshold: threshold for stattest
Contains:
- TestColumnDrift for target
- TestPrecisionScore
- TestRecallScore
- TestF1Score
- TestAccuracyScore
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
stattest_threshold : Optional[float]
class MulticlassClassificationTestPreset(stattest: Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None, stattest_threshold: Optional[float] = None)
Bases:
TestPreset
Multiclass Classification tests.
- Parameters
stattest
– statistical test for target drift test.stattest_threshold
– threshold for statistical test for target drift test.
Contains tests:
- TestAccuracyScore
- TestF1Score
- TestPrecisionByClass for each class in data
- TestRecallByClass for each class in data
- TestNumberOfRows
- TestColumnValueDrift
- TestRocAuc
- TestLogLoss
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
stattest_threshold : Optional[float]
Bases:
TestPreset
Data Drift tests.
Contains tests:
- TestShareOfDriftedColumns
- TestColumnValueDrift
- TestAllFeaturesValueDrift
cat_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
cat_stattest_threshold : Optional[float]
columns : Optional[List[str]]
drift_share : Optional[float]
num_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
num_stattest_threshold : Optional[float]
per_column_stattest : Optional[Dict[str, Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]]
per_column_stattest_threshold : Optional[Dict[str, float]]
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]
stattest_threshold : Optional[float]
Bases:
TestPreset
Data Quality tests.
Contains tests:
- TestAllColumnsShareOfMissingValues
- TestAllColumnsMostCommonValueShare
- TestNumberOfConstantColumns
- TestNumberOfDuplicatedColumns
- TestNumberOfDuplicatedRows
- TestHighlyCorrelatedColumns
columns : Optional[List[str]]
Bases:
TestPreset
Data Stability tests.
Contains tests:
- TestNumberOfRows
- TestNumberOfColumns
- TestColumnsType
- TestAllColumnsShareOfMissingValues
- TestNumColumnsOutOfRangeValues
- TestCatColumnsOutOfListValues
- TestNumColumnsMeanInNSigmas
columns : Optional[List[str]]
Bases:
TestPreset
No Target Performance tests.
- Parameters
columns
– list of columns include to tests
Contains tests:
- TestColumnValueDrift
- TestShareOfDriftedColumns
- TestColumnsType
- TestAllColumnsShareOfMissingValues
- TestNumColumnsOutOfRangeValues
- TestCatColumnsOutOfListValues
- TestNumColumnsMeanInNSigmas
- TestCustomFeaturesValueDrift
cat_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None
cat_stattest_threshold : Optional[float] = None
columns : Optional[List[str]]
drift_share : Optional[float]
num_stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None
num_stattest_threshold : Optional[float] = None
per_column_stattest : Optional[Dict[str, Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]]] = None
per_column_stattest_threshold : Optional[Dict[str, float]] = None
stattest : Optional[Union[str, Callable[[Series, Series, str, float], Tuple[float, bool]], StatTest]] = None
stattest_threshold : Optional[float] = None
Bases:
TestPreset
Regression performance tests.
Contains tests:
- TestValueMeanError
- TestValueMAE
- TestValueRMSE
- TestValueMAPE
Bases:
object
Last modified 9mo ago