Reference page for all row-level text and LLM evals.
Name | Description | Parameters |
---|---|---|
ExactMatch() |
| Required:
|
RegExp() |
| Required:
|
BeginsWith() |
| Required:
|
EndsWith() |
| Required:
|
Name | Description | Parameters |
---|---|---|
Contains() |
| Required:
|
DoesNotContain() |
| Required:
|
IncludesWords() |
| Required:
|
ExcludesWords() |
| Required:
|
ItemMatch() |
| Required:
|
ItemNoMatch() |
| Required:
|
WordMatch() |
| Required:
|
WordNoMatch() |
| Required:
|
ContainsLink() |
| Optional:
|
Name | Description | Parameters |
---|---|---|
IsValidJSON() |
| Optional:
|
JSONSchemaMatch() |
| Required:
|
JSONMatch() |
| Required:
|
IsValidPython() |
| Optional:
|
IsValidSQL() |
| Optional:
|
Name | Descriptor | Parameters |
---|---|---|
TextLength() |
| Optional:
|
OOVWordsPercentage() |
| Optional:
|
NonLetterCharacterPercentage() |
| Optional:
|
SentenceCount() |
| Optional:
|
WordCount() |
| Optional:
|
Name | Descriptor | Parameters |
---|---|---|
CustomDescriptor() |
| Optional:
|
CustomColumnsDescriptor() |
| Optional:
|
Name | Descriptor | Parameters |
---|---|---|
LLMEval() |
| Optional:
|
Name | Descriptor | Parameters |
---|---|---|
ContextQualityLLMEval() |
| Required:
|
ContextRelevance() |
| Required:
|
FaithfulnessLLMEval() |
| Required:
|
CompletenessLLMEval() |
| Required:
|
Name | Descriptor | Parameters |
---|---|---|
CorrectnessLLMEval() |
| Required:
|
DeclineLLMEval() |
| Optional:
|
PIILLMEval() |
| Optional:
|
NegativityLLMEval() |
| Optional:
|
BiasLLMEval() |
| Optional:
|
ToxicityLLMEval() |
| Optional:
|
Name | Descriptor | Parameters |
---|---|---|
SemanticSimilarity() |
| Required:
|
BERTScore() |
| Required:
|
Sentiment() |
| Optional:
|
HuggingFace() |
| Optional:
|
HuggingFaceToxicity() |
| Optional:
|