How to capture LLM inputs and outputs and evaluate them.
address
is the destination backend to store collected traces.
Project_id
is the ID of the Evidently Project you just created. Go to the Home page, enter the Project and copy its ID from above the dashboard.
Dataset_name
helps identify the resulting Tracing dataset. All data with the same ID is grouped into a single dataset.
create_trace_event
from Tracely
to trace the execution of the function and treat each as a separate session. This loops through the list of questions, captures input arguments and outputs and sends the data to Evidently Cloud: