We probably can! However, we might choose not to since we try to have a good enough and maintainable set of Metrics and Tests. That is a delicate balance!
You might be using an older Evidently version. Starting from version 0.3.2, all visualizations in Reports are aggregated by default. This helps reduce the size of the resulting HTML. You can choose to include raw data if you prefer this. In this case, you might want to use a sampling strategy for your dataset, for instance, random sampling or stratified sampling.
If your dataset is too large, you can define a sampling strategy.
We plan to add support for distributed computation in the later version.