Data Privacy

With a mission to ensure consumers are able to be confident in the AI applications they interact with, the team at Confident AI takes data security way more seriously than anyone else.

Your Privacy Using deepeval

By default, deepeval uses PostHog to track only very basic telemetry data. Specifically, the following is collected:

• Event names (e.g. evaluation started/completed)
• Metric names used
• Whether the evaluation is running in a Jupyter notebook
• A randomly generated anonymous UUID (no user or company identity)
• Public IP address (used only for coarse regional analytics)

Personally identifiable information is explicitly excluded. You can opt out of all telemetry at any time:

export DEEPEVAL_TELEMETRY_OPT_OUT=1

PostHog is the only place this data goes. deepeval does not report crashes or exceptions anywhere.

Your Privacy Using Confident AI

All data sent to Confident AI is securely stored in databases within our private cloud hosted on AWS (unless your organization is on the VIP plan). Your organization is the sole entity that can access the data you store.

We understand that there might still be concerns regarding data security from a compliance point of view. For enhanced security and features, consider upgrading your membership here.