Data Privacy

With a mission to ensure consumers are able to be confident in the AI applications they interact with, the team at Confident AI takes data security way more seriously than anyone else.

Your Privacy Using deepeval

By default, deepeval uses PostHog to track only very basic telemetry data. Specifically, the following is collected:

• Event names (e.g. evaluation started/completed)
• Metric names used
• Whether the evaluation is running in a Jupyter notebook
• A randomly generated anonymous UUID (no user or company identity)
• Public IP address (used only for coarse regional analytics)

Personally identifiable information is explicitly excluded. You can opt out of all telemetry at any time:

export DEEPEVAL_TELEMETRY_OPT_OUT=1

deepeval also uses Sentry to capture errors and exceptions raised within the package, only if you have explicitly opted in. No user or company data is collected through Sentry. To help us catch bugs for future releases, set the ERROR_REPORTING environment variable to 1:

export ERROR_REPORTING=1

Your Privacy Using Confident AI

All data sent to Confident AI is securely stored in databases within our private cloud hosted on AWS (unless your organization is on the VIP plan). Your organization is the sole entity that can access the data you store.

We understand that there might still be concerns regarding data security from a compliance point of view. For enhanced security and features, consider upgrading your membership here.