Privacy Policy

1. What we collect

• Account data — name, email, GitHub username when you sign up
• Usage data — eval run metadata (package name, model, score, timestamp)
• Published packages — eval suites you publish to the registry
• Technical logs — server logs for debugging and security

2. What we do NOT collect

• Your LLM API keys — all model calls use your own keys locally (BYOK)
• The content of your model prompts or responses
• Payment card details — EvalKit does not collect card details during free early access

3. How we use data

• To operate the registry and dashboard
• To generate the public leaderboard (only if you opt in)
• To send transactional emails about your account
• To improve the platform

4. Leaderboard and public data

Eval run results are private by default. You can opt in to share results on the public leaderboard. Shared results include: package name, model name, score, and date. No prompt or response content is ever shared.

5. Third-party services

• Clerk — authentication
• Cloudflare — storage and CDN
• Sentry — error tracking

Each service has its own privacy policy and data handling practices.

6. Data retention

Account data is retained while your account is active. You can request deletion at any time. Deleted accounts have their personal data removed within 30 days. Published packages may remain in the registry unless explicitly unpublished.

7. Your rights

• Access the data we hold about you
• Request correction of inaccurate data
• Request deletion of your account and data
• Export your run history

8. Contact

Privacy questions or data requests: contact email coming soon.