Blog / Valohai's Audit Log: Traceability built for AI governance
Valohai's Audit Log: Traceability built for AI governance

Valohai's Audit Log: Traceability built for AI governance

by Tarek Oraby | on November 06, 2024

In the world of AI and ML development, accountability and traceability are no longer just best practices—they're essential. With regulations like the EU AI Act putting the spotlight on AI governance, organizations must demonstrate control over their AI development and deployment pipelines.

Valohai's new Audit Log feature directly addresses these needs by providing data science teams with the tools to track, manage, and review every action within their AI/ML operations.

The view of the Audit Log in the Valohai MLOps platform

Why audit logging matters for AI

Audit logs play a critical role in AI and ML projects. They provide a detailed, immutable record of all key activities across projects—who did what, when, and where—ensuring transparency at every step.

As AI continues to be subject to more regulations, like the EU AI Act, organizations need to have mechanisms in place that allow them to trace the origins of their models and ensure their development adheres to compliance requirements.

Audit logs help organizations:

  • Ensure compliance: For regulated industries, having a verifiable history of all actions related to AI projects is a must. Audit logs act as an evidence trail, critical for compliance audits and legal investigations.
  • Debug issues: When something goes wrong, you need to know exactly what actions were taken and by whom. Audit logs give you the ability to pinpoint the source of an issue quickly and with clarity.
  • Maintain accountability: In large teams, it's essential to know who is responsible for each change. Audit logs provide a clear picture of individual contributions and actions across your organization.

What Valohai's Audit Log offers

Valohai is an end-to-end MLOps platform, and with the new Audit Log feature, it builds on that foundation by offering a ready-to-use solution for traceability. No setup is required. The feature works out of the box and integrates seamlessly with your existing workflows. Here's what you can expect:

1. Comprehensive event tracking

Valohai's audit logs capture all relevant activities, including data access, ML job executions, pipeline runs, dataset changes, and model-related actions like approvals and rejections. Each log entry provides essential details:

  • Who performed the action
  • What action was taken
  • When it happened
  • Where the action originated (e.g., IP address and system details)

For example, if a model version is rejected or a pipeline is started, Valohai logs this with full traceability. This ensures that all significant activities are accounted for, no matter where or when they occurred.

2. Immutability and security

Audit logs in Valohai are immutable, ensuring that once an event is logged, it cannot be altered or deleted. This safeguards the integrity of the log and ensures that you always have an accurate and unchangeable record of all actions. Sensitive information like IP addresses are also protected—only organization admins have access to these logs, providing an additional layer of security.

3. Searchable and exportable

The audit logs are designed for accessibility and ease of use. With the ability to filter events by date range, project, or model, you can quickly zero in on the information you need. You can also export logs to a CSV format, enabling you to integrate them into your reporting or audit processes effortlessly.

4. Retention for compliance

Valohai retains audit logs for a minimum of 180 days, ensuring that you have a comprehensive record of all activities over an extended period.

5. Visibility where it matters

Audit logs are available under the organization dashboard, as well as from Valohai's Model Hub, making them easily accessible without disrupting your workflows. Users can view all activity tied to specific models directly from the Model Hub, ensuring that every model has a clear history of changes.

The view of audit events for a spcific model in the Valohai MLOps platform

Built for compliance in a regulated world

As AI governance evolves, so do the requirements placed on companies developing and deploying AI. Valohai’s Audit Log empowers organizations to meet these demands by providing a comprehensive, immutable, and accessible record of all actions across AI and ML projects.

Whether you’re navigating compliance requirements like the EU AI Act, debugging issues, or ensuring accountability within your team, Valohai’s Audit Log delivers the transparency and control you need—right out of the box.

If you want to learn more about the new audit logging feature or need help getting started, feel free to check out our detailed documentation or chat with our Customer Team!

Free eBookPractical MLOpsHow to get started with MLOps?