Patch Notes

New charts, bugfixes, accessibility. Secret work behind the scenes. Don't tell anyone…

• Summer is starting to be over in Finland. Rains are coming.

• Pipeline node actions!
• Pipeline task parameter-parameter edges!!
• Performance improvements!!!
• Bugfixes.

This time it's mostly bugfixes… and some usability and performance improvements too.

• Datum aliases were added!
• Datum adoption was added!
• Bugs were fixed!
• Hosted Notebooks were removed, mostly!

• Data management improvements
• Execution pinning
• Bugfixes and polish and optimization and polysyndeton

Many things to do and see! And some bugfixes.

• Parameter interpolation in input URIs
• Task detail tabs
• Task node outputs
• Datum tagging
• Bugfixes
• Fine-tuning
• Coarse tuning

Sparklines, task nodes, spot instances, STS roles, bugfixes.

A hecking chonker of a change log! The highlights:

• Partial pipelines!
• Early stop for executions!
• Deployment dashboard improvements!
• Fix the bug!

• Task early stop conditions
• Read-only projects
• Improved output purging
• Organization embetterage
• Bugfixes, as usual!

• Project copying
• Pipeline parameter-parameter edges
• Deployment improvements
• Credit card bugfixes 🤑

• Deployment monitoring!
• User interface improvements!
• Bugfixes!
• Exclamation marks! (This is the third time I've said that! It's the charm!)

A little holiday update with a couple bugfixes and some usability improvements.

• Triggers!
• UI clarity!
• Small bug fixes!

• More exposed run metadata!
• Datum search by wildcard!
• Robustness! As usual!

A new version on Friday the 13th, what could go wrong?!

• Pipeline deployment improvements
• Bugfixes

• Deployments in pipelines!
• Environment variables in deployments!
• Fun times for the whole family!

• Usability improvements with new action buttons.
• API now publishes multi-execution event streams and task execution counts.
• And bugfixes, too!

• Custom S3 store endpoints!
• Data table UI polish!
• Minor bugfixes!

• Deployment, task and pipeline polish
• The usual smattering of bugfixes

• OpenAPI!
• Task statuses in the API!
• Quality of life improvements!

• Cloud storage for certain preferences
• Chart, tracing and deployment bugfixes
• API improvements

• Private AWS ECR and Google Cloud Container Registry support
• Assign default store for your organization
• Pipeline design revamp initial steps

• Share stores across organizations!
• Keep directory structures for wildcard inputs!
• Speed boosts!
• Usability fixes!
• It's really hot in here, why am I writing patch notes and not being outside?!

• Private Docker registries for deployment image building
• Bugfixes and accessibility improvements

Lots of bugfixes, and some changes to deployment prefixes.

• Bayesian optimization improvements and bugfixes

• Data management related bugfixes and improvements.

Small bugfixes and some deployment scrutability improvements.

• The triumphant return of the execution outputs endpoint!
• Some bugfixes.

Totally not April Fools!

• Notifications!
• Nicer commit referencing!
• Execution time limits!
• Deployment polish!
• … and other bugfixes

Socially isolated bugfixes! #COVID19

• Environment and deployment management improvements
• Bugfixes here and there

• Bayesian hyperparameter optimization!
• Deployment memory requests!
• Agent updates!

• Input selection embetterments!
• Random Search tasks!
• Less annoying notifications!

Thanks to the holidays and everything, not much more than usability fixes and bugfixes this time! A little polish never hurts, though, right?

• Execution Alerts!
• Bugfixes!

• Refreshed organization and profile views
• Bugfixes

• Improved onboarding experience
• A new template project by Hugging Face
• Little bugfixes

• Additional enterprise features like project ownership control
• API token management improvements
• Bug-swatting, as usual

• Enterprise goodness edition!
• Team Access Grants!
• Azure AD Login!

Usability and performance improvements, new CLI version.

• Better UX and more control over package contents in Jupyhai
• A cornucopia of bug fixes and optimizations, as well as Hard Stop for executions.

• Logs shown in your local time zone.
• Allow copying executions into tasks.
• Continued pipeline improvements like deletion and better error messages on invalid pipelines.
• And other minor improvements.

• Pipelines are in open beta now!
• Data heritage view!
• API call view!
• Scatter charts!
• A bunch of bugfixes!
• #hashtags!
• Exclamation marks!

• New CLI version!
• Jupyter Notebook previews!
• Robustness! Stability! Checksums!

• Some little bugfixes and a some quality-of-life improvements, plus some new features bubbling under.

• Some little bugfixes, a sprinkling little quality-of-life improvements, a handful of new features.
  What's not to like?

Just a small bugfix release to make your Friday a little brighter.

• Quality-of-life improvements
• Metadata, parameters and input information available in /valohai/config
• Input data tracking
• A bunch of small bugfixes
• Happy Midsummer!

• Improved execution log filtering using | syntax
• Improved and more accurate Valohai API documentation
• Remove length limit from project repository reference to better allow multiple branches in a project

• Support for enormous amounts of execution output files
• Support for execution output files with very long names
• Read-only and write-only data stores

• Support for new CUDA images (e.g. Tensorflow 1.13.x)
• Various platform Quality of Life improvements and bugfixes
• New Valohai command-line client version

• Ad-hoc execution copying
• Error codes in API responses

• New tutorial experience
• Commit handling improvements
• Metadata and parameter formatting and sorting fixes

• Private Docker images
• Metadata comparison
• Bugfixes and performance improvements

• Improved Swift support
• Quality-of-life improvements
• Minor bugfixes

• Execution and task re-titling
• Nicer input editing
• Repository URL buttons
• Deployment traceability
• Execution copy bugfix

• Task copying
• Execution table improvements
• Metadata chart improvements
• Team/organization membership improvements
• OpenSSH format key support

• Organization invitation system
• User experience improvements

• Style refresh
• Metadata chart improvements and bugfixes
• A plethora of other small quality of life improvements

• Superpowered chart views!
• Wildcards and URI resolution for custom data stores!
• OpenStack Swift data storage support!
• Bugfixes and polish!
• Happy holidays!

• Allow enforcing two-factor authentication.
• New project dashboard view.
• Technical environmental variable view.
• Native Google Storage support.

• Two-factor authentication with TOTP
• Allow writing notes to tasks
• Improved autoscaling logic

• Random hyperparameter optimization
• More user-friendly execution/task creation

• Improved execution tagging system that now also covers tasks.
• We provide suggestions for execution Docker images.
• Metadata charts now properly show zero values.

• Error codes from executions are now handled correctly.
• Small UI polish and quality-of-life improvements in many places.

• Built-in environment variable support.
• Step inputs can now have descriptions.
• Improved Create Execution and Create Task layouts.

• Organizations!
• Nicer invoices!
• Project transfers!
• Exclamation marks!

• Improvements to the execution view page.
• Executions and tasks can be titled.
• Repositories no longer require valohai.yaml.
• Billing is available in EUR too.
• New parameter and parameter-value interpolations in addition to parameters.
• More useful data is printed at start of execution.
• Valohai-CLI was updated.
• It's hot in Turku, Finland.

• Layout changes, project header should now be more clear on all projects.
• You can now easily preview image output files on web interface.
• Kubernetes deployment test view supports image responses for more streamlined testing.

• New usage and bill estimation page.
• Momentarily losing server connection won't hide logs on execution page.

• Execution metadata charts are lazy-loaded.
• Data browser will now correctly refresh available files after upload.
• Convert all frontend code to TypeScript.

• Add deployment endpoint test UI with optional drag and drop image payload.
• Internal crash reporting now includes user contact information.

• Non-integer number values for parameters and metadata are rounded.
• Allow ordering executions by parameter.
• Removed Promise.finally() usage that caused Linux browsers to crash on execution creation.

• Shell variable syntax ${foo} is now supported within commands.
• Stores can now be deleted.

• Improvements to metadata and log views.
• Custom S3 stores no longer require the Multipart IAM Upload Role field.
• Retry functionality in the frontend now works better.

• Kubernetes deployment feature in beta for Early Adopter users.
• Improve task detail view layout.
• Hide purged files when selecting execution inputs.

• Allow downloading execution logs through the web client.
• Show execution durations in more human-readable format.
• Command-line client properly hides deleted executions.

• Show parameters of individual executions in the execution list on task page of the web client.
• Rename execution "Discussion" feature to "Notes" to clarify what it should be used for.

• Allow specifying multiple input files per execution input.
• Allow searching input files by the execution number that generated the data.
• Improve the layout of execution and task lists on the web client.

• Use S3 multipart upload to allow output files up to 5 terabytes.
• Add logarithmic hyperparameter optimization.

• Don't upload output directory files that start with a dot.
• Allow executions to upload files in the middle of their run aka. "live upload."

• Make it more comfortable to select machine type on the command-line client.
• Add credit system to the billing.
• Improve accuracy of execution duration calculations.
• Empty lines on hyperparameter optimization parameters are now ignored.

• Add execution tagging system.
• Allow users to download files through web client data browser.
• Show which machine type was used for an execution in the web client.
• Uploading won't overwrite an already existing S3 files.

• Add GitHub App integration to streamline onboarding of new users.
• Allow users to delete executions and uploaded files through the web client.
• Using custom Docker image will now start on the first try.

• Disallow copying of ad-hoc executions.
• Improve error reporting on git repository fetch errors for support.
• Load long executions logs without lagging the web client.

• Release the example project for R.
• Limit how many previous commit versions to show in execution create page dropdown.
• Avoid executions from entering eternal stopping limbo.

• Allow hyperparameter optimization of flag parameter type.
• Custom stores can now be uploaded to.
• Limit how many log events are shown in the web client.
• Resign uploaded input file credentials before queueing an execution that uses then.

• Valohai platform is now out of beta!
• Add store system to allow customized download endpoints.
• Rework the usage flow how to define existing files as inputs to executions.

• Add user profile page.
• Rework how real-time statistics are displayed.

• Add support for non-GPU instances.
• Improve how fast execution status updates.
• Allow collaborators to see input and output files of projects they have been invited.

• Allow uploading input files to S3 stores with the web client.
• Allow short hash for commit selection in API and the command-line client.
• Implement per-user quota to restrict how much a single user can run in the shared clusters.

• Add pagination support for task executions list page.
• Show more detailed resource usage by project and by hardware type used for billing.
• Make worker infrastructure clean up cached content more rigorously.
• Navigate straight to the execution logs screen after execution creation.

• Improve project to repository linking user flow.
• Improve AWS cluster downscaling as workloads can drop from hundreds of parallel executions to just zero in mere minutes.
• Show more obvious error when the command-line client is used to start executions on a project without a linked repository.

• Add hyperparameter optimization and tasks.
• Allow project collaborators also see and use on-premises hardware.
• Add local directory mount as an input method for on-premises workers.

• Web client graphics are now served from a CDN for better speed.
• Stop canceled executions more gracefully.

• Allow users to select which type of AWS instances to run their execution on, not just g2.
• Stopped executions should not be picked again by Valohai workers.

• Parameters passed to the worker nodes are now properly quoted.

• Release beta version of the Valohai machine learning platform for early access.
• Add login, billing, project, repository and execution management systems.