Integrating trusted datasets into your ML workflows

The following short video demo shows how to integrate proprietary datasets listed on the Valyu Exchange into your ML workflows seamlessly

Spoiler Alert 🚨 - it is super simple...

Check out the notebook for yourself here!


The Valyu SDK allows you to seamlessly integrate proprietary data sources into your existing AI/ML workflows. To make the process even more user-friendly, we have modelled our dataset loader after the Hugging Face SDK, so you can use the methods you already know and love.

Here's how to get started:

  1. Generate an API Key: Once granted access to a dataset, navigate to My Hub and generate an API key. Be sure to store it securely, as it will not be visible again.

  2. Fetch the Dataset Identifier: Go to the dataset and obtain the dataset identifier from the URL. (It is of the form {organisation_id}/{dataset_name})

  3. Load the Dataset: Use your API key and dataset identifier with the load_dataset method to retrieve the dataset.

Our SDK places a strong emphasis on type annotation, to ensure the best possible developer experience for our users.

If you have any feedback please reach out to us at contact@valyu.network, or on X..We'd love to hear from you!

Last updated