Skip to content

DataSet.to_ray_dataset

This will convert the Quokka Dataset to a Ray Dataset. This is a blocking call. It will NOT move data to your local machine.

Return

Ray Dataset

Source code in pyquokka/quokka_dataset.py 
50
51
52
53
54
55
56
57
58
def to_ray_dataset(self):

    """
    This will convert the Quokka Dataset to a Ray Dataset. This is a blocking call. It will NOT move data to your local machine.

    Return:
        Ray Dataset
    """
    return ray.data.from_arrow_refs(self.to_arrow_refs())