kartothek.io_components.index module

kartothek.io_components.index.update_indices_from_partitions(partition_list, dataset_metadata_factory)[source]

This takes indices from a partition list and overwrites all indices in the dataset metadata provided by the dataset metadata factory. The same is done in the store dataset part. This is used in an additional build index step (by the build_dataset_indices__pipeline) which should be used after updating partitions of a dataset.