You can delete a dataset or multiple datasets at any time by clicking the dataset(s) checkbox.
And then clicking the Delete Items Button.
You can also delete Image Sets in the same way.