If you’d like to delete a Gallery from your collection, you can do this by selecting the Gallery and clicking the button "Edit details" on the right hand side of the screen. Once you have done this, a pop-up window will appear where you can select "Delete this Gallery" at the bottom.
Please keep in mind, once a Gallery has been deleted you will not be able to restore it later.