To avoid disrupting existing workflows, the dialog is only shown when
overwrite is disabled. If there is no UI, then it will be assumed that
the file is not overwritten.