diff --git a/tests/end2end/features/downloads.feature b/tests/end2end/features/downloads.feature
index fbda16e54..b914de1e1 100644
--- a/tests/end2end/features/downloads.feature
+++ b/tests/end2end/features/downloads.feature
@@ -3,6 +3,7 @@ Feature: Downloading things from a website.
     Background:
         Given I set up a temporary download dir
         And I clean old downloads
+        And I set ui -> remove-finished-downloads to -1
 
     ## starting downloads