diff --git a/tests/end2end/features/downloads.feature b/tests/end2end/features/downloads.feature
index b16340594..7bde58b4f 100644
--- a/tests/end2end/features/downloads.feature
+++ b/tests/end2end/features/downloads.feature
@@ -92,6 +92,8 @@ Feature: Downloading things from a website.
         And I run :leave-mode
         Then no crash should happen
 
+    # https://github.com/qutebrowser/qutebrowser/issues/4240
+    @qt!=5.11.2
     Scenario: Downloading with SSL errors (issue 1413)
         When SSL is supported
         And I clear SSL errors