diff --git a/tests/end2end/features/hints.feature b/tests/end2end/features/hints.feature
index 6f05b7d6b..fe3ba056f 100644
--- a/tests/end2end/features/hints.feature
+++ b/tests/end2end/features/hints.feature
@@ -184,6 +184,15 @@ Feature: Using hints
         Then the error "Not enough words in the dictionary." should be shown
         And data/numbers/5.txt should be loaded
 
+    Scenario: Dictionary file does not exist
+        When I open data/hints/html/simple.html
+        And I set hints -> dictionary to no_words
+        And I set hints -> mode to word
+        And I run :hint
+        And I press the key "a"
+        Then the error "Word hints requires reading the file at *" should be shown
+        And data/hello.txt should be loaded
+
     ### Number hint mode
 
     # https://github.com/The-Compiler/qutebrowser/issues/308