diff --git a/tests/end2end/data/hints/issue1186.html b/tests/end2end/data/hints/issue1186.html
new file mode 100644
index 000000000..adf4fe155
--- /dev/null
+++ b/tests/end2end/data/hints/issue1186.html
@@ -0,0 +1,35 @@
+
+
+
+
+ Issue 1186
+
+
+
+ This page contains 10 hints to test backspace handling, see #1186.
+
+
+
+ This requires setting hints -> mode to number, and hints -> scatter to false.
+
+
+
+ When pressing f, x, 0, Backspace, only hints starting with x should be
+ shown.
+
+
+
+
diff --git a/tests/end2end/features/hints.feature b/tests/end2end/features/hints.feature
index 7e5e8458f..9f288e525 100644
--- a/tests/end2end/features/hints.feature
+++ b/tests/end2end/features/hints.feature
@@ -188,3 +188,15 @@ Feature: Using hints
And I run :follow-hint 1
Then data/numbers/2.txt should be loaded
And data/numbers/3.txt should be loaded
+
+ # https://github.com/The-Compiler/qutebrowser/issues/1186
+ Scenario: Keeping hints filter when using backspace
+ When I open data/hints/issue1186.html
+ And I set hints -> mode to number
+ And I set hints -> scatter to false
+ And I run :hint all
+ And I press the key "x"
+ And I press the key "0"
+ And I press the key ""
+ And I run :follow-hint 11
+ Then the error "No hint 11!" should be shown
diff --git a/tests/manual/hints/issue1186.html b/tests/manual/hints/issue1186.html
deleted file mode 100644
index c1202e3b0..000000000
--- a/tests/manual/hints/issue1186.html
+++ /dev/null
@@ -1,33 +0,0 @@
-
-
-
-
- Issue 1186
-
-
-
- This page contains 10 hints to test backspace handling, see #1186.
-
-
-
- This requires setting hints -> mode to number, and hints -> scatter to false.
-
-
-
- When pressing f, t, 0, Backspace, only hints starting with t should be
- shown.
-
-
-
-