diff --git a/tests/end2end/data/hints/number.html b/tests/end2end/data/hints/number.html
index 61a71c805..60f8bde19 100644
--- a/tests/end2end/data/hints/number.html
+++ b/tests/end2end/data/hints/number.html
@@ -13,6 +13,7 @@
Related issues:
- #308 - Renumber hints when filtering them in number mode.
+ - #576 - Keep hint filtering when rapid hinting in number mode
diff --git a/tests/end2end/features/hints.feature b/tests/end2end/features/hints.feature
index 331d70a64..7e5e8458f 100644
--- a/tests/end2end/features/hints.feature
+++ b/tests/end2end/features/hints.feature
@@ -177,3 +177,14 @@ Feature: Using hints
And I press the key "s"
And I run :follow-hint 1
Then data/numbers/7.txt should be loaded
+
+ # https://github.com/The-Compiler/qutebrowser/issues/576
+ Scenario: Keeping hint filter in rapid mode
+ When I open data/hints/number.html
+ And I set hints -> mode to number
+ And I run :hint all tab-bg --rapid
+ And I press the key "t"
+ And I run :follow-hint 0
+ And I run :follow-hint 1
+ Then data/numbers/2.txt should be loaded
+ And data/numbers/3.txt should be loaded
diff --git a/tests/manual/hints/issue576.html b/tests/manual/hints/issue576.html
deleted file mode 100644
index 942db1ade..000000000
--- a/tests/manual/hints/issue576.html
+++ /dev/null
@@ -1,27 +0,0 @@
-
-
-
-
- Issue 186
-
-
-
- This page contains several hints to test filtering with rapid hints, see #576.
-
-
-
- This requires setting hints -> mode to number, and hints -> scatter to false.
-
-
-
- When pressing ;r, t, and then following a hint, the "one" link should
- not get a hint.
-
-
-
-
-