diff --git a/CONTRIBUTING.asciidoc b/CONTRIBUTING.asciidoc
index e12d9cb9a..e240015ce 100644
--- a/CONTRIBUTING.asciidoc
+++ b/CONTRIBUTING.asciidoc
@@ -638,6 +638,7 @@ New PyQt release
 * See above
 * Install new PyQt in Windows VM (32- and 64-bit)
 * Download new installer and update PyQt installer path in `ci_install.py`.
+* Update `tox.ini`/`.travis.yml`/`.appveyor.yml` to test new versions
 
 qutebrowser release
 ~~~~~~~~~~~~~~~~~~~