For some reason the behaviour of QHostAddress("31c3").isValid() changed with Qt 5.6.1: https://bugreports.qt.io/browse/QTBUG-53983 This causes the test to fail because Qt thinks this is a valid IP, so we think it's a valid URL.