Does NHS auto clean the database so that previous URIs that don't work or get "no post forms found etc" don't get retried or is there some sort of automatic threshold; ie "retry http://... 3 times and then remove it".
If not it would be a great option to have, something like:
1. Remove URIs that return "no post forms found" automatically
2. Remove sites that don't seem to work after [INPUT FIELD] retries