The idea to rename all "module_testsuite"s to "testsuite" might not have been so bright an idea after all. The reason being, that VPATH includes "../.." in all modules (I'm not sure why though, is it really necessary?) which means the module testsuites aren't being rebuilt due to "testsuite" already being "up to date" because of ../../testsuite.