Test::More has lots of crazy new development that's breaking my modules
I still wish we had a way to remove reports from CPAN Testers. The case of a broken Test::More is a really good reason for this.
I received many fail reports for Business::ISBN, which I've been working on lately. However, it's from a test I hadn't touched for things I wasn't working on.
The failure looked odd. I've never heard of
Modification of non-creatable array value attempted, subscript -1 at .../Test/More/DeepCheck.pm line 82.
Then I noticed that all of the fail reports reported the same development version of
build_requires: Module Need Have -------------------- -------- ------------ ExtUtils::MakeMaker 0 6.99_14 Test::More 0.95 1.301001_045
There are a few other bad tests for things happening in v5.21, but for the most part I get the black eye on MetaCPAN or CPAN Search from the CPAN Testers using a bad version of
Test::More. It happens. Schwern once said that he could break all of CPAN.
The problem, though, is not a broken Test::More but a development version of one that we don't trust yet. I know that Andreas and Slaven want to test everything, but perhaps these sorts of tests don't need to go to CPAN Testers. In the last month I've spent a couple hours tracking down problems that weren't anything to do with anything I did and with what I think is some overzealous new development in
Test::More. If you want to write a better
is_deeply, make a separate module and let people play with it.
Fortunately, normal users won't have this broken
Test::More. Unfortunately, they still get to see the red bars for my module.