Late to the party, but I brought bottles
I'd been procrastinating at looking at Dist::Zilla, but I thought I'd have a go with it this week.
And as usual I found some yaks to shave on my travels.
After much gnashing of teeth and hair-pulling I've eventually released Dist::Zilla::Plugin::AssertOS to CPAN.
Closely followed by Dist::Zilla::Plugin::NoAutomatedTesting.
Both these demonstrate a slightly dubious mechanism for manipulating the dzil generated Makefile.PL. You might want Dist::Zilla::Plugin::MakeMaker::Awesome instead.