Different coverage percentage from XCode report

[domenicontt]

Hi Team,
The report generated by slather provides coverage percentages that are far different from those provided by XCode. For many swift classes that have 100% coverage with XCode, slather reports zero coverage.
Any suggestions to solve this problem?
Thanks!

[jarrodlombardo-EventBase]

Need more details. Is Slather printing any warnings or errors when you run it?

[domenicontt]

Hi, sorry for the lack of details in the previous comment. During slather running I don't have any errors or warnings. My project uses XCode 15.2 and Swift 5.
Thanks!

[jarrodlombardo-EventBase]

Still not enough details for me to investigate anything. Can you copy the log from XCode that does code coverage and also the log from your slather run?

[victor-livefront]

FWIW I've also seen inconsistencies between what Slather is reporting vs what Xcode is reporting. I was seeing partial coverage on a few files not being reported. Played around with my slather configuration for a little bit, but didn't have any luck. To circumvent the issue, I moved our CI coverage reporting over to Xcov from Slather, and the reporting is now 1-1 with Xcode. Here's a screen shot of an example of what wasn't covered (just the initializer in this file, everything else was covered). Didn't see any warnings or errors in the console when generating Slather reports. We're also on Xcode 15.2 now, but we've been seeing the problem for a few months and also used Xcode 15.0.

[may246]

@victor-livefront Hey Victor, appreciate hearing about what your team has been seeing. Do you happen to have an example of how you got Xcov working for CI coverage reporting? We're seeing similar discrepancies between Xcode vs Slather (even with Xcode 16) and are interested in trying Xcov as an alternative.

[victor-livefront]

@victor-livefront Hey Victor, appreciate hearing about what your team has been seeing. Do you happen to have an example of how you got Xcov working for CI coverage reporting? We're seeing similar discrepancies between Xcode vs Slather (even with Xcode 16) and are interested in trying Xcov as an alternative.

We were using Danger plugins. The example I mentioned above was not using the plugin, but slather directly to make sure it wasn't the plugin's fault. The slather plugin uses slather under the hood. In my Dangerfile, I simply swapped the slather plugin for the Xcov plugin. The parameters were nearly the same.