Looks like there must have been a bug in iOS or watchOS but iOS 9.3 and watchOS 2.2 have fixed any Apple Watch slowness and made it very snappy again!
Lyoko37 about Duo Mobile