A lot of Samsung / Pixel watches’ users have the same issue. It seems that the watch does not fully wake up the watchface engine.
This has been reported to google, who confirmed this is a firmware issue. It is being fixed on their side.
You can check more information HERE