Everything dropped down into the water will move in its own way.
A bare jig will move a little, a jig with a spike or rubber grub will move more.
The swivel, although designed to eliminate line twist, is more geared towards open water trolling and cast-retrieves.
You drop any lure down an ice hole, and it WILL spin. and when you reel it back up it WILL spin again! It's the laws of nature at work.
Water resistance causes lure movement, which is why a spoon flutter, spinning blades spin, and buzz baits buzz.
A swivel will only eliminate so much of the spin (line twist).
The only true way to prevent it is to lower your lure very slowly, which would be counter-productive when you spend most of your time just lowering your lures.