Woman winds up on an island who's residents are frozen in time

This is part of a series and I cannot remember the title or author. There is an island full of magic users that have been frozen in time. They tried to freeze an evil chaos wizard to prevent a major spell being cast but he remained free and everyone else is frozen. The woman is adrift in the ocean and taken to the island by a sea animal.
That's "The Outcast", the middle book of Louise Cooper's Time Master trilogy. Although Tarod is a more sympathetic character than the "evil chaos wizard" description implies.

Seconding that this is Louise Cooper's The Outcast, book 2 in the Time Master trilogy.