Why do scratches and spots come back when I click OK?

I'm in CS3 and retouching a lot of very old photos. When I use the Dust and Scratches filter and preview the work, the image looks much improved. When I click on OK, a lot of the blemishes come right back.

Any help or suggestions?

Vaughn

Make sure the image and the preview are both at 100%.