Select the images in Lightroom, and then use the Library > Previews > Discard Smart Previews menu.
The actual smart preview files are stored in a folder next to your catalogue file. You can delete the entire folder (using Explorer or Finder) if you want, but you won't be able to figure out how individual smart preview files correspond to photos in the catalogue.