Drag & drop the song title over the Trash smart playlist to remove it from the main song library.

You can also Control + Click on the title to delete it.