How can I stop a listing from appearing on all websites?

Once the listing has been marked as settled you will need to follow the steps to make the listing "Withdrawn"

Go to your property and on the front page click the "withdrawn" button on the status bar.