The work that I want to use in my book is out of print, does that mean that it is no longer protected by copyright?

Being out of print has no bearing on the copyright status of a work; the time limits and fair use exemption still need to be applied.