Hurricane Rafael will start its steady weakening the next few days. The rare November hurricane will linger through the weekend.