We spend too much time at work to be forever miserable. Part of your process should be to reflect on what you want personally and professionally.
Don't give up on your dreams any more than you give in to flights of fancy.
Being realistic doesn't mean you can't change your reality though. Changing jobs is as good a time as any for making other life changes. Do it!