OVERWINTERING ROSEMARY, INSIDE AND OUT Written by: Giordano's Gift & Garden | October 21, 2016 Can I keep my rosemary plant happy all winter? This question comes up every fall. The easy answer is, “You can try.” There are also things you can do to improve your chances of success with keeping rosemary over the winter.