Use caulk or weather stripping to seal up any air leaks from window frames, baseboards, electrical outlet and switch plates, wall- or window-mounted air conditioners, and other openings, such as pipes and wiring coming through ceilings, floors, and walls.