Scales can be a problem. Dormant oil will control overwintering stages. Crawlers are controlled with sprays of Sevin or Orthene.
Sassafras weevil adult feeds on buds as they are breaking, and before the leaves have expanded, resulting in holes in the leaves. The larvae mine the leaves causing brown areas. No chemical control is listed.