Nickolas Kieth Smith, 32 of Rome, was arrested after reports said he broke into a home of a woman that had a protective order against him.
Police added that Smith became aggressive once inside the home and in front of a small child.
The incident occurred at a home on Westlyn Court on June 10 of this year.
Smith is charged with first degree burglary, cruelty to children and aggravated stalking.