Visitation and moving to different county. I am non custodial parent..?

The other parent told me he could keep me from moving? I live in Virginia. I am not moving out of state. Can he stop me? My visitation not gonna change besides the weekday visits. I will still get weekend? Help the other parent tries to control my whole life just because of our son.