You should focus on what’s important to the success of your character early on, in terms of your skills and the perks you choose.
Your character’s progression is tied to your INT so don’t knee-cap yourself. First off, Fallout is fairly forgiving, but you gotta go high Intelligence.