You should slowly increase dex for archers yes. 7 or 8 is just for the first few levels. Youll need more later. And invest in the weapon skill, bow for example, since that makes a difference in mid and late game.
Speed is more important then con, especially for those who stay away in a fight.
Youll find plenty of equipment that boost any of those stats too so you will be able to combine.
Actually, there is no need to be completely min-maxed and have super focused perfect builds.
Unless you really get off on that and want to do it.
Im not sure what you mean by the last sentence, speed gives you more APs and you dont need that to "start getting dex-int-str". The system doesnt work that way. Speed gives more Aps and thats it. Con affects the ... maximum number, but thats not that important as Speed is.
Its not a requirement for other attributes which you will increase by leveling up or from equipment.
Just relax, play on and slowly build your characters.
Its fine.