Bumping this thread since I have the same problems that have been described by the other people in here, specifically oxa1900's first post. I'm hoping this will receive due attention as it is preventing me from really enjoying the game when I'm constantly being taken out of it by annoying performance issues.
My system specs:
i5 3570k @ 3.2 Ghz
8 GB RAM
HD 7950 3GB
Game usually runs at 60 on auto-detected ultra settings but in some spots on the map the game just seems to eat my CPU and I lose 15-20 fps. It can go from 60 to 45 in places like the beach where you fight the turtles at the start of fort Joy or the square where you meet Ifan.
If I turn shadows off completely (gives me a big ~20 FPS boost) the problem of huge, seemingly random framerate drops persists. Things like micro-stutter when rotating the camera are also a bit of a nuisance.
TL;DR: Can manage +60 FPS through lower settings, but it won't ever stay there due to random 15-20 FPS drops in certain places. Please fix if possible.