There are lot of archers, but I cannot say they are too difficult. I cleared up two fortresses so far.
If I had a criticism toward fortresses, it would be that they are too expansive and there are many of them, similar in design. They are not as bad as Oblivion gates, but they are not the most interesting locations either.
