The imps at the beginning have resistance to physical damage types. That means that the 6 you are hitting for is halved into 3. If you made it off the boat and you're still having an issue than it may be bugged.