Blue key goes to the blue door in the mystery house in the crows nest, however once you get to one of the end chests in that house you can lock pick all adjacent doors to get all the other chests with high enough lockpick skills