There's another assasin in town. I forget names at this point, but he's in the lower part of the town more towards the west, in a house. He asks you to kill the one you found hiding in a cellar.
If you killed him before talking to the first one, I'm not sure you'll even get the quest. Try an earlier save?