Just got a bug where the time weaver is hostile towards me even though I haven't done anything. Can't escape either since there's no portal in sight to run to...
Try taking the teleporter back to the observatory. Someone else reported that after doing so and returning the weaver was no longer hostile.