If I understand you correctly, you want to continue playing on PC with your current console savegame and use mods. That should work, but it probably won't be possible the other way around. This is due to mods that are not available for the console. There are good reasons why it is pointed out in multiplayer games with cross-platforms that everyone must have the
same mod version. Based on this, it will most likely be the same in the single player.