Without Kurama, Naruto still carries the large chakra reserves of his family from being Minato Namikaze's son. He would be nowhere as overpowered as he would be during the Shinobi War, but still powerful enough to pose a threat to most shinobi thanks to Sage Mode, Shadow Clones and Rasengan variants.
Still that being said, I'd likely give this match to Jiraiya after a difficult match. The Sannin has more battle experience and a more diverse arsenal of jutsu he could rely upon in various battle scenarios, which more than make up for his imperfect version of Sage Mode. While Naruto is surprisingly crafty in battle with what limited jutsu he knows, his limited arsenal still makes him predictable in battle to those familiar with his style of fighting, which Jiraiya would know very well from having trained the boy between the timeskip. Rasenshuriken would pose the biggest threat to Jiraiya as its speed and destructive ability (while Naruto is in Sage Mode) would be more than capable of dispatching the Toad Sage. But six times out of ten, I'd favor Jiraiya winning here.