Mr Hunt told the BBC the British-Iranian pair's return to the UK last week was an "extraordinary achievement" but it should have happened faster.
He called for an independent inquiry into the issue.
Ms Zaghari-Ratcliffe spent six years in detention on spying charges.
She was visiting her parents in Iran when she was arrested and has always denied the allegations.
Mr Ashoori, who was released at the same time, spent almost five years in detention on spying charges, which he also denied.