Speaking after talks in Muscat, Zarif and Omani Foreign Minister Yusuf bin Alawi also announced the two had agreed to demarcate a previously undefined stretch of maritime border, in waters including some of the world's busiest sea lanes.
On Yemen, Zarif said they discussed implementing a ceasefire, setting up talks between warring factions and how to get aid in.
"Iran and Oman want peace, security and stability in the region and have shared interests in this regard," Zarif emphasized.
Oman, which borders Yemen, is the only one of the six Gulf Arab states that make up the Gulf Co-operation Council (GCC) not to join Saudi Arabia's military campaign against Yemeni people.
Iranian and Omani news agencies reported that the countries had demarcated a 450 km (280 mile) section of their maritime border that had not previously been defined, in the first substantial progress on the issue since 1975.
"This agreement will strengthen economic relations between our two countries," bin Alawi announced.