"He told me that in countries such as (Iran), these things take a bit of time."
The Iranian group OpenStadiums, which is campaigning for the right of women to attend sports fixtures in the Islamic Republic, said that some women were arrested near Azadi stadium on Thursday during the Esteghlal-Persepolis match.
"When Mr. Infantino was enjoying a football match in men-only stadium, Iranian female football fans were under arrest," the group said on Twitter.
The semi-official Iranian students news agency ISNA quoted Interior Ministry spokesman Salman Samani as saying the female fans were not arrested but rather transferred to a "proper place" by police.
Infantino said he was aware of criticism of his visit but felt it was better to engage in dialogue with Iranian leaders.
"I heard there were some incidents where some women were detained because they wanted to attend a football match and there was some criticism, obviously and rightly," he said.
"There are two ways to deal with this matter - either we criticise, we sanction, we condemn, we don´t speak and we cut relations. Or we go there and have a discussion and try to convince the leaders of the country that they should give (women) access to stadiums . I went for the second option."
There was no immediate Iranian comment on Infantino´s remarks.
Rouhani´s office denied reports on Thursday that the ban on women attending matches had already been lifted.
The country has long barred women from attending male soccer matches, based at least partly on the theory that women should not hear male fans swear and curse.
Iranian women are allowed to attend female football matches.