The man is reported to have collapsed at the entrance to Rabbi Nachman's burial site in front of his children.
This is the second arrest of an ultra-orthodox Jew in Uman in two days.
The Ukrainian Embassy in Israel also took this as an opportunity to take aim at Israel for its recent filmmaking agreement with Russia.
Ahead of Rosh Hashanah Israelis take trains from Poland to reach Uman in Ukraine.
The PM warned Israelis trying to go to Uman for Rosh Hashanah that it is dangerous and God hasn't always protected the Jews in Ukraine.
The government emphasized the fact that the plan was being set in motion to avoid a crisis like last year that left many stuck for hours or even a day on Ukraine's border.
DIASPORA AFFAIRS: Spending Rosh Hashanah at Rabbi Nachman’s grave holds deep spiritual significance for those who make the journey and more tangible rewards for the residents of Uman.
Jerusalem Affairs and Jewish Tradition Minister Meir Porush has appealed to the prime minister to help avoid a humanitarian crisis in Uman.