One of the protesters can be seen in a video brandishing a flag over his head while a call of “free, free Palestine” can be heard.
In response, the delegation sought assistance at the local police station.
On Sunday, separate rallies to free the 240 people Hamas is holding hostage and to call for a ceasefire drew thousands of people in Sydney.
The Wall, which is located on the exterior of the Beth Weizmann Jewish Community Center in Melbourne, was only unveiled last Friday.
I did it for them, but if I let myself, even now, think of the humiliation I suffered at that clique of upper-class Jewish girls, tears come to my eyes.
The man, a self-proclaimed "Nazi", followed the students off the bus and continued to shout antisemitic obscenities at them.
Organizers have promoted the event on social media, inviting members of the wider national community to "celebrate the movement's exponential growth."
Transgender rights activists clashed with neo-Nazis in Melbourne after an anti-transgender activist sought to address supporters at the parliament building.