If you believe that standing in the presence of annoying people is having your "rights infringed", then we cannot move further with the discussion.
if one group is impeding the ability of another to assemble and express their views freely and peacefully then I see that as a problem...can't they have their demonstration an hour later? an hour before?