That question requires a very complicated answer.
Theoretically the sway bars only work while the car is swaying to one side. You turn left your car will roll right. your outside suspension compression and your sway bar compresses the inside suspension to keep the car flat/level through a turn.
This video explains it well: http://www.youtube.com/watch?v=_liGnV3PTiQ
Basically if your car isn't swaying left or right, then they are doing much. So bumps from pot holes won't change because of a sway bar. This is going be affected more by changing springs, shocks and tires.
your ride comfort won't suffer, at least not noticeably. your handling will be more balanced and that is a good thing.