Window will roll down but won't go back up

Window will roll down but won't go back up I done tested motor and if I reverse polarity it will roll up so I changed the switches. Both driver side and passenger still gives me same problem someone gimme advice