For decades, these gatherings brought together Americans from the left and right and all pastures in between