Baseball use to be Americas "past time." It has it's popular areas in the US, but it has taken a hit in popularity over the years. When teams are bad, and there seems to be way more bad teams then good teams, no one cares about those teams. Brewers were getting all the hype when Braun was using PEDs now you don't here much about them, Pittsburgh was a joke until the last two years.
Soccer is the most popular sport in the world, yet it is the 5th most popular in the US.