Do people ume that asians have it easier getting into college?

I can't help but get annoyed when many ppl (esp whites) ume that we have it easier than them getting into top colleges just because we're a minority. They say that even though we do not get affirmative action, there are more whites in those universities than asians. Have they considered the fact that we make up about 4% of the population but about 20% of Ivy Leagues? Obviously proportion will come into play. Also, i looked at statistics for a university where the average asian to be accepted had a 3.7 gpa while the average white had 3.6.