Does it matter where you to college?

Well I want to major in computer science and I do want to go to MIT or Carnegie Mellon also, but I’m saving those schools for grad school. Will it still matter where I went to college if I want to go to those kind of universities to get a Masters or PhD?