<p>More Knuth here, and some other authors, on the distinction between "exercises" (which everyone needs some minimum number of, to learn math) and "problems" (which no one can ever get too many of, to REALLY learn math): </p>
<pre><code>"It is perhaps pertinent to make a comment or two here about the problems of the text. There is a distinction between what may be called a PROBLEM and what may be considered an EXERCISE. The latter serves to drill a student in some technique or procedure, and requires little, if any, original thought. Thus, after a student beginning algebra has encountered the quadratic formula, he should undoubtedly be given a set of exercises in the form of specific quadratic equations to be solved by the newly acquired tool. The working of these exercises will help clinch his grasp of the formula and will assure his ability to use the formula. An exercise, then, can always be done with reasonable dispatch and with a minimum of creative thinking. In contrast to an exercise, a problem, if it is a good one for its level, should require thought on the part of the student. The student must devise strategic attacks, some of which may fail, others of which may partially or completely carry him through. He may need to look up some procedure or some associated material in texts, so that he can push his plan through. Having successfully solved a problem, the student should consider it to see if he can devise a different and perhaps better solution. He should look for further deductions, generalizations, applications, and allied results. In short, he should live with the thing for a time, and examine it carefully in all lights. To be suitable, a problem must be such that the student cannot solve it immediately. One does not complain about a problem being too difficult, but rather too easy."
"It is impossible to overstate the importance of problems in mathematics. It is by means of of problems that mathematics develops and actually lifts itself by its own bootstraps. Every research article, every doctoral thesis, every new discovery in mathematics, results from an attempt to solve some problem. The posing of appropriate problems, then, appears to be a very suitable way to introduce the student to mathematical research. And it is worth noting, the more problems one plays with, the more problems one may be able to pose on one's own. The ability to propose significant problems is one requirement to be a creative mathematician."
</code></pre>
<p>Eves, Howard (1963). A Survey of Geometry volume 1. Boston: Allyn and Bacon, page ix.</p>
<pre><code>"Before going any further, let's digress a minute to discuss different levels of problems that might appear in a book about mathematics:
</code></pre>
<p>Level 1. Given an explicit object x and an explicit property P(x), prove that P(x) is true. . . .</p>
<p>Level 2. Given an explicit set X and an explicit property P(x), prove that P(x) is true for FOR ALL x [existing in] X. . . .</p>
<p>Level 3. Given an explicit set X and an explicit property P(x), prove OR DISPROVE that P(x) is true for for all x [existing in] X. . . .</p>
<p>Level 4. Given an explicit set X and an explicit property P(x), find a NECESSARY AND SUFFICIENT CONDITION Q(x) that P(x) is true. . . .</p>
<p>Level 5. Given an explicit set X, find an INTERESTING PROPERTY P(x) of its elements. Now we're in the scary domain of pure research, where students might think that total chaos reigns. This is real mathematics. Authors of textbooks rarely dare to pose level 5 problems."</p>
<p>Graham, Ronald, Knuth, Donald, and Patashnik, Oren (1994). Concrete Mathematics Second Edition. Boston: Addison-Wesley, pages 72-73.</p>
<pre><code>"First, what is a PROBLEM? We distinguish between PROBLEMS and EXERCISES. An exercise is a question that you know how to resolve immediately. Whether you get it right or not depends on how expertly you apply specific techniques, but you don't need to puzzle out what techniques to use. In contrast, a problem demands much thought and resourcefulness before the right approach is found. . . .
"A good problem is mysterious and interesting. It is mysterious, because at first you don't know how to solve it. If it is not interesting, you won't think about it much. If it is interesting, though, you will want to put a lot of time and effort into understanding it."
</code></pre>
<p>Zeitz, Paul (1999). The Art and Craft of Problem Solving. New York: Wiley, pages 3 and 4.</p>
<pre><code>". . . . As Paul Halmos said, 'Problems are the heart of mathematics,' so we should 'emphasize them more and more in the classroom, in seminars, and in the books and articles we write, to train our students to be better problem-posers and problem-solvers than we are.'
"The problems we have selected are definitely not exercises. Our definition of an exercise is that you look at it and know immediately how to complete it. It is just a question of doing the work, whereas by a problem, we mean a more intricate question for which at first one has probably no clue to how to approach it, but by perseverance and inspired effort one can transform it into a sequence of exercises."
</code></pre>
<p>Andreescu, Titu & Gelca, Razvan (2000), Mathematical Olympiad Challenges. Boston: Birkhäuser, page xiii.</p>