What is your overall GPA now? If it is not in the range or close to the range of accepted students at Yale, then yes, it will be difficult to get in even with an upward trend. However, the GPA is only one aspect of an application. How are your extracurricular activities and standardized testing score?