I’ve had this happen too. I would take the site down. If the students are allowed to leave after they finish the exam (which is typical), it can be difficult to figure out afterwards which students are accessing the site during the exam in order to cheat and which simply accessed the site to check their answers after turning in the exam.
If you leave it up, I recommend writing the time of submission on each exam, which is a good practice to do anyway.