Here's an interesting post on the differences between closing vs. deleting a web part. Deleting web parts from your page can improve response times. You should not have more than 50 web parts on a page although I would scale that back a lot more.