Without proper caching, having a large number of poorly optimized plugins can really impact both the server, and the page generation times.

URL: http://www.dev4press.com/2011/blog/benchmark/measuring-impact-of-plugins-on-wordpress-loading/