wp sites and memory use on servers

my VPS server company says my WP sites is hogging the memory, i have few sites built and hosted by us. They are asking me to do a cache on the site so the CPU/memory is not eating up. Any hints/posts on how to optimize sites to use less memory?

please let me know, i am desperate for a solution so i dont have to pay extra $100 per month on VPS upgrade.