This paper shows how to address issues with high memory consumption and latency by taking a streaming approach to pipeline component development.
Download Link: http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=bb88dafd-9bba-4d6b-b276-cd7e205f8896