Simple supply and demand. If the Fed buys Treasury paper it is increasing demand for it, and in holding it decreases supply. That, in turn, raises the price, which lowers rates. Mortgages, as one example, are closely linked to Treasury rates, so you get consumer and business rates dropping. At the same time, as you've indicated, in purchasing the debt the Fed is putting more cash into the system.