I think you get various signals superimposed on ECG signals due to breathing and movement. The filtering should remove most of it. I don't know how you chose the filtering (or the opamps, which are not really the right ones for the job and will inject noise into the leg connection) but I suggest you read some more data sheets and application notes about ECG. At ECG frequencies I would expect low flicker noise to be an important opamp parameter.