Ok. I am actually try to simulate Hybrid-DFE, where the feedforward filter is implemented in frequency domain, while the feedback filter is implemented in time domain. Now, I have gFB, GFB=fft([1 gFB]), GFF, and yFF, where {gFB},{GFB} are the feedback coefficients in the time and frequency domain respectively, {GFF} are the frequency domain coefficients of the feedforward filter, and {yFF} is the time domain output of the feedforward filter. Now I try to do the feedback filtering as:
y=yFF+filter([1 gFB],1,s);
where {s} are the previous decisions. But I got non-smooth results even at high number of bits. Is my approach correct? I mean the feedback filter, and the GFB transformation of gFB?
Thanks in advance