I don't exactly understand the intended sensor geometry from your drawing. Generally, dust can be measured optically. If your setup is actually sensitive enough is a different question.
I think scattering is a better measurement method than reflection, a modulated LED current source would allow a suppression of enviromental light and easy amplification of received signal, also short wavelength light can be expected to give a higher sensitivity for fine particles than IR.