Buffer has larger area, because the output cascade of the buffer is the inverter (which has the same size as inverter cell with the same drive strength). So, total area of the buffer is output_inverter_area PLUS input inverter (which are smaller, than output inv).