Normally put a deadband on the PID driving the damper. Something like 5% of the current setpoint which typically keeps it from chasing the noise. If that's not enough, sometimes I'll use an exponential filter to smooth it out a bit. Don't normally need that though.
Any VAV controller that has a rock steady airflow reading is doing some sort of filtering in the background.