This seems pretty punitive, considering the poorest in society need the money immediately, not as a lump sum refund once per year.

Here (Australia) the tax free threshold is baked into your tax withholding amount.