Can we issue financial credit note against non-payment by recipient of goods to save at least income tax?

Yes, for income tax, instead of issuing financial credit note, one can simply write off the balance. He will get requisite income tax deduction without effecting any implications under GST.