He couldn't do such a thing in all conscience.
I couldn't do such a wicked thing in all conscience.
We cannot in all conscience refuse to help.
He did poorly in English in all conscience.