Jonathan Edwards seeks to answer this question. His (I believe, biblical) response is so foreign to the pragmatism of our day. In short, his answer is this:

"...such as are in profession, and in the eye of the church's Christian judgment, godly or gracious persons." (Works, Vol. 1, p. 434).

Amen.