Thank you Timothy; I've moved your comment here for better context.
I'd wondered if William Yerbury, the first husband of Elizabeth, was the hymn writer (https://www.brethrenarchive.org/people/hymn-writers/w-yerbury-d-1863/) but all acounts suggest he died in 1863. However it seems quite a coincidence, so who knows.
For a while he was also in partnership with Thomas Cheverton.
In fact E.E. Crocker published "Hymns and Poems for Believers" by W. Yerbury in 1863,
So surely this must be the same person, and the 1863 date of Yerbury is a mistake, probably copied from the date of publication of this book?
Would be good to get a scan of the poetry book too.