Stolen horse, what to do?

You created this problem by taking it into your own hands rather than contacting the proper legal authorities. While I do agree the horse likely needed help committing a crime to do so is not the answer. You do need to get in contact with the proper authorities about this problem. There isn't much else to do. Next time don't steal a horse.