In this work, we study a hybrid high‐order (HHO) method for an elliptic diffusion problem with Neumann boundary condition. The proposed method has several features, such as: (a) the support of arbitrary approximation order polynomial at mesh elements and faces on polytopal meshes, (b) the design of a local (element‐wise) potential reconstruction operator and a local stabilization term, that weakly enforces the matching between local element‐ and face‐based on degrees of freedom, and (c) cheap computational cost, thanks to static condensation and compact stencil. We prove the well‐posedness of our HHO formulation, and obtain the optimal error estimates, according to previous study. Implementation aspects are thoroughly discussed. Finally, some numerical examples are provided, which are in agreement with our theoretical results.