The Notarial Office(NO), working on providing various essential certificates, still relies on manual handling and requires paper materials from other government departments. That brings lots of inconvenience. The Notarial Office rejects non-local paper materials for their lower credibility in the local place and then cannot provide cross-border services. It also easily causes sensitive information leakage as copies of paper materials have been stored. In this case, a blockchain-based system is suitable to address challenges in this scenario because of its advantages (e.g, decentralized, immutability, transparency, auditability). We implemented this system on top of the Hyperledger Fabric. Moreover, we replace manual operations with smart contracts, set extra ledgers to off-load different types of transactions and provide encryption for private information when needed. In the end, we get the expected result. That is, the modification outperformed the unmodified network in experiments.