Calculating relevant entropic quantities of probability distributions and quantum states is a fundamental task in information processing. The decision problem version of estimating the Shannon entropy is the Entropy Difference problem (ED): given descriptions of two circuits, determine which circuit produces more entropy in its output when acting on a uniformly random input. The analogous problem with quantum circuits (QED) is to determine which circuit produces the state with greater von Neumann entropy, when acting on a fixed input state and after tracing out part of the output. Based on plausible complexity-theoretic assumptions, both of these problems are believed to be intractable for polynomial-time quantum computation.In this paper, we investigate the hardness of these problems in the case where the circuits under consideration have logarithmic (ED log and QED log ) and constant depth (ED O(1) and QED O(1) ), respectively. We first show that, relative to an oracle, these problems cannot be as hard as their counterparts with polynomial-size circuits. Furthermore, we show that if a certain type of reduction from QED to QED log exists, it implies that any polynomial-time quantum computation can be performed in log depth. While this suggests that having shallow circuits makes entropy estimation easier, we give indication that the problem remains intractable for polynomial-time quantum computation by proving a reduction from Learning-With-Errors (LWE) to ED O(1) .We then consider a potential application of our results to quantum gravity research via the AdS/CFT correspondence. First, we introduce HQED, a Hamiltonian version of QED, where one is given two local Hamiltonians and asked to estimate the entanglement entropy difference in their ground states. We show that this problem is at least as hard as the circuit version by providing a reduction from QED to HQED. With these results, we then discuss a potential experiment that would make use of AdS/CFT in order to solve LWE efficiently. We conjecture that unless the AdS/CFT bulk to boundary map is exponentially complex, this experiment would violate the intractability assumption of LWE.