In this paper, we introduce the notion of second and higher-order granular differentiability for fuzzy number-valued functions. A weighted granular metric is defined for continuously granular differentiable mappings and proves that it is a complete metric space. Fuzzy initial value problems are investigated for second and higher-order fuzzy differential equations under granular differentiability. Sufficient conditions are established for the existence and uniqueness of solutions for the fuzzy initial value problems. An algorithm is developed to determine the solution to the fuzzy initial value problem under granular differentiability. Moreover, examples are presented to verify our theoretical results and algorithm.