The propagation of linear and nonlinear electrostatic waves is investigated in magnetized dusty plasma with stationary negatively or positively charged dust, cold mobile ions and non-extensive electrons. Two normal modes are predicted in the linear regime, whose characteristics are investigated parametrically, focusing on the effect of electrons non-extensivity, dust charge polarity, concentration of dust and magnetic field strength. Using the reductive perturbation technique, a Zakharov-Kuznetsov (ZK) type equation is derived which governs the dynamics of small-amplitude solitary waves in magnetized dusty plasma. The properties of the solitary wave structures are analyzed numerically with the system parameters i.e. electrons non-extensivity, concentration of dust, polarity of dust and magnetic field strength. Following Allen and Rowlands (J. Plasma Phys. 53:63, 1995), we have shown that the pulse soliton solution of the ZK equation is unstable, and have analytically traced the dependence of the instability growth rate on the nonextensive parameter q for electrons, dust charge polarity and magnetic field strength. The results should be useful for understanding the nonlinear propagation of DIA solitary waves in laboratory and space plasmas.