In the geometrically frustrated materials with the low-dimensional and small spin moment, the quantum fluctuation could interfere with the complicated interplay of the spin, electron, lattice and orbital interactions, and host exotic ground states such as nematic spin-state and chiral liquid phase. While the quantum phases of the one-dimensional chain and S -½ twodimensional triangular-lattice antiferromagnet (TLAF) had been more thoroughly investigated by both theorists and experimentalists, the work on S = 1 TLAF has been limited. We induced the lattice distortion into the TLAFs, A3NiNb2O9 (A = Ba, Sr, and Ca) with S (Ni 2+ ) = 1, and applied the thermodynamic, magnetic and neutron scattering measurements. Although A3NiNb2O9 kept the non-collinear 120° antiferromagnetic phase as the ground state, the Ni 2+ -lattice changed from the equilateral triangle (A = Ba) into isosceles triangle (A = Sr and Ca). The inelastic neutron scattering data were simulated by the linear spin-wave theory, and the competition between the single-ion anisotropy and the exchange anisotropy from the distorted lattice was discussed.
I.
INTRODUCTIONIn the geometrically frustrated system, the complicated interaction(s) between electron, phonon, spin and orbital could lead to degenerate ground states, which introduce exotic properties and attracted a lot attention over the past decades [1][2][3]. Meanwhile, those degenerate states would easily be held by the symmetrical inconsistency and be destroyed by significant quantum fluctuations, not only induced by the complicated interactions among low dimensionality, geometrical frustration, small spin and the applied magnetic field, but also modified the classical Heisenberg model [4][5]. The triangular-lattice antiferromagnet (TLAF), one of the simplest frustrated two-dimensional (2D) material, had been suggested to be strongly influenced by the strong quantum spin fluctuations with small effective spin (S = 1/2 or 1) and exhibited a rich variety of interesting physics [6][7][8].A striking example of these quantum phenomena is the transition from a non-collinear 120° spin configuration at 0 T into fractional-magnet lattice under a finite range of applied magnetic field, such as a collinear up-up-down (uud) phase corresponding to a magnetization plateau with one-third of its saturation value [9][10][11][12][13].Recently, the theoretical research indicated the uud state as a commensurate analogue of the incommensurate spin-density-wave which was predicted and observed for frustrated one-dimensional spin-1 chains and S = ½ TLAF [14, 15], and suggested the possibility for exotic magnetic excitations. While there was an enormous theoretical activity in the domain, a full consensus on the origin of the uud state, (even the ground magnetic state, non-collinear 120 o at zero field) was limited. This is true as well for the state-of-the art experimental investigation of its spin excitations due to the lack of a triangular-lattice materials. Although the lattice distortion has been believed to influence t...