Quantum key agreement (QKA) is an important cryptographic primitive that plays a pivotal role in private communications. Authenticated QKA plays an important role in QKA. In this paper, we propose an authenticated multiparty QKA scheme based on 4-qubit cluster states entanglement swapping. The scheme is divided into two parts, the first part is the quantum identity authentication stage, and the second part is the QKA stage. In the quantum identity authentication stage, the participants determine that the participant communicating with them is the claimed person through mutual authentication, which can avoid the impersonation attack of the eavesdropper Eve. In the QKA phase, the participants adopt a bidirectional transmission structure with the participation of a semi-trusted third party, and based on the entanglement swapping property of the 4-qubit cluster state, the QKA is finally realized. Detailed security analysis shows that the protocol can resist a variety of internal and external attacks, such as participants attack, entangle-measure attack, and so on.