The new era of technology is a rollback in which massive information comes from interconnected devices. These types of things that have Internet connectivity are called the Internet of Things (IoT). IoT and its applications have enabled novel service provisioning, whereas at the same time it has raised complex challenges of managing such network. Resource limitation such as computational power and energy limitation defines the characteristics of IoT that require a novel design of management framework. Designing a management framework that meets the IoT requirements is a daunting task. Recently, Software-Defined Networking (SDN) paradigm has eased the management of traditional Internet by provisioning centralized view of the network. This makes SDN a potential candidate for managing IoT. However, traditional design of the SDN paradigm needs to be redefined to adapt it for the IoT. Hence, in this paper, we have discussed trends and research of management architecture for IoT based on Software-Defined Networking principles. In addition, we discuss non-SDN-based approaches. In this paper, we compare all of the efforts in the last five years in addressing issues of IoT management that involves security service provisioning, fault tolerance, energy management, and load balancing. We also discuss future research directions that evolved from our detailed survey and taxonomy of the Software-Defined IoT (SDIoT) management frameworks.