Illegal, unreported, and unregulated (IUU) fishing is a major concern in fisheries management around the world. Several measures have been taken to address the problem. In Lake Victoria, the alleviation of IUU fishing is implemented through the Regional Plan of Action (RPOA-IUU), which restricts use of certain fishing gear, as well as prohibits fishing in closed areas and during closed seasons. Despite the long-term efforts to monitor and control what goes on in the fisheries, IUU fishing has persisted in Lake Victoria. Inspired by interactive governance theory, this paper argues that the persistence of IUU fishing could be due to different images that stakeholders have about the situation, rather than the lack of management competency. Through structured interviews with 150 fisheries stakeholders on Ijinga Island in the southeastern part of Lake Victoria, Tanzania, using paired comparison questionnaires, the study elicits stakeholders' perspective about the severity of different locally-pertinent fishing-related activities. The results show that while fisheries stakeholder groups agree on their judgments about certain fishing gears, some differences are also apparent. For instance, fisheries managers and scientists do not always agree with fishing people about what activities cause the most damage to fisheries resources and ecosystem. Further, they tend to consider some IUU fishing-related activities less damaging than some non-IUU fishing. Such disparity creates governability challenges, pointing to the need to revisit relevant regulatory measures and to make them consistent with the knowledge and judgments of all stakeholders. Based on these findings, we discuss governing interventions that may contribute to addressing IUU fishing in Lake Victoria and elsewhere.