The complexity of modern military operations create a demand for efficient collaborative decision making and problem solving. Additionally, as military units operate in increasingly dynamic environments, the ability to respond to changing circumstances becomes paramount for mission success. An effective response rests on correct dissemination and transfer of information across the command and control structure, and thus is critically linked to the network of human interactions.In this paper, we take an agent-based modeling approach to collective problem solving. We investigate three key factors affecting the performance in collaborative environments: (1) the structure of network used to share information between agents, (2) the search strategies adopted by agents, and (3) the complexity of problems facing the group. In particular we study how the trade-off between exploitation of known solutions and exploration for novel ones is related to the efficiency of collective search. Additionally we consider the role of agent behavior: propensity for risk-taking and trustworthiness, as well as the dynamic nature of social connections. Finally, we outline the directions for future work regarding the efficiency of problem solving on military-like command and control structures.