“…The main difference between distributed optimization and distributed computing is that the agents in distributed optimization algorithms run simultaneously, i.e., there are no successors and predecessors, and no agent will be idle until the algorithm terminates. Further, fully distributed optimization algorithms may not have a central agent that initiates and terminates the algorithm similar to [8], [10], [14], nor a communication network topology restriction similar to [11]- [13], [15], [18]- [20].…”