With the continued increase of size and complexity of contemporary digital systems, there is a growing need for models of large size and high complexity, as well as methods of analyzing such models. This paper presents a method for simulating large-scale concurrent Petri net models using parallel distributed hardware platforms. By using POETS architecture, our method allows the mapping of concurrent Petri net executions onto 49,152 parallel processing hardware threads to achieve orders of magnitude (45 to 220 times) improvements of simulation speed, compared to conventional simulation methods using single processor systems. The presented method employs techniques including Petri net model partitioning, the use of max-step and locallyinterleaving semantics, and the fair firing of transitions.