In this work, we present a compact LIBS sensor developed for characterization of samples on a crime scene following requirements of law enforcement agencies involved in the project. The sensor operates both in a tabletop mode, for aside measurements of swabbed materials or taken fragments, and in handheld mode where the sensor head is pointed directly on targets at the scene. The sensor head is connected via an umbilical to an instrument box that could be battery-powered and contains also a color camera for sample visualization, illumination LEDs, and pointing system for placing the target in focus. Here we describe the sensor’s architecture and functionalities, the optimization of the acquisition parameters, and the results of some LIBS measurements. On nano-plotted traces at silica wafer and in optimized conditions, for most of the elements the detection limits, in term of the absolute element masses, were found to be below 10 picograms. We also show results obtained on some representative materials, like fingerprints, swabbed soil and gunshot residue, varnishes on metal, and coated plastics. The last, solid samples were used to evaluate the depth profiling capabilities of the instrument, where the recognition of all four car paint layers was achieved.