To my parents, Wayne and Debbie. i I would like to begin by thanking my parents, Debbie Mitzner and Wayne Miller, for all of their advice and support. Wayne Miller voluntarily acted as a copy-editor for all of my publications, including this thesis. My next thanks go to my advisor, Mario Sznaier, at the Robust Systems Laboratory in Northeastern. I met Mario in Fall of 2016 as a BS/MS student, when I asked him for an override in order to attend his Spring 2017 special topics course in Big Data, Sparsity, and Control. During the opening lecture, he gave a survey of sparse methods in robust regression, computer vision, and system identification. At the close of this first lecture, I asked him how I could learn more and join his lab, and he responded by giving me the door code. I officially joined the lab as a PhD student in Fall of 2018, and then acted as a teaching assistant for his Sparsity course in 2019, 2021, and 2022. Mario introduced me to topics such as rank-minimization, sparsity, Frank-Wolfe methods, measures, polynomial optimization, and data-driven control. Mario's wealth of experience allows him to draw connections between different disciplines and rapidly determine if ideas have promise, have been done before, and/or are marginal/intractable. His discussions with myself and other members of the laboratory help us refine our approaches and experiments, providing guidance in sometimes unexpected ways, and leading us into new directions of research. I would like to thank Octavia Camps (co-director of the Robust Systems Laboratory) for the discussions and application of my methods towards computer vision. I would like to thank all of my colleagues in the Robust Systems Lab over the course of my ∼6 years there. Specific recognition goes to my collaborators Tianyu Dai, Rajiv Singh, Jian Zheng, Armand Comas, Biel Roig-Solvas, and Zachary Walker-Liang. There are many other students and professors at Northeastern (outside the Robust Systems Laboratory) to thank. Students in research include