Suggestions
Rory Carmichael
Head of Engineering, Infrastructure Platform at Quantcast (Hiring)
Professional Background
Rory Carmichael is an accomplished leader in the field of distributed computing and software engineering, with a robust professional profile that highlights extensive experience in managing state-of-the-art infrastructure for large-scale data systems. Currently serving as the Head of Engineering for the Infrastructure Platform at Quantcast, Rory spearheads a talented team that is responsible for writing and operating massive distributed systems that handle impressive workloads each day.
With a focus on performance and efficiency, Rory and his team manage systems that consistently outperform traditional platforms. One of their notable projects includes a custom map-reduce stack that processes between 20 and 40 petabytes (PB) of input/output daily, showcasing advanced computations and data analytics capabilities. Beyond this, Rory oversees the QFS open-source distributed filesystem, which adeptly manages petabytes of data, ensuring seamless storage and retrieval.
A testament to his leadership capabilities, Rory has developed transport systems that facilitate the transfer of over 50 terabytes of data per day to and from both bidding and data collection infrastructures. This role not only involves technical oversight but also strategic supervision to ensure that the data systems operated by his team are high-performing and efficient. Additionally, Rory has innovated tools that aggregate real-time spend and impression data, enhancing the control mechanisms within the bidding systems.
Rory’s journey through various positions has equipped him with an unparalleled depth of knowledge in distributed systems, making him a go-to expert in the field.
Education and Achievements
Rory Carmichael holds a Master of Science (MS) degree in Computer Science from the prestigious University of Notre Dame, where he also completed his Bachelor of Science in Computer Science. In a delightful twist, Rory also holds a Bachelor of Arts in English from the same institution. This diverse educational background not only underscores his technical proficiency but also reflects his ability to communicate complex ideas clearly, a skill highly advantageous in the tech field where collaboration is key.
His academic prowess is matched by his professional achievements, which are highlighted by his progressive journey at Quantcast. Starting as a Software Engineer in Technical Operations, Rory quickly ascended through the ranks, taking roles as Manager of Cluster Interfaces and Senior Manager of Scale & Transport before becoming the Head of Engineering. This trajectory exhibits a clear pattern of exemplary performance and leadership that is respected and recognized across the organization.
In addition to his roles at Quantcast, Rory has also contributed to the innovation in bioinformatics during his time as Release Manager at VectorBase and as a Senior Analyst-Programmer at the University of Notre Dame's Bioinformatics Core Facility. This blend of experiences in both high-scale data operations and bioinformatics insights adds a unique edge to Rory's technical acumen and creative problem-solving skills.
Achievements
-
Leadership in Large Scale Systems: As head of a team that manages systems processing up to 250,000 queries per second (QPS), Rory demonstrates his expertise in orchestrating complex technological initiatives that contribute directly to the goals and efficiency of Quantcast.
-
Development of Innovative Data Solutions: Rory has been instrumental in creating tools and frameworks that redefine data processing efficiency. The custom map-reduce stack he oversees not only surpasses the performance of Hadoop but has also influenced the way large data sets are handled in real-time environments.
-
Managing Open Source Technologies: His leadership in managing the QFS open-source distributed filesystem illustrates his advocacy for open-source solutions and engagement with the tech community, further highlighting his role in fostering collaborative innovation.
-
Outstanding Educational Background: Rory’s unique combination of technical and creative expertise, bolstered by his educational achievements in both computer science and English, exemplifies a multidisciplinary approach to technology—making him an excellent communicator and collaborator in technical settings.
Rory Carmichael’s career thus paints a vibrant picture of a professional dedicated to pushing the boundaries of what is achievable in distributed computing and software development. With extensive experience and a forward-thinking mindset, Rory continues to lead his team towards greater innovations in data management and operational excellence.