Suggestions
Pramit Mitra
Software Architect at Bloomberg Industry Group
Professional Background
Pramit Mitra is a highly skilled AWS Cloud Engineer and experienced Data Engineer with a prominent track record in data integration and processing. With extensive hands-on coding experience, Pramit has developed expertise in a range of technology stacks that are critical for building robust data solutions in cloud environments. His distinguished career reflects his commitment to technological evolution in the data sphere.
At present, Pramit serves as a Software Architect at Bloomberg Industry Group, where he is instrumental in architecting innovative solutions that drive data processing efficiencies for the organization. Pramit's profile showcases a career rich in achievements within well-known technology companies, including Oracle and eBay, where he contributed significantly to enterprise-level data platforms.
Pramit possesses a keen understanding of essential data engineering concepts, particularly around designing and implementing ETL pipelines for large-scale distributed systems. He has expertly navigated the complexities of data exchange, working with relational databases such as Teradata and Oracle, as well as distributed storage systems like HDFS and MapRFS. His proficiency extends to stream feeds, NoSQL databases like HBase, and both unstructured and semi-structured data formats including JSON and XML. This diverse skill set places him in a unique position to optimize data handling processes across various domains.
Education and Achievements
Educationally, Pramit holds a Post Graduate Diploma in Business Management with a specialization in IT Systems from the Institute of Management Technology in Ghaziabad, where he graduated with First Class honors. He also holds a B-Tech degree in Computer Engineering from West Bengal University of Technology in Kolkata, completed with First Class. This solid foundation in both business management and technical engineering equips Pramit with a multifaceted perspective on technology implementation in business processes.
Over his career, Pramit has made significant accomplishments in data engineering implementations:
- Notably, he was involved in one of the world's largest migrations of an RDBMS-based data warehouse into a processing system built on Spark, demonstrating his capacity to manage and transform large volumes of data efficiently.
- He also developed a real-time Call Log Monitoring Analytics System for AT&T, North America's largest telecom company, showcasing his ability to integrate complex data systems in real-time settings.
- Pramit played a pivotal role in the creation of a Geo-Distributed HR Data Management System for Nike, further emphasizing his versatility in handling diverse data-driven challenges.
- His contributions also include working on Europe's expansive Oracle Retail Data Warehouse implementation for Morrisons, a testament to his in-depth knowledge of retail-specific data management systems.
Achievements
In terms of concrete achievements, Pramit has excelled in several key areas within the field of data engineering:
- He managed one of the largest ETL platforms with over 100,000 daily ETL jobs, evenly distributed among extraction, transformation, and loading processes.
- Handling data sizes in the hundreds of terabytes and overseeing configurations that include multi-threading and partitioning, Pramit ensures optimal data management solutions.
- His adept handling of delta files includes managing a batch delta file size of 1.7 TB, showcasing his capabilities in extracting maximum performance from data operations.
- In terms of infrastructure, he has worked with disaggregated storage solutions, managing up to 400 TB using Ceph, an experience that highlights his proficiency with cloud storage technologies.
- Pramit has significant experience with high network bandwidth operations, having implemented dual interface read/write logic that adapts based on data volume requirements. His capabilities extend to managing an extensive network security policy framework encompassing over 3,500 automated policies.
- As an expert in Kubernetes, he has created and managed dozens of Kubernetes pods, demonstrating his understanding of container orchestration critical for modern cloud-native applications.
- Furthermore, he has extensive experience working with Hadoop clusters, showcasing his alignment with best practices in big data frameworks capable of handling multi-petabyte datasets.
Through a combination of academic excellence, practical experience, and notable implementations, Pramit Mitra stands out as a distinguished professional in the field of AWS Cloud Engineering and Data Engineering. His approach to data solutions not only addresses current needs but also anticipates future demands in a constantly evolving technological landscape. Pramit's career is a testament to his lifelong commitment to excellence in data engineering, making him a valuable asset in any data-centric organization.