성균관대학교

Data Engineer

- Terraformed the whole data infrastructure for a dedicated AWS account while handling   cross-account issues using Terraform and Ansible* Operating AWS resources and custom storages (Kinesis, MSK, EKS, S3, EMR, Dynamo, EC, CloudWatch, Codebuild, IAM, ES, Zookeeper, Druid, ..)* Introduced application infrastructure on EKS to provide data services towards customer such as  recommendation, product popularity with centralized monitoring and logging using Prometheus and EFK  * Provide resource flexible and isolated EDA environment (e.g., Jupyter) on top of Kubernetes* Creating a recommendation system while using Spark (batch) and Flink (stream) to create statistical  recommendation models, real-time user profiles, and batch product profiles* Developing experimentation platform management tools and doing ETL for the required dataset * Maintaining seller sales report and ad performance report metrics including 80+ middle stage hive tables to create those reports and product feature stores

Yanolja

Has contributed to Apache Zeppelin- <a href="https://github.com/apache/zeppelin/commits/master?author=1ambda">https://github.com/apache/zeppelin/commits/master?author=1ambda</a>

The Apache Software Foundation

ASF Member, Commiter of Zeppelin

- Work]* Managed the whole infra system on AWS alone using terraform, ansible, datadog (EC2, S3, ASG, RDS, ECS, ES, EC, Kinesis, Cloudfront, Cloudwatch, Codebuild, IAM, ..)* Designed deploy pipeline suitable for 10-15 people using jenkins, AWS code build, ..* Dockerized Apps and Kubernetes-ed the application layer.* Scaled team by introducing tools such as kubernetes, swagger (codegen), flyway, etc.* Developed few service features in Java* Devising enterprise-dedicated deployment / monitoring strategy[Open Source]Contributed Apache Zeppelin in full time for 6 months* Designed / Improved pluggable visualization system* Proposed Extendable Tabledata Handling API (<a href="https://cwiki.apache.org/confluence/display/ZEPPELIN/Proposal:+Extending+TableData+API)*">https://cwiki.apache.org/confluence/display/ZEPPELIN/Proposal%3A+Extending+TableData+API)*</a> and so on (<a href="https://github.com/apache/zeppelin/commits?author=1ambda%29%5BNotable">https://github.com/apache/zeppelin/commits?author=1ambda)[Notable</a> TALKs]* How They Operate Kuberetes on AWS (2018. 1. 13, Devops Korea 2018, Seoul)* Helium Makes Zeppelin Fly (2017.05.18 ApacheCon BigData 2017, Miami FL)[MOOCs]* Big Data Analysis with Scala and Spark (<a href="https://www.coursera.org/learn/scala-spark-big-data">https://www.coursera.org/learn/scala-spark-big-data</a>)

ZEPL - Collaborative Data Science Platform by the creators of Apache Zeppelin

Software Engineer

- Work]Maintained systems for data infrastructure* Maintained GA like client libraries which is used in 10+ SERVICES on 2 platforms. (JS, Android)* Maintained schema generation libraries used in 100+ projects* Operating kafka consumer containers which handle 1 billion+ log / day and manage 180+ data collections to save logs into HDFS (Scala)* Operating 20+ kafka brokers (3 clusters) including mirror makers in production. These brokers are highly important backbones in SK planet's Big Data infra (300+ topics, 12 TB+)[Articles]Writing Advanced Functional Programming Articles About Scalaz (<a href="https://1ambda.github.io/scala)[Opensource">https://1ambda.github.io/scala)[Opensource</a> Activity]* Created a github profile viewer written in TS + React (<a href="https://github.com/oh-my-github/oh-my-github)*">https://github.com/oh-my-github/oh-my-github)*</a> Built a docker image for Apache kafka-connect (<a href="https://hub.docker.com/r/1ambda/kafka-connect)*">https://hub.docker.com/r/1ambda/kafka-connect)*</a> Developed dashboard for Apache kafka-connect  (<a href="https://github.com/1ambda/kafka-connect-dashboard)[Certifications]Finished">https://github.com/1ambda/kafka-connect-dashboard)[Certifications]Finished</a> 15+ MOOC courses and still trying to learn something.