Software Engineering Manager @NAVER CLOVA
Jul 2020 - Present
Machine Learning Data Platform
Senior Software Engineer @Coupang
Korean version of Amazon.com; largest e-commerce, logistics company
Jul 2018 - Mar 2020 📍Seoul, South Korea
Data Engineering
- Kafka log persistence
- Kafka schema registry
- Handling extract, transform, load (ETL) tasks with Spark
Inter-domain logistics state management system (Flow)
- Handling write-heavy workloads with Cassandra
- Message ordering guarantee with a distributed queue
- RESTful API for internal customers (domain teams)
- Spark jobs for data validation, written in Scala, fully automated with Airflow
Internal Tools & Extracurricular Activities
awsauth: Command line tool written in Golang to issue temporary AWS access keys with AD FS and AWS STS