Vivekkumar Muthukrishnan

With a strong skill set in architecting and implementing event-driven streaming, ETL systems, and data modeling in cloud environments, I have a proven track record of delivering high-performance solutions across diverse business domains. I thrive on tackling complex challenges and optimizing systems for high availability and maintainability working in numerous product led companies.

One of my strengths lies in architecting data pipelines from end to end, optimizing system performance and reducing costs. For ex. experimenting and fine-tuning state descriptors and object size, resulting in an impressive 40% reduction in cloud computation costs. Additionally, I've developed best practices for designing Spark jobs, resulting in reduction in operational costs and execution time.

I'm well-versed in cloud technologies, like GCP/AWS using Dataproc/EMR, Airflow, Database technologies (row vs Column) Terraform, and Kubernetes. I have extensive experience in building efficient data pipelines and integrating third-party data sources, leveraging Python, Kafka, and Spark to ensure maintainability and streamlined operations.

As as experienced developer and data engineer I have experience in data modelling using cloud technologies (creating the data pipelines) and also creating realtime streaming applications using modern frameworks(like Flink).

As a mentor, I'm dedicated to sharing my expertise and supporting others in their professional growth. I help beginners enter into the world of data engineering, I can provide valuable guidance in architecting robust systems, optimizing data pipelines, implementing best practices, and overcoming data-related challenges. I have a strong passion for continuous improvement and can help mentees navigate the ever-evolving landscape of data engineering.