Senior ETL Developer

Mandatory skills (8+ Years of experience in ETL development with 4+ Years on AWS Pyspark scripting)

• Experience deploying and running AWS-based data solutions using services or products such as S3, Lambda, SNS, Cloud Step Functions.
• Person should be strong in Pyspark
• Hands on and working knowledge in Python packages like NumPy, Pandas, Etc
• Experience deploying and running AWS-based data solutions using services or products such as S3, Lambda, SNS, Cloud Step Functions. Sound knowledge in AWS services is must.
• Person should work as Individual contributor
• Good to have familiar with metadata management, data lineage, and principles of data governance.

Good to have:

• Experience to process large set of data transformations both semi and structured data
• Experience to build data lake & configuration on delta tables.
• Good experience with computing & cost optimization.
• Understanding the environment and use case and ready to build holistic Data Integration frame works.
• Good experience in MWAA (airflow orchestration)

Soft skill:

• Having good communication to interact with IT-Stake holders and Business.
• Understand the pain point to delivery.