ETL Engineer Responsibilities:
- Implement ETL processes to transform and ingest client data from multiple forms and sources into the Choice Data Platform.
- Develop and maintain SQL and Python code for data validation, ingestion, transformation, and analysis.
- Understanding of ETL (Extract , Transform , Load) - Creation of ETL Pipelines to extract and Ingest data into data lake/warehouse with simple to medium complexity Data transformations and troubleshooting ETL job issues.
- Experience implementing complex, high volume data transformation pipelines.
- Proficient in data transformation with Python
Nice to have:
SQL, Python, AWS (S3, Kinesis, Sqs, Redshift, Glue, Lambda, Postgres with ec2, api’s and cloud watch)