Lead AWS Data Engineer- SQL Expert , ETL, Python Job at Atlantis IT group, Ontario, CA

d2ZzalFLWVNVbHdSN3BJaDdaNTdZNDB3Qmc9PQ==
  • Atlantis IT group
  • Ontario, CA

Job Description

Role: Lead AWS Data Engineer- SQL Expert , ETL, Python

Location: Toronto

Hybrid

AWS, SQL, OLAP, OLTP, ETL , PYTHON

Responsibilities:

Design, develop, and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Redshift, EMR, etc.)

Collaborate with data scientists, analysts, and business stakeholders to gather requirements and build ETL/ELT workflows.

Optimize data workflows for scalability, reliability, and performance.

Ensure data quality, governance, and security standards are met.

Monitor and troubleshoot data pipeline issues.

Required Skills:

8+ years of experience in data engineering, preferably in a cloud environment.

Strong hands-on experience with AWS services: Glue, Redshift, S3, Lambda, EMR, Athena.

Proficient in Python and SQL.

Experience with data modeling, warehousing concepts, and data lakes.

Familiarity with orchestration tools like Airflow or Step Functions.

Knowledge of CI/CD practices and version control (e.g., Git).

Nice to Have:

Experience with real-time data processing (e.g., Kinesis, Kafka).

Knowledge of Terraform or CloudFormation for infrastructure as code.

Familiarity with DevOps practices and tools.

AWS, SQL, OLAP, OLTP, ETL , PYTHON

Responsibilities:

Design, develop, and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Redshift, EMR, etc.)

Collaborate with data scientists, analysts, and business stakeholders to gather requirements and build ETL/ELT workflows.

Optimize data workflows for scalability, reliability, and performance.

Ensure data quality, governance, and security standards are met.

Monitor and troubleshoot data pipeline issues.

Required Skills:

8+ years of experience in data engineering, preferably in a cloud environment.

Strong hands-on experience with AWS services: Glue, Redshift, S3, Lambda, EMR, Athena.

Proficient in Python and SQL.

Experience with data modeling, warehousing concepts, and data lakes.

Familiarity with orchestration tools like Airflow or Step Functions.

Knowledge of CI/CD practices and version control (e.g., Git).

Nice to Have:

Experience with real-time data processing (e.g., Kinesis, Kafka).

Knowledge of Terraform or CloudFormation for infrastructure as code.

Familiarity with DevOps practices and tools.

Job Tags

Similar Jobs

WD Partners

Construction Project Manager Job at WD Partners

 ...gain experience, train and mentor with the best, and build a successful career!We currently have an opening for a Construction Project Manager on our Construction Management Services team! We are open to hiring in Raleigh, Roanoke, or Charlotte to support client... 

Lakeville Station

Breakfast cook Job at Lakeville Station

 ...Working in fast food? Are you ready to learn skills that pay much better? We would love to train you. If you consider yourself Sharp, eager and willing to learn with the ability to multitask. No experience is necessary, but some experience will bring better pay. Highschoolers... 

Ocean Casino Resort

Seasonal - Barista- Starbucks Job at Ocean Casino Resort

 ...About the Role The Barista is responsible for preparing and selling drinks by following recipes and preparation techniques, as well as generating revenue by attracting new customers. Position Responsibilities Welcomes customers by determining their coffee interests... 

SpikeIT Global Solutions, Inc.

ServiceNow Developer Job at SpikeIT Global Solutions, Inc.

 ...Job Description ServiceNow Developer - ITSM Role Overview: Develop, configure, and customize ServiceNow ITSM modules (Incident, Problem, Change, Service Catalog, CMDB). Key Responsibilities: Implement workflows, business rules, UI policies,... 

Logan View Public Schools

Elementary Art Teacher Job at Logan View Public Schools

 ...Elementary Art Teacher Logan View Public Schoolsis seeking a positive and enthusiastic individual to join our elementary teaching staff. This individual must demonstrate an understanding of working in a small school by demonstrating collaboration, flexibility, strong...