AWS Data Engineer
Virtusa
Date: 3 weeks ago
City: Chennai, Tamil Nadu
Contract type: Full time
Job Summary
We are looking for a skilled AWS Data Engineer with strong experience in building and managing cloud-based ETL pipelines using AWS Glue, Python/PySpark, and Athena, along with data warehousing expertise in Amazon Redshift. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions in a cloud-native environment.
Design and implement ETL workflows using AWS Glue, Python, and PySpark.
Develop and optimize queries using Amazon Athena and Redshift.
Build scalable data pipelines to ingest, transform, and load data from various sources.
Ensure data quality, integrity, and security across AWS services.
Collaborate with data analysts, data scientists, and business stakeholders to deliver data solutions.
Monitor and troubleshoot ETL jobs and cloud infrastructure performance.
Automate data workflows and integrate with CI/CD pipelines.
Required Skills & Qualifications
Hands-on experience with AWS Glue, Athena, and Redshift.
Strong programming skills in Python and PySpark.
Experience with ETL design, implementation, and optimization.
Familiarity with S3, Lambda, CloudWatch, and other AWS services.
Understanding of data warehousing concepts and performance tuning in Redshift.
Experience with schema design, partitioning, and query optimization in Athena.
Proficiency in version control (Git) and agile development practices.
We are looking for a skilled AWS Data Engineer with strong experience in building and managing cloud-based ETL pipelines using AWS Glue, Python/PySpark, and Athena, along with data warehousing expertise in Amazon Redshift. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions in a cloud-native environment.
Design and implement ETL workflows using AWS Glue, Python, and PySpark.
Develop and optimize queries using Amazon Athena and Redshift.
Build scalable data pipelines to ingest, transform, and load data from various sources.
Ensure data quality, integrity, and security across AWS services.
Collaborate with data analysts, data scientists, and business stakeholders to deliver data solutions.
Monitor and troubleshoot ETL jobs and cloud infrastructure performance.
Automate data workflows and integrate with CI/CD pipelines.
Required Skills & Qualifications
Hands-on experience with AWS Glue, Athena, and Redshift.
Strong programming skills in Python and PySpark.
Experience with ETL design, implementation, and optimization.
Familiarity with S3, Lambda, CloudWatch, and other AWS services.
Understanding of data warehousing concepts and performance tuning in Redshift.
Experience with schema design, partitioning, and query optimization in Athena.
Proficiency in version control (Git) and agile development practices.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Business Support Coordinator (Invoice Specialist)
A.P. Moller - Maersk,
Chennai, Tamil Nadu
1 day ago
We OfferThe Business support team manages the booking, certificate and invoice process for Maersk Training centres across the globe. This role is responsible for managing and validating invoices within Business Central (BC) and ADM (Administrate) systems, understanding of how invoice processing impacts business cash flow and ability to identify patterns in invoice discrepancies and their root causes, monitor and report...
Business Analyst L3
Wipro,
Chennai, Tamil Nadu
2 days ago
Job description:Job Description Role PurposeThe purpose of the role is to liaison and bridging the gap between customer and Wipro delivery team to comprehend and analyze customer requirements and articulating aptly to delivery teams thereby, ensuring right solutioning to the customer.͏ Do1. Customer requirements gathering and engagement Interface and coordinate with client engagement partners to understand the RFP/ RFI requirements ...
Senior Business Systems Analyst
UPS,
Chennai, Tamil Nadu
3 days ago
Avant de postuler à un emploi, sélectionnez votre langue de préférence parmi les options disponibles en haut à droite de cette page.Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunités innovantes, découvrez notre culture enrichissante et travaillez avec des équipes talentueuses qui vous poussent à vous développer chaque jour....
