Data Engineer(Python + Airflow + Snowflake)

RAPSYS TECHNOLOGIES PTE LTD


Date: 16 hours ago
City: Pune, Maharashtra
Contract type: Full time
Remote
We're Hiring: Data Engineer (Python + Airflow + Snowflake)!

We are seeking an experienced Data Engineer to design, build, and maintain robust data pipelines and infrastructure. The ideal candidate will have expertise in Python, Apache Airflow, and Snowflake to support our data-driven initiatives and ensure seamless data flow across the organization.

Location: Pune, India

Work Mode: Work From Office

Role: Data Engineer

Summary

What You'll Do:

Python + Airflow + Snowflake Data Engineer

We are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience,

specifically with a strong background in AWS technologies. The ideal candidate will have a

deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling

efficient data pipeline orchestration and management.

Responsibilities

  • Design, develop, and maintain complex data pipelines using Python for efficient data

processing and orchestration.

  • Collaborate with cross-functional teams to understand data requirements and

architect robust solutions within the AWS environment.

  • Implement data integration and transformation processes to ensure optimal

performance and reliability of data pipelines.

  • Optimize and fine-tune existing data pipelines / Airflow to improve efficiency,

scalability, and maintainability.

  • Troubleshoot and resolve issues related to data pipelines, ensuring smooth

operation and minimal downtime.

  • Work closely with AWS services like S3, Glue, EMR, Redshift, and other related

technologies to design and optimize data infrastructure.

  • Develop and maintain documentation for data pipelines, processes, and system

architecture.

  • Stay updated with the latest industry trends and best practices related to data

engineering and AWS services.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • Proficiency in Python, PySpark and SQL for data processing and manipulation.
  • Min 5 years of experience in data engineering, specifically working with Apache

Airflow and AWS technologies.

  • Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS

Lambda.

  • Understanding of Snowflake Data Lake is preferred.
  • Experience with optimizing and scaling data pipelines for performance and

efficiency.

  • Good understanding of data modeling, ETL processes, and data warehousing

concepts.

  • Excellent problem-solving skills and ability to work in a fast-paced, collaborative

environment.

  • Effective communication skills and the ability to articulate technical concepts to

non-technical stakeholders.

Preferred Qualifications

  • AWS certification(s) related to data engineering or big data.
  • Experience working with big data technologies like Snowflake, Spark, Hadoop, or

related frameworks.

  • Familiarity with other data orchestration tools in addition to Apache Airflow.
  • Knowledge of version control systems like Bitbucket, Git.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Lead Associate - Accounting and Finance Controllership

Nexdigm, Pune, Maharashtra
14 hours ago
<p class="MsoNormal" style="text-align: justify;"><span style="font-weight: bolder;"><span lang="EN-US" style="font-size: 10pt; font-family: Arial, sans-serif;"><span style="font-family: Arial; font-size: 14px;">About Us:<span style="font-weight: bolder; text-align: justify;"><span lang="EN-US" style="font-family: Arial;">Click here to know - 'Who we are?'<span style="font-weight: bolder;"><span lang="EN-US" style="font-family: Arial;">JOB DESCRIPTION:<span style="font-weight: bolder;"><span style="line-height: 15.3333px; font-family: Arial;">DESIRED SKILL:<span style="font-weight: bolder;"><span lang="EN-US" style="line-height: 15.3333px; font-family: Arial;">Accounting<span lang="EN-US" style="line-height: 15.3333px; font-family: Arial;">Review of Accounting for Sales,...

Sr. QA - Creative Automation

dentsu, Pune, Maharashtra
16 hours ago
The purpose of this role is to ensure the developed software meets the client requirements and the business’ quality standards within the project release cycle and established processes. To develop skills and to gain experience in various QA areas.Job Description:Experience: 5- 7 yearsRequirements:Bachelor's/Master's degree in Computer Science or related field. 5-6 years of experience in software quality assurance. Solid knowledge...

Security Guard

G4S, Pune, Maharashtra
4 days ago
Job Introduction / Roles ResponsibilitiesAs a professionally trained Security Guard for G4S, you could be a member of the security team responsible for securing premises, such as building sites, courts, shops, warehouses, banks and factories. You would be conducting foot or vehicle patrols, controlling access at points of entry, securing equipment and people, responding to emergency situations, monitoring CCTV, surveillance...