Data Engineer(Python + Airflow + Snowflake)

RAPSYS TECHNOLOGIES PTE LTD


Date: 2 weeks ago
City: Pune, Maharashtra
Contract type: Full time
Remote
We're Hiring: Data Engineer (Python + Airflow + Snowflake)!

We are seeking an experienced Data Engineer to design, build, and maintain robust data pipelines and infrastructure. The ideal candidate will have expertise in Python, Apache Airflow, and Snowflake to support our data-driven initiatives and ensure seamless data flow across the organization.

Location: Pune, India

Work Mode: Work From Office

Role: Data Engineer

Summary

What You'll Do:

Python + Airflow + Snowflake Data Engineer

We are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience,

specifically with a strong background in AWS technologies. The ideal candidate will have a

deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling

efficient data pipeline orchestration and management.

Responsibilities

  • Design, develop, and maintain complex data pipelines using Python for efficient data

processing and orchestration.

  • Collaborate with cross-functional teams to understand data requirements and

architect robust solutions within the AWS environment.

  • Implement data integration and transformation processes to ensure optimal

performance and reliability of data pipelines.

  • Optimize and fine-tune existing data pipelines / Airflow to improve efficiency,

scalability, and maintainability.

  • Troubleshoot and resolve issues related to data pipelines, ensuring smooth

operation and minimal downtime.

  • Work closely with AWS services like S3, Glue, EMR, Redshift, and other related

technologies to design and optimize data infrastructure.

  • Develop and maintain documentation for data pipelines, processes, and system

architecture.

  • Stay updated with the latest industry trends and best practices related to data

engineering and AWS services.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • Proficiency in Python, PySpark and SQL for data processing and manipulation.
  • Min 5 years of experience in data engineering, specifically working with Apache

Airflow and AWS technologies.

  • Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS

Lambda.

  • Understanding of Snowflake Data Lake is preferred.
  • Experience with optimizing and scaling data pipelines for performance and

efficiency.

  • Good understanding of data modeling, ETL processes, and data warehousing

concepts.

  • Excellent problem-solving skills and ability to work in a fast-paced, collaborative

environment.

  • Effective communication skills and the ability to articulate technical concepts to

non-technical stakeholders.

Preferred Qualifications

  • AWS certification(s) related to data engineering or big data.
  • Experience working with big data technologies like Snowflake, Spark, Hadoop, or

related frameworks.

  • Familiarity with other data orchestration tools in addition to Apache Airflow.
  • Knowledge of version control systems like Bitbucket, Git.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Manager, Global Workflow (MS)

ACA Group, Pune, Maharashtra
6 hours ago
About ACA:ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlpha technology platform with the specialized expertise of former regulators and practitioners and our deep understanding of the global regulatory landscape.This Pune-based role...

Frontend Solution Architect

Zensar Technologies, Pune, Maharashtra
23 hours ago
Job DescriptionWhat's this role about?We are seeking a UI Architect to join our dynamic team. The ideal candidate will have a strong foundation in front-end technologies and a passion for creating efficient, scalable, and accessible web applications. This role requires a deep understanding of web development best practices, design patterns, and cutting-edge frameworks.Here's How You'll Contribute Architect Node, ES6, Typescript...

Customer Service Assistant

Mouser Electronics, Pune, Maharashtra
2 days ago
Job DescriptionPerforms data entry accurately and efficiently using various computer programs, word processing, spreadsheet, or database commands; formats material as required.Proofs material entered and generated data reports as required; reviews discrepancies in data received, requests clarification or advises supervisor of issues related to data, to verify customer requests are processed correctly.Files, keeps records, and prepares/transmits/sorts/distributes faxes, mail, e-mail, and reports...