Senior Consultant - Tech Consulting - National - CNS - TC - Data Engineer- Mumbai and Ahmedabad
EY
Date: 2 weeks ago
City: Ahmedabad, Gujarat
Contract type: Full time
Job Title: Data Engineer
Level: Senior Consultant
Experience: 3-6 Years
Location: Mumbai and Ahmedabad
Role Summary
The Data Engineer role focuses on the design, development, and maintenance of scalable,
reliable, and high-performance data platforms. The role requires strong hands-on expertise in
Python-based microservices, distributed data processing frameworks, and cloud-based big
data ecosystems, with a primary emphasis on building robust applications to process ETL
pipelines and production-grade data systems.
Key Responsibilities
Design, develop, and maintain scalable Python-based microservices for data ingestion and
processing
Build and optimize microservices to support end-to-end ETL pipelines for large-scale batch and
streaming data
Develop and manage distributed data processing workfl ows using Apache Spark and PySpark
Create, schedule, and monitor workfl ows using Apache Airfl ow
Design and deploy data pipelines on AWS EMR or similar big data platforms using Python
Implement real-time data ingestion and streaming pipelines
Ensure data quality, reliability, performance, and scalability of data systems
Apply best practices for code quality, testing, CI/CD, and production monitoring
Troubleshoot production issues and perform root-cause analysis
Required Skills & Experience
6–8 years of experience in Data Engineering or backend data platform roles
Strong profi ciency in Python with experience building production-grade microservices
Hands-on expertise with Apache Spark and PySpark
Experience working with AWS EMR or equivalent cloud-based big data services. (Must have
knowledge on AWS eco system)
Strong experience with Apache Airfl ow for workfl ow orchestration
Deep understanding of ETL pipeline design and data modeling
Hands-on experience with Kafka for inter-domain communication and real-time or streaming
data pipelines
Strong experience with PostgreSQL or similar RDBMS
Experience working in Agile/Scrum environments
Good to Have
Experience with Scala, Docker and Kubernetes
Exposure to cloud platforms such as AWS, Azure, or GCP
Experience with data lake architectures and schema evolution
Familiarity with monitoring and logging tools
Desired Competencies
Strong ownership and accountability
Excellent problem-solving and analytical skills
Good communication and collaboration skills
Ability to work independently in a fast-paced environment
Level: Senior Consultant
Experience: 3-6 Years
Location: Mumbai and Ahmedabad
Role Summary
The Data Engineer role focuses on the design, development, and maintenance of scalable,
reliable, and high-performance data platforms. The role requires strong hands-on expertise in
Python-based microservices, distributed data processing frameworks, and cloud-based big
data ecosystems, with a primary emphasis on building robust applications to process ETL
pipelines and production-grade data systems.
Key Responsibilities
Design, develop, and maintain scalable Python-based microservices for data ingestion and
processing
Build and optimize microservices to support end-to-end ETL pipelines for large-scale batch and
streaming data
Develop and manage distributed data processing workfl ows using Apache Spark and PySpark
Create, schedule, and monitor workfl ows using Apache Airfl ow
Design and deploy data pipelines on AWS EMR or similar big data platforms using Python
Implement real-time data ingestion and streaming pipelines
Ensure data quality, reliability, performance, and scalability of data systems
Apply best practices for code quality, testing, CI/CD, and production monitoring
Troubleshoot production issues and perform root-cause analysis
Required Skills & Experience
6–8 years of experience in Data Engineering or backend data platform roles
Strong profi ciency in Python with experience building production-grade microservices
Hands-on expertise with Apache Spark and PySpark
Experience working with AWS EMR or equivalent cloud-based big data services. (Must have
knowledge on AWS eco system)
Strong experience with Apache Airfl ow for workfl ow orchestration
Deep understanding of ETL pipeline design and data modeling
Hands-on experience with Kafka for inter-domain communication and real-time or streaming
data pipelines
Strong experience with PostgreSQL or similar RDBMS
Experience working in Agile/Scrum environments
Good to Have
Experience with Scala, Docker and Kubernetes
Exposure to cloud platforms such as AWS, Azure, or GCP
Experience with data lake architectures and schema evolution
Familiarity with monitoring and logging tools
Desired Competencies
Strong ownership and accountability
Excellent problem-solving and analytical skills
Good communication and collaboration skills
Ability to work independently in a fast-paced environment
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Senior Executive Accounts _ Legal (Ahmedabad)
Blue Dart,
Ahmedabad, Gujarat
5 days ago
Job TitleExecutive/Senior Executive Accounts – LegalFunctionLegal & ComplianceReports ToManager – LegalLocationHead OfficeTravel Required25% þ 50% ☐ 75% ☐Blue Dart Express Limited, a listed company, is a leader in courier, integrated air express package distribution, and eCommerce in South Asia, offering a wide range of logistics solutions. Founded in 1983, it is recognised for reliable, time-bound, and secure delivery services across...
Channel Sales Specialist
Vertiv,
Ahmedabad, Gujarat
1 week ago
Job DescriptionBrief Job Description:The Partner Manager is responsible for sales growth through managed reseller and distributor partners to help maximize channel sales opportunities across the region.The main contribution of this role is driving aggressive revenue growth of Mission-Critical infrastructure solutions from Vertiv’s Rack and Edge based products, including UPS, Rack/Row based Cooling, Power Distribution and IT Management portfolios.Mission-critical Infrastructure Solutions...
Principal Drainage Engineer (Infodrainage/Microdrainage)
Mott MacDonald,
Ahmedabad, Gujarat
1 week ago
Mott MacDonald is a global engineering, management, and development consultancy committed to delivering impactful work that shapes the future.We are a team of over 20,000 experts working across the world in more than 50 countries.We are proud to be part of an ever-changing global industry, delivering transformative work that’s defining our future. It’s our people who power that performance. As...
