Data Engineer

Job Location

HYDERABAD OFFICE INDIA

Job Description

Key Responsibilities:

• Productionize pipelines for large, complex data sets which meet technical and business requirements.
• Partner with data asset managers, architects, and development leads to ensure a sound technical solution.
• Follow, and contribute to, coding standards and best practices to ensure pipelines and components are efficient, robust, cost effective and reusable.
• Identify, design, and implement internal process improvements.
• Optimize Spark jobs for performance and cost. Tune configurations, minimize shuffles, and leverage advanced techniques like broadcast joins, caching, and partitioning.
• Ensure data quality, reliability, and performance by implementing best practices for data validation, monitoring, and optimization.
• Monitor and troubleshoot data pipelines and workflows to ensure seamless operation.
• Stay updated on the latest Databricks features, tools, and industry trends to continuously improve data engineering practices.
• Strong understanding of distributed computing concepts and big data processing.
• Excellent problem-solving skills and the ability to work collaboratively in a team environment.
  
  

Job Qualifications

• Strong skills with Python, SQL, Delta Lake, Databricks, Spark/Pyspark, Github and Azure.
• You will be expected to Attain and/or maintain technical certifications related to the role (Databricks, Azure)
• Ability to use and implement CI/CD and associated tools such as Github Actions, SonarQube, Snyk
• Familiarity or experience in one or more modern application development framework methods and tools (e.g. Disciplined Agile, Scrum).
• Familiarity or experience with a range of data engineering best practices for development including query optimization, version control, code reviews, and documentation
• The ability to build relationships and work in diverse, multidisciplinary teams
• Excellent communication skills with business intuition and ability to understand business systems, versatility, and willingness to learn new technologies on the job
  
  

About Us

We produce globally recognized brands and we grow the best business leaders in the industry. With a portfolio of trusted brands as diverse as ours, it is paramount our leaders are able to lead with courage the vast array of brands, categories and functions. We serve consumers around the world with one of the strongest portfolios of trusted, quality, leadership brands, including Always, Ariel, Gillette, Head & Shoulders, Herbal Essences, Oral-B, Pampers, Pantene, Tampax and more. Our community includes operations in approximately 70 countries worldwide. Visit http://www.pg.com to know more.

We are an equal opportunity employer and value diversity at our company. We do not discriminate against individuals on the basis of race, color, gender, age, national origin, religion, sexual orientation, gender identity or expression, marital status, citizenship, disability, HIV/AIDS status, or any other legally protected factor.

"At P&G, the hiring journey is personalized every step of the way, thereby ensuring equal opportunities for all, with a strong foundation of Ethics & Corporate Responsibility guiding everything we do.

All the available job opportunities are posted either on our website - pgcareers.com, or on our official social media pages, for the convenience of prospective candidates, and do not require them to pay any kind of fees towards their application.”

Job Schedule

Full time

Job Number

R000135017

Job Segmentation

Experienced Professionals