Senior Data Engineer- Azure Databricks

InfoCepts


Date: 4 hours ago
City: Pune, Maharashtra
Contract type: Full time

Position: Senior Data Engineer - Azure Databricks 

 

Purpose of the Position:  

To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, to make faster, data-driven decisions as part of its data transformation journey. 

Proficiency in data integration techniques, ETL processes and data pipeline architectures. Well versed in Data Quality rules, principles and implementation. 

 

Location: Nagpur/ Pune/ Chennai/ Bangalore

 

Type of Employment: FTE 

 

Key Result Areas and Activities: 

  • Data Pipeline Development: Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark. 

  • Data Architecture Implementation: Apply Medallion Architecture to structure data layers (raw, enriched, curated). 

  • Data Quality & Governance: Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog. 

  • Performance Optimization: Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency and cost-effectiveness. 

  • Collaboration & Delivery: Work closely with analysts, architects, and business teams to deliver end-to-end data solutions.

    • How to apply

    To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

    Post a resume

    Similar jobs

    Account Executive

    Autodesk, Pune, Maharashtra
    11 hours ago
    Job Requisition ID #25WD91233Position OverviewWe are seeking a passionate and motivated Account Executive ready to elevate their sales career in the dynamic and rapidly growing Construction Cloud Technology space. In this role, you will represent Autodesk Construction Solutions within your assigned territory, helping revolutionize an industry that has historically lagged in adopting technology. With a regional approach to selling into...

    Financial Planning and Analysis

    Emerson, Pune, Maharashtra
    4 days ago
    Job DescriptionProject Cost AccountantJob SummaryIf you are a Finance professional, Emerson has an exciting role for you! We are looking for a Project Analyst to work with our Financial Services Group in Pune.We value autonomy, self-reliance, fast movers, a passion for robust and ability to maintained quality of financial reporting.In This Role, Your Responsibilities Will Be: Manage the monthly reporting...

    Customer Service Representative

    bp, Pune, Maharashtra
    4 days ago
    The Customer Service Representative role exists to provide first and second line of customer support to telephone and written enquiries from external Key Customers, internal Customers and other Consumers in accordance with agreed service levels. The position will ensure all facing queries are answered with the required speed, accuracy and with the maximum level of customer satisfaction.Customer Facing (CF) CSRs...