Azure Data Engineer
Deqode
Date: 1 day ago
City: Faridabad, Haryana
Salary:
₹1,000,000
-
₹2,500,000
per year
Contract type: Full time
Role Overview
We are seeking a Senior Software Engineer (SSE) with strong expertise in Kafka, Python, and Azure Databricks to lead and contribute to our healthcare data engineering initiatives. This role is pivotal in building scalable, real-time data pipelines and processing large-scale healthcare datasets in a secure and compliant cloud environment.
The ideal candidate will have a solid background in real-time streaming, big data processing, and cloud platforms, along with strong leadership and stakeholder engagement capabilities.
Key Responsibilities
We are seeking a Senior Software Engineer (SSE) with strong expertise in Kafka, Python, and Azure Databricks to lead and contribute to our healthcare data engineering initiatives. This role is pivotal in building scalable, real-time data pipelines and processing large-scale healthcare datasets in a secure and compliant cloud environment.
The ideal candidate will have a solid background in real-time streaming, big data processing, and cloud platforms, along with strong leadership and stakeholder engagement capabilities.
Key Responsibilities
- Design and develop scalable real-time data streaming solutions using Apache Kafka and Python.
- Architect and implement ETL/ELT pipelines using Azure Databricks for both structured and unstructured healthcare data.
- Optimize and maintain Kafka applications, Python scripts, and Databricks workflows to ensure performance and reliability.
- Ensure data integrity, security, and compliance with healthcare standards such as HIPAA and HITRUST.
- Collaborate with data scientists, analysts, and business stakeholders to gather requirements and translate them into robust data solutions.
- Mentor junior engineers, perform code reviews, and promote engineering best practices.
- Stay current with evolving technologies in cloud, big data, and healthcare data standards.
- Contribute to the development of CI/CD pipelines and containerized environments (Docker, Kubernetes).
- 4+ years of hands-on experience in data engineering roles.
- Strong proficiency in Kafka (including Kafka Streams, Kafka Connect, Schema Registry).
- Proficient in Python for data processing and automation.
- Experience with Azure Databricks (or readiness to ramp up quickly).
- Solid understanding of cloud platforms, with a preference for Azure (AWS/GCP is a plus).
- Strong knowledge of SQL and NoSQL databases; data modeling for large-scale systems.
- Familiarity with containerization tools like Docker and orchestration using Kubernetes.
- Exposure to CI/CD pipelines for data applications.
- Prior experience with healthcare datasets (EHR, HL7, FHIR, claims data) is highly desirable.
- Excellent problem-solving abilities and a proactive mindset.
- Strong communication and interpersonal skills to work in cross-functional teams.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Logistics Specialist
Kongsberg Automotive,
Faridabad, Haryana
1 day ago
About The PositionLogisitc Specialist positon Scope -Manages material Planning (Direct and consumable) for Prod. as per the guidelines.To manage the inventory budgets and business KPI’s.Facilitate accurate RAW Material demand data to responsible for forecasting and planning.Manage all Freight and Packaging spend - InwardMonitor transportation costs and providers- InwardProblem solving logistical issues to support improvement plansManage engagement with Sales, Marketing and...
Banker-Customer Experience
IDFC FIRST Bank,
Faridabad, Haryana
1 week ago
Job RequirementsRole/Job Title - Banker-Customer ExperienceBusiness - Retail BankingFunction/ Department: 'Branch BankingPlace of work: PAN IndiaJob PurposeThe role entails providing best in-class customer service to become their banking partner of choice through efficient and cost effective customer engagement. The role bearer would be responsible for client engagement, customer service, operations, liability build up, cross sales at the designated branch and...
Brand Manager in Faridabad
That's Creative,
Faridabad, Haryana
2 weeks ago
Key Responsibilities Develop and execute comprehensive social media and digital marketing strategies to increase brand awareness and engagement Manage key accounts and maintain strong relationships with clients to ensure satisfaction and loyalty Provide creative direction to design and content teams to ensure brand consistency and quality Analyze market trends and consumer insights to identify opportunities for growth and innovation Collaborate...
