Sr. Specialist - Software Engineering

Job Title: Staff Engineer I - Software Engineering

Location: India (remote)

About The Job

We are looking for a highly skilled Lead Data Engineer to design, build, and maintain scalable, robust, and efficient data pipelines. The ideal candidate will lead data engineering initiatives, optimize data processing, and ensure the seamless ingestion, transformation, and virtualization of data for downstream applications.

What You Will Do

• Maintain, adapt, and update data pipeline systems to meet user requirements and enhance efficiency.
• Research and document user requirements and system specifications for data engineering solutions.
• Design and develop program logic addressing specific data engineering needs.
• Translate business requirements and functional specifications into detailed system and pipeline design specifications.
• Assume responsibility for data pipeline design activities, including defining data architecture and error message arrangements.
• Modify and document new and existing data pipelines to correct errors or enhance capabilities.
• Create and troubleshoot data pipeline code using Python and AWS cloud-based services.
• Prepare lifecycle documentation for newly created and existing data pipelines, including changes that reflect new user requirements and defect resolutions.
• Prepare reports on the status, operation, and maintenance of data systems for use by stakeholders.
• Test new and existing data pipelines to ensure they perform as expected.
• Develop, document, and implement system designs, codes, and testing standards.
• Analyze proposed changes at a system level and recommend designs and solutions that minimize impact to interfacing systems while maximizing code re-usability and maintaining business value.
• Work in coordination with other data engineers and cross-functional teams on larger projects.
  
  

Who You Are

• You have 7–9 years of relevant experience in Data Engineering, with a strong background in designing and optimizing data pipelines.
• You hold a Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
• You have a deep understanding of data modeling principles, techniques, and tools.
• You are proficient in both SQL and NoSQL databases.
• You have extensive experience in building ETL pipelines and data processing workflows.
• You possess strong Python programming skills for data engineering.
• You are well-versed in AWS cloud-based services such as DMS, EventBridge, Lambda, Redshift, RDS, S3, etc.
• You have experience with CI/CD pipelines and automation tools for data engineering.
• You understand Agile development methodologies and their implementation in data projects.
• You are knowledgeable about data security and privacy best practices, especially in the healthcare domain (e.g., HIPAA compliance).
• You have excellent analytical and problem-solving skills, enabling you to optimize data processing solutions effectively.
• You communicate effectively in a professional environment and collaborate well with cross-functional teams.
• You demonstrate confidence in your expertise, take ownership of your tasks, and are accountable for deliverables and outcomes.
• You continuously explore emerging trends, technologies, and industry best practices to enhance your skill set.
  
  

Education & Experience

• 10–14 years of relevant work experience.
• Bachelor’s degree in computer science, Computer Engineering, Software Engineering, or a related area, or equivalent experience, desired.
  
  

Technical Skills

 Programming: Python, SQL, NoSQL

 Data Engineering: ETL pipelines, data modeling, workflow orchestration (Airflow)

 Cloud & Infrastructure: AWS (DMS, EventBridge, Lambda, Redshift, RDS, S3)

 Databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, DynamoDB)

 DevOps & CI/CD: Git, Jenkins, Terraform, Docker

 Security & Compliance: Data governance, HIPAA compliance (preferred)

Soft Skills

• English Language proficiency is required to effectively communicate in a professional environment.
• Excellent communication skills are a must.
• Strong problem-solving skills and a creative mindset to bring fresh ideas to the table.
• Should demonstrate confidence and self-assurance in their skills and expertise enabling them to contribute to team success and engage with colleagues and clients in a positive, assured manner.
• Should be accountable and responsible for deliverables and outcomes.
• Should demonstrate ownership of tasks, meet deadlines, and ensure high-quality results.
• Demonstrates strong collaboration skills by working effectively with cross-functional teams, sharing insights, and contributing to shared goals and solutions.
• Continuously explore emerging trends, technologies, and industry best practices to drive innovation and maintain a competitive edge.