Lead I - Data Engineering
UST Global
-
ID: 59123
5 - 7 Years
2 Openings
Trivandrum
Role description
Sr/Lead Data Engineer
Total Experience: 7 - 9 YearsJob Summary
We are looking for a highly skilled Data Engineer. The engineer will be responsible for building, enhancing, and supporting scalable data pipelines and transformation frameworks that power enterprise-grade data products.
The platform leverages Snowflake as the enterprise data lake, with Oracle GoldenGate, Kafka, and Java-based microservices enabling high-volume real-time and batch data ingestion and transformation. The role involves close collaboration with architects, business teams, and external customer integration teams.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Snowflake, Kafka, and Oracle GoldenGate.
- Develop and enhance Java-based microservices for data transformation and ingestion into Snowflake staging layers.
- Create and optimize Snowflake tables, views, streams, tasks, and stored procedures.
- Build reusable ingestion and transformation frameworks for structured and semi-structured data.
- Develop high-performance SQL queries and optimize Snowflake workloads.
- Support near real-time and batch data integration processes.
- Collaborate with downstream consumers and external customer teams for data exposure and integration.
- Troubleshoot production issues and perform root cause analysis.
- Implement data validation, reconciliation, and monitoring mechanisms.
- Participate in CI/CD, automation, and DevOps initiatives.
Required Skills
- Strong experience in Snowflake development and optimization.
- Hands-on experience with Kafka and streaming architectures.
- Experience with Oracle GoldenGate replication technologies.
- Strong Java programming experience with microservices architecture.
- Expertise in SQL and relational database concepts.
- Experience in ETL/ELT pipeline development.
- Understanding of data warehousing and data lake concepts.
- Experience with Linux/Unix environments and shell scripting.
- Familiarity with Git, Jenkins, and CI/CD pipelines.
Preferred Skills
- Experience with telecom or enterprise data platforms.
- Knowledge of cloud platforms such as AWS or Azure.
- Exposure to Airflow or workflow orchestration tools.
- Understanding of data governance and security standards.
Education
Bachelor’s degree in Computer Science, Engineering, or related field.
Skills
data architecture,snowflake,kafka,oracle goldengate,azure ad,kubernetes,
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Motion Graphics Designer
Lead II - Enterprise Solutions
Lead I - Production Support