Data Engineer

IDFC FIRST Bank


Date: 3 weeks ago
City: Thāne, Maharashtra
Contract type: Full time
Job Requirements

Role/ Job Title: Data Engineer

Business: New Age

Function/ Department: Data & Analytics

Place of Work: Mumbai

Roles & Responsibilities

'Minimum 2-3 years of Data Engineering experience

Proven experience in in SQL, Spark, Hadoop ecosystem

Have worked on multiple TBsof data volume from ingestion to consumption

Work with business stakeholders to identify and document high impact business problems and potential solutions

Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (cloudera, hortonworks) and/or AWS

Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API and its usability

A suitable candidate will also be proficient in Spark, Spark Streaming, hive, SQLs

A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.

The candidate will additionally demonstrate substantial experience and a deep knowledge of relational databases.

Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning

Creating Technical Design Documentation of the projects/pipelines

Secondary Responsibilities

'Ability to work independently and handle your own development effort.

Excellent oral and written communication skills Learn and use internally available analytic technologies

Identify key performance indicators and create educational/deliverables path to achieve the same

Use educational background in data engineering and perform data mining analysis

Work with BI analysts/engineers to create prototypes

Engage in the delivery and presentation of solutions

Key Success Metrics

'Ensure timely deliverables.

Write and maintain excellent code quality Spot Data fixes. Solutionize technical aspects of the projects. Error free deliverables.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Assistant Manager Guest Service @ibis Thane

Accor, Thāne, Maharashtra
1 week ago
Company DescriptionJoin us at Accor, where life pulses with passion!As a pioneer in the art of responsible hospitality, the Accor Group gathers more than 45 brands, 5,600 hotels, 10,000 restaurants, and lifestyle destinations in 110 countries. While each brand has its own personality, where you will be able to truly find yourself, they all share a common ambition: to keep...

Assistant/ Deputy Manager - Application Engineering - Thane, Maharashtra

voestalpine, Thāne, Maharashtra
2 weeks ago
IntroductionThe people are what make the difference in voestalpine.The people who produce, transform and refine high quality steel processes and products in flexible and specialized companies around the world. The people who take on the challenges of our clients. People with concerns to find even better solutions. It's the people like you that keep voestalpine one step ahead.Who we arevoestalpine...

EHS Professional - Customer Services

Siemens, Thāne, Maharashtra
4 weeks ago
We at Smart Infrastructure Division in Siemens Ltd. is one of the top tier global suppliers of products, systems, solutions, and services for the efficient, reliable, and intelligent transmission and distribution of electrical power. As the trusted partner for the development and extension of an efficient and reliable power infrastructure that industry and the portfolio they need.JOIN US! WE MAKE...