Data Engineer, Specialist
EY
Date: 3 weeks ago
City: Hyderabad, Telangana
Contract type: Full time
Requisition Id : 1637229
Role:
The Data Engineer, Specialist is responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This role involves building robust ETL (Extract, Transform, Load) processes, managing databases and optimizing cloud-based data platforms to ensure efficient and seamless integration of data from multiple sources.
Roles & Responsibilities:
Develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from diverse sources, transform it as required and load it into data warehouses or analytical systems.
Design and optimize database architectures and data pipelines to ensure high performance, availability and security while supporting structured and unstructured data.
Integrate data from multiple sources, including APIs, third-party services and on-prem/cloud databases to create unified and consistent datasets for analytics and reporting.
Collaborate with data scientists, analysts and business stakeholders to understand their data needs, develop data solutions and enable self-service analytics.
Develop automated workflows and data processing scripts using Python, Spark, SQL, or other relevant technologies to streamline data ingestion and transformation.
Optimize data storage and retrieval strategies in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure Synapse, ensuring scalability and cost-efficiency.
Maintain and improve data quality by implementing validation frameworks, anomaly detection mechanisms and data cleansing processes.
Thoroughly tests code to ensure accuracy and alignment with its intended purpose. Reviews the final product with end users to confirm clarity and understanding, providing data analysis guidance as needed.
Offers tool and data support to business users and team members, ensuring seamless functionality and accessibility.
Conducts regression testing for new software releases, identifying issues and collaborating with vendors to resolve them and successfully deploy the software into production.
Role:
The Data Engineer, Specialist is responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This role involves building robust ETL (Extract, Transform, Load) processes, managing databases and optimizing cloud-based data platforms to ensure efficient and seamless integration of data from multiple sources.
Roles & Responsibilities:
Develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from diverse sources, transform it as required and load it into data warehouses or analytical systems.
Design and optimize database architectures and data pipelines to ensure high performance, availability and security while supporting structured and unstructured data.
Integrate data from multiple sources, including APIs, third-party services and on-prem/cloud databases to create unified and consistent datasets for analytics and reporting.
Collaborate with data scientists, analysts and business stakeholders to understand their data needs, develop data solutions and enable self-service analytics.
Develop automated workflows and data processing scripts using Python, Spark, SQL, or other relevant technologies to streamline data ingestion and transformation.
Optimize data storage and retrieval strategies in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure Synapse, ensuring scalability and cost-efficiency.
Maintain and improve data quality by implementing validation frameworks, anomaly detection mechanisms and data cleansing processes.
Thoroughly tests code to ensure accuracy and alignment with its intended purpose. Reviews the final product with end users to confirm clarity and understanding, providing data analysis guidance as needed.
Offers tool and data support to business users and team members, ensuring seamless functionality and accessibility.
Conducts regression testing for new software releases, identifying issues and collaborating with vendors to resolve them and successfully deploy the software into production.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Senior Business Analyst
Bristol Myers Squibb,
Hyderabad, Telangana
1 day ago
Working with UsChallenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the lives of patients, and the careers of...
AVP - OPS RISK AND CONTROL
HSBC,
Hyderabad, Telangana
2 weeks ago
Some Careers Have More Impact Than Others.If you’re looking for a career where you can make a real impression, join HSBC and discover how valued you’ll be.HSBC is one of the largest banking and financial services organisations in the world, with operations in 62 countries and territories. We aim to be where the growth is, enabling businesses to thrive and...
Senior Scientific Writer I
Novartis India,
Hyderabad, Telangana
2 weeks ago
SummaryTo write, support and manage projects to prepare high quality medical and scientific communications including, literature review, abstracts, posters, slide sets, Manuscripts for publication/ presentation at congresses or assets to be used by internal medical teams.About The RoleProfile Summary: Prepare literature review, abstracts, posters, and slide sets working from various data sources including clinical study reports, patient profiles etc.. Timely...
