Data Engineer, Specialist
EY
Date: 4 hours ago
City: Hyderabad, Telangana
Contract type: Full time
Requisition Id : 1637229
Role:
The Data Engineer, Specialist is responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This role involves building robust ETL (Extract, Transform, Load) processes, managing databases and optimizing cloud-based data platforms to ensure efficient and seamless integration of data from multiple sources.
Roles & Responsibilities:
Develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from diverse sources, transform it as required and load it into data warehouses or analytical systems.
Design and optimize database architectures and data pipelines to ensure high performance, availability and security while supporting structured and unstructured data.
Integrate data from multiple sources, including APIs, third-party services and on-prem/cloud databases to create unified and consistent datasets for analytics and reporting.
Collaborate with data scientists, analysts and business stakeholders to understand their data needs, develop data solutions and enable self-service analytics.
Develop automated workflows and data processing scripts using Python, Spark, SQL, or other relevant technologies to streamline data ingestion and transformation.
Optimize data storage and retrieval strategies in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure Synapse, ensuring scalability and cost-efficiency.
Maintain and improve data quality by implementing validation frameworks, anomaly detection mechanisms and data cleansing processes.
Thoroughly tests code to ensure accuracy and alignment with its intended purpose. Reviews the final product with end users to confirm clarity and understanding, providing data analysis guidance as needed.
Offers tool and data support to business users and team members, ensuring seamless functionality and accessibility.
Conducts regression testing for new software releases, identifying issues and collaborating with vendors to resolve them and successfully deploy the software into production.
Role:
The Data Engineer, Specialist is responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This role involves building robust ETL (Extract, Transform, Load) processes, managing databases and optimizing cloud-based data platforms to ensure efficient and seamless integration of data from multiple sources.
Roles & Responsibilities:
Develop and maintain scalable ETL (Extract, Transform, Load) processes to efficiently extract data from diverse sources, transform it as required and load it into data warehouses or analytical systems.
Design and optimize database architectures and data pipelines to ensure high performance, availability and security while supporting structured and unstructured data.
Integrate data from multiple sources, including APIs, third-party services and on-prem/cloud databases to create unified and consistent datasets for analytics and reporting.
Collaborate with data scientists, analysts and business stakeholders to understand their data needs, develop data solutions and enable self-service analytics.
Develop automated workflows and data processing scripts using Python, Spark, SQL, or other relevant technologies to streamline data ingestion and transformation.
Optimize data storage and retrieval strategies in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure Synapse, ensuring scalability and cost-efficiency.
Maintain and improve data quality by implementing validation frameworks, anomaly detection mechanisms and data cleansing processes.
Thoroughly tests code to ensure accuracy and alignment with its intended purpose. Reviews the final product with end users to confirm clarity and understanding, providing data analysis guidance as needed.
Offers tool and data support to business users and team members, ensuring seamless functionality and accessibility.
Conducts regression testing for new software releases, identifying issues and collaborating with vendors to resolve them and successfully deploy the software into production.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Senior Software Development Engineer
Oracle,
Hyderabad, Telangana
2 days ago
Job DescriptionAt Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world.Values are OCI’s foundation and how we deliver excellence. We strive for equity,...
Junior Software Engineer
Regal Rexnord,
Hyderabad, Telangana
2 days ago
To achieve the mission and success of this position, we believe you already have:Educational background in Computer science, IT, Engineering, or equivalent;At least 1 years of experience in Software Development and/or working with AGV systems;Strong knowledge in C# and .NET.Experience working with Azure cloud solutions;Fluency in English, both spoken and written;Strong collaboration and communication skills;Ability to anticipate, address, and solve...
EY - GDS Consulting - AIA - Genesys - Staff
EY,
Hyderabad, Telangana
3 days ago
At EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help to build a better working world.Staff Genesys IVR DeveloperJob Description: We are seeking an experienced Senior Genesys IVR Developer to join our team and contribute...