Senior Data Engineer - Data Bricks
UPS
Date: 12 hours ago
City: Chennai, Tamil Nadu
Contract type: Full time

Before you apply to a job, select your language preference from the options available at the top right of this page.
Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.
Job Description
This position participates in the support of batch and real-time data pipelines utilizing various data analytics processing frameworks in support of data science practices for Marketing and Finance business units. This position supports the integration of data from various data sources, as well as performs extract, transform, load (ETL) data conversions, and facilitates data cleansing and enrichment. This position performs full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, implementation of systems and applications software. This position participates and contributes to synthesizing disparate data sources to support reusable and reproducible data assets.
Responsibilities
3 years of experience with Databricks, Apache Spark, Python, and SQL
Preferred Skills
DeltaLake Unity Catalog, R, Scala, Azure Logic Apps, Cloud Services Platform (e.g., GCP, or AZURE, or AWS), and AGILE concepts.
Employee Type
Permanent
UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.
Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.
Job Description
This position participates in the support of batch and real-time data pipelines utilizing various data analytics processing frameworks in support of data science practices for Marketing and Finance business units. This position supports the integration of data from various data sources, as well as performs extract, transform, load (ETL) data conversions, and facilitates data cleansing and enrichment. This position performs full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, implementation of systems and applications software. This position participates and contributes to synthesizing disparate data sources to support reusable and reproducible data assets.
Responsibilities
- Supervises and supports data engineering projects and builds solutions by leveraging a strong foundational knowledge in software/application development. He/she is hands on.
- Develops and delivers data engineering documentation.
- Gathers requirements, defines the scope, and performs the integration of data for data engineering projects.
- Recommends analytic reporting products/tools and supports the adoption of emerging technology.
- Performs data engineering maintenance and support.
- Provides the implementation strategy and executes backup, recovery, and technology solutions to perform analysis.
- Performs ETL tool capabilities with the ability to pull data from various sources and perform a load of the transformed data into a database or business intelligence platform.
- Codes using programming language used for statistical analysis and modeling such as Python/Spark
- Literate in the programming languages used for statistical modeling and analysis, data warehousing and Cloud solutions, and building data pipelines.
- Proficient in developing notebooks in Data bricks using Python and Spark and Spark SQL.
- Strong understanding of a cloud services platform (e.g., GCP, or AZURE, or AWS) and all the data life cycle stages. Azure is preferred.
- Proficient in using Azure Data Factory and other Azure features such as LogicApps.
- Preferred to have knowledge of Delta lake, Lakehouse and Unity Catalog concepts.
- Strong understanding of cloud-based data lake systems and data warehousing solutions.
- Has used AGILE concepts for development, including KANBAN and Scrums
- Strong understanding of the data interconnections between organizations’ operational and business functions.
- Strong understanding of the data life cycle stages - data collection, transformation, analysis, storing the data securely, providing data accessibility
- Strong understanding of the data environment to ensure that it can scale for the following demands: Throughput of data, increasing data pipeline throughput, analyzing large amounts of data, Real-time predictions, insights and customer feedback, data security, data regulations, and compliance.
- Strong knowledge of algorithms and data structures, as well as data filtering and data optimization.
- Strong understanding of analytic reporting technologies and environments (e.g., Power BI, Looker, Qlik, etc.)
- Understanding of distributed systems and the underlying business problem being addressed, as well as guides team members on how their work will assist by performing data analysis and presenting findings to the stakeholders.
- Bachelor’s degree in MIS, mathematics, statistics, or computer science, international equivalent, or equivalent job experience.
3 years of experience with Databricks, Apache Spark, Python, and SQL
Preferred Skills
DeltaLake Unity Catalog, R, Scala, Azure Logic Apps, Cloud Services Platform (e.g., GCP, or AZURE, or AWS), and AGILE concepts.
Employee Type
Permanent
UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Datacom testing
Capgemini,
Chennai, Tamil Nadu
14 hours ago
Location: BangaloreExperience: 9-12 YearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the value of technology and drive scalable, sustainable growth.Your RoleAs a Software Engineer, you will contribute to the...

Vigilance Associate
IDFC FIRST Bank,
Chennai, Tamil Nadu
2 days ago
Job RequirementsJob Requirements Role/Job Title: Vigilance AssociateFunction: VigilanceJob PurposeVigilance Associate shall be responsible for managing and maintaining effective communication/liaison with Law Enforcement Authorities and external counsels within defined turnaround time.ResponsibilitiesRoles & Responsibilities: To manage and maintain effective communication/liaison with Law Enforcement Authorities and external counsels within defined turnaround time.To deal effectively with different internal stakeholders of the Bank.Maintain, Analyze and...

Courier
FedEx,
Chennai, Tamil Nadu
3 days ago
Responsible for the completion of operational processes at station and hub locations which may include ramp and sort operations, courier and despatch operations. Ensures processes are completed safely and in a timely fashion.Accuracy & Attention to Detail;Planning & Organizing Skills;Interpersonal Skills;Problem Solving Skills;Team Working SkillsFedEx was built on a philosophy that puts people first, one we take seriously. We are...
