RandomTrees - Senior Data Engineer - PySpark/Azure Databricks
RandomTrees
Date: 7 hours ago
City: Hyderabad, Telangana
Contract type: Full time
About The Job
We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data pipelines.
The ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).
You will be responsible for developing efficient data solutions, optimizing workflows, and ensuring data reliability to support business decisions.
Key Responsibilities
We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data pipelines.
The ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).
You will be responsible for developing efficient data solutions, optimizing workflows, and ensuring data reliability to support business decisions.
Key Responsibilities
- Design, develop, and deploy high-performance data pipelines using PySpark, Databricks, and Azure Data Factory (ADF).
- Optimize and maintain SQL queries, stored procedures, and ETL processes for large-scale data processing.
- Work with Azure cloud services (Azure Data Lake, Azure Synapse, Blob Storage, etc.) to build scalable data solutions.
- Implement data integration, transformation, and warehousing solutions in Databricks.
- Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver actionable insights.
- Ensure data quality, governance, and security best practices across all pipelines.
- Troubleshoot and resolve data-related issues in production environments.
- Automate workflows and improve efficiency using CI/CD pipelines.
- Mentor junior engineers and provide technical guidance.
- 7+ years of hands-on experience in Data Engineering.
- Strong expertise in PySpark for large-scale data processing.
- Proficiency in SQL (query optimization, stored procedures, performance tuning).
- Hands-on experience with Azure cloud services (ADF, Azure Data Lake, Synapse, Blob Storage, etc.)
- Experience with Databricks (Delta Lake, Spark optimization, notebook workflows).
- Knowledge of data modeling, ETL/ELT processes, and data warehousing.
- Familiarity with Python, Shell scripting, and automation.
- Understanding of CI/CD pipelines and DevOps practices (Git, Azure DevOps).
- Strong problem-solving skills and ability to work in a fast-paced environment.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
MM - Solution Architect - L4
NTT DATA Business Solutions,
Hyderabad, Telangana
1 hour ago
Job DescriptionJob Description – Senior SAP MM Consultant (Level 4)Experience: 12+ YearsRole SummaryLead the SAP MM workstream for SAP S/4HANA implementation, rollout, and transformation projects. Collaborate with business stakeholders to design, configure, test, and deploy scalable Procure-to-Pay (P2P) solutions aligned with SAP Best Practices and Clean Core principles.Key ResponsibilitiesLead business workshops and gather functional requirements.Design and configure SAP MM solutions...
Executive Senior - Admin
Bondada Group,
Hyderabad, Telangana
3 hours ago
Designation: Executive – Travel DeskDepartment: Administration / Travel DeskEmployment Type: Full Time, PermanentRole Category: Administration & Travel OperationsLocation: Hyderabad, ECIL X RoadsReporting: Travel Desk Lead / Administration ManagerRole OverviewWe are looking for a detail-oriented and service-oriented Travel Desk Executive to coordinate official domestic and international travel arrangements for employees and business stakeholders. The role covers flight, hotel and cab bookings,...
Lead Engineer - SW Design - RAIL
Silicon Labs,
Hyderabad, Telangana
1 day ago
Silicon Labs (NASDAQ: SLAB) is the leading innovator in low-power wireless connectivity, building embedded technology that connects devices and improves lives. Merging cutting-edge technology into the world’s most highly integrated SoCs, Silicon Labs provides device makers the solutions, support, and ecosystems needed to create advanced edge connectivity applications. Headquartered in Austin, Texas, Silicon Labs has operations in over 16 countries...
