Python-Pyspark Developer

Infosys


Date: 2 weeks ago
City: Hyderabad, Telangana
Contract type: Full time
  • Primary skills:Python, Pyspark

We are looking for an experienced Python PySpark Developer to design, develop, and optimize large-scale data processing systems. The ideal candidate will work on big data platforms, build scalable ETL pipelines, and process high-volume datasets using Spark and Python. Key Responsibilities Data Engineering & Development Develop and maintain data pipelines using Python and PySpark Process and transform large datasets in distributed environments Build scalable ETL/ELT workflows Big Data Processing Work with Apache Spark (PySpark) for batch and real-time processing Optimize Spark jobs for performance and efficiency Handle structured and unstructured data Data Integration Ingest data from multiple sources: Databases (SQL/NoSQL) APIs Files (CSV, JSON, Parquet) Integrate with data platforms like: Hadoop (HDFS) Cloud (AWS, Azure, GCP) Performance Optimization Tune Spark jobs (partitioning, caching, parallelism) Optimize SQL queries and transformations Improve data processing efficiency and cost Collaboration & Support Work with data engineers, data scientists, and analysts Translate business requirements into technical solutions Participate in code reviews and agile development practices Monitoring & Troubleshooting Debug and resolve issues in data pipelines Monitor job execution and data quality Ensure reliability and availability of data workflows

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

EXECUTIVE N - WOOD FINISHES RELATIONSHIP (Hyderabad)

Asian Paints, Hyderabad, Telangana
3 days ago
Location:Hyderabad, TG, INAreas of Work: Sales & Marketing Job Id: 15218OverviewExternal Job DescriptionThe role is a frontline sales position responsible for driving growth and penetration of Asian Paints Wood Coatings, ranging from melamine finishes to high‑end PU (Polyurethane) and specialty wood coatings, within the defined geography. The role focuses on contractor-led demand creation, site-level engagement, and solution-driven selling, by building...

Technical Administrator - MEP

Macro, Hyderabad, Telangana
3 days ago
Location Hyderabad India Working Location Category PlacedAbout UsMacro is a recognised global specialist in facilities management, providing cutting-edge services to some of the most prominent brands offering workplace design, helpdesk services, interim property management, and providing solutions to making buildings healthier, smarter and sustainable by using advanced technological solutions.We are driven by a commitment to excellence in everything we do....

Successfactor Specialist- Assistant Manager- Hyderabad

Deloitte, Hyderabad, Telangana
1 week ago
Summary Position Summary Deloitte is seeking a SuccessFactors specialist to support SAP SuccessFactors Employee Central and Employee Central Payroll within the SuccessFactors team. This role supports day-to-day operations, issue resolution, system enhancements, and payroll compliance activities across HR and payroll processes. The role also works with cross-functional stakeholders to improve system stability, accuracy, and operational efficiency.Work you'll doAs a SuccessFactors...