Data Engineer
Refactor Academy
Date: 4 days ago
City: Hyderabad, Telangana
Contract type: Full time
We are seeking an experienced Data Engineer to join our team on a contractual basis for 3 months (extendable). The ideal candidate will have 4+ years of hands-on experience in data engineering, with advanced proficiency in SQL, and 3+ years of experience with Python and PySpark. This role requires flexibility to work in the 1 PM to 10 PM (timezone) shift.
Responsibilities
Responsibilities
- Data Integration and ETL: Develop, maintain, and optimize data pipelines and ETL processes to ensure efficient data processing and integration from multiple sources.
- Advanced SQL: Design, query, and optimize complex SQL queries to extract, transform, and load (ETL) data efficiently. Proficient in writing optimized queries for large datasets and ensuring high performance.
- Python and PySpark: Utilize Python for data manipulation, cleaning, and processing. Work extensively with PySpark to handle large-scale data processing and distributed computing tasks.
- Data Modeling and Warehousing: Assist in designing, building, and maintaining data models and data warehouses, ensuring data integrity and performance.
- Collaboration: Work closely with data scientists, analysts, and other engineers to understand data needs and optimize data workflows.
- Troubleshooting and Optimization: Diagnose, troubleshoot, and resolve data-related issues and performance bottlenecks.
- Documentation: Create and maintain documentation for data pipelines, processes, and data structures.
- 4+ years of experience in data engineering or a related field.
- Advanced SQL knowledge with experience in writing optimized queries for large databases.
- 3+ years of experience in Python for data processing and automation.
- 3+ years of hands-on experience with PySpark for distributed data processing.
- Strong understanding of data modeling and database management.
- Familiarity with cloud platforms (AWS, GCP, or Azure) is a plus.
- Good understanding of data pipelines, ETL tools, and big data ecosystems.
- Ability to work in a collaborative, fast-paced environment.
- Strong problem-solving and debugging skills.
- Excellent communication skills and ability to work in a remote team.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Desktop Administrator II, IT Infrastructure
Ryan,
Hyderabad, Telangana
2 days ago
Why Ryan?Global Award-Winning CultureFlexible Work EnvironmentGenerous Paid Time OffWorld-Class Benefits and CompensationRapid Growth OpportunitiesCompany Sponsored Two-Way TransportationExponential Career GrowthJob Profile SummaryThe Desktop Administrator II (“Desktop Administrator”) maintains and manages distributed desktop and laptop systems and software, including, but not limited to, installation, configuration, preventive maintenance, operation, and problem-resolution activities.Duties and responsibilities, as they align to Ryan’s Key ResultsPeopleCreate a positive...
Quality Assurance Engineer
Epiq,
Hyderabad, Telangana
4 days ago
It's fun to work at a company where people truly believe in what they are doing!Job Description:Summary:The role involves writing, automating, and executing functional test cases for new software enhancements to ensure full application test coverage. Key tasks include collaborating with cross-functional teams to address software issues, testing APIs using tools like Postman and Swagger, and maintaining test automation frameworks....
Software Engineering Manager, Corporate Engineering
Google,
Hyderabad, Telangana
4 days ago
Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Hyderabad, Telangana, India; Gurgaon, Haryana, India.Minimum qualifications:Bachelor’s degree, or equivalent practical experience.8 years of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript).3 years of experience in a technical leadership role; overseeing projects,...
