GCP with PySpark - Lead
UST
Date: 1 week ago
City: Thiruvananthapuram, Kerala
Contract type: Full time
Role Description
UST is looking for a talented GCP Data Engineer with 5 to 10 years of experience to join our team and play a crucial role in designing and implementing efficient data solutions on the Google Cloud Platform (GCP). The ideal candidate should possess strong data engineering skills, expertise in GCP services, and proficiency in data processing technologies, particularly PySpark.
Responsibilities
Data Pipeline Development:
GCP, PySpark
UST is looking for a talented GCP Data Engineer with 5 to 10 years of experience to join our team and play a crucial role in designing and implementing efficient data solutions on the Google Cloud Platform (GCP). The ideal candidate should possess strong data engineering skills, expertise in GCP services, and proficiency in data processing technologies, particularly PySpark.
Responsibilities
Data Pipeline Development:
- Design, implement, and optimize end-to-end data pipelines on GCP, focusing on scalability and performance.
- Develop and maintain ETL workflows for seamless data processing.
- Utilize GCP services such as BigQuery, Cloud Storage, and Dataflow for effective data engineering.
- Implement and manage data storage solutions on GCP.
- Leverage PySpark for advanced data transformations, ensuring high-quality and well-structured output.
- Implement data cleansing, enrichment, and validation processes using PySpark.
- Proven experience as a Data Engineer, with a strong emphasis on GCP.
- Proficiency in GCP services such as BigQuery, Cloud Storage, and Dataflow.
- Expertise in PySpark for data processing and analytics is a must.
- Experience with data modeling, ETL processes, and data warehousing.
- Proficiency in programming languages such as Python, SQL, or Scala for data processing.
- Relevant certifications in GCP or data engineering are plus.
GCP, PySpark
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Site Reliability Developer 3
Oracle,
Thiruvananthapuram, Kerala
6 days ago
Job DescriptionThe ideal candidate will be a detail-oriented professional with a robust technical background, a proven track record in Site Reliability Engineering, and a passion for improving service reliability and performance. You should thrive in a fast-paced environment, be adept at collaborating with diverse teams, and have a proactive approach to problem-solving and continuous improvement.My Oracle Support (MOS) is Oracle's...
Senior C++ and C# Software Developer
Allnessjobs,
Thiruvananthapuram, Kerala
1 week ago
Skills:python ,, c#, C++, DEVEOPS, AZURE, GIT,Your TasksDevelop and enhance software components self-dependently within an experienced agile team.Coordinate new functionalities with stakeholders.Realize independently new functionalities.Participate in Agile software development using C++ and C# under Windows and Linux.Contribute to our DevOps efforts to build, test, and release software faster and more reliably.Your QualificationsYou have a Bachelor of Technology (BTech) or Master...
Azure DevOps : Lead Engineer
Quest Global,
Thiruvananthapuram, Kerala
3 weeks ago
Job Requirements Azure DevOps : Lead Engineer - Job DescriptionExperience: 5+ yearsWork Location: Bangalore/TVMRoles & ResponsibilitiesDesign, build and implement technical DevOps solutions to simple and medium complexity projectsAssess and identify technical gaps in the maturity of clients DevOps tools landscape and CI/CD implementationsRequired Skill SetsExperience with architecting and automating cloud native technologies, deploying applications, and provisioning infrastructure.Experience with Infrastructure as...
