Snowflake with PySpark - Lead

Role Description

UST is looking for a skilled Snowflake Engineer with 5 to 7 years of experience to join our team and contribute to the development and maintenance of efficient data solutions on the Snowflake cloud data platform. The ideal candidate should possess strong data engineering skills, expertise in Snowflake, and proficiency in data processing technologies, with a specific focus on PySpark.

Snowflake Data Warehouse

• Design, implement, and optimize data warehouses on the Snowflake platform.
• Ensure effective utilization of Snowflake features for scalable and high-performance data storage.
  
  

Data Pipeline Development

• Develop, implement, and optimize end-to-end data pipelines on Snowflake.
• Create and maintain ETL workflows for seamless data processing.
  
  

Data Transformation With PySpark

• Leverage PySpark for advanced data transformations within the Snowflake environment.
• Implement data cleansing, enrichment, and validation processes using PySpark.
  
  

Requirements

• Proven experience as a Data Engineer, with a strong emphasis on Snowflake.
• Proficiency in Snowflake features and capabilities for data warehousing.
• Expertise in PySpark for data processing and analytics is a must.
• Experience with data modeling, ETL processes, and efficient data storage.
• Proficiency in programming languages such as Python, SQL, or Scala for data processing.
  
  

Skills

Snowflake, PySpark