Staff Engineer Data

Job Description

Job Description

As a Senior Staff Engineer, you'll be at the forefront of designing, developing, and scaling our pipelines and infrastructure. You'll collaborate closely with cross-functional teams to ensure data quality, reliability, and security. Your expertise in cloud technologies and big data will be instrumental in creating a platform that can handle massive data volumes and deliver real-time insights. You deeply understand the problem and customer needs, leaving no room for ambiguity. Your solutions exceed expectations, often surprising customers. You persistently tackle challenges and seek solutions, never giving up easily.You are known for sharing knowledge, admitting mistakes, and fostering a comfortable and inclusive team environment. Persistence is your strong suit, and you always finish what you start.

What Will You Do

• Lead the design, development, and maintenance of cloud-based platforms, data pipelines and infrastructure, ensuring scalability, reliability, and security.
• Architect and implement highly available, fault-tolerant systems on cloud platforms such as AWS, Azure, or Google Cloud.
• Collaborate with cross-functional teams to define platform requirements, establish best practices, and drive architectural decisions.
• Provide technical leadership and mentorship to engineering teams, fostering a culture of innovation and continuous improvement.
• Drive initiatives to enhance platform scalability, stability, compliance, and governance, ensuring adherence to industry standards and regulatory requirements.
• Architect and build product , inventory data pipelines and platform that will power all our sites
• Develop clean, safe, testable and cost-efficient solutions; Build fast and reliable pipeline, platform with underlying data model that can scale according to business needs and growth
• Work with backend engineers to create services that can ingest and supply data to and from external sources, provide data streaming solutions and ensure data quality and timeliness
• Understand the system you are building, foresee shortcomings ahead of time and be able to resolve or compromise appropriately
• Work closely with data scientists, analysts, and business stakeholders to understand requirements. Job Requirements
  
  

What We're Looking For

• Bachelor's degree or equivalent practical experience; Master’s degree preferred.
• 10 years of experience in software development, and with data structures/algorithms.
• 5+ Experience in cloud architecture and Big Data technologies such as Hadoop, Amazon EMR, Pig, Hive, Spark, Redshift.
• Expertise in SQL technologies and RDBMS (PostgreSQL, AWS RDS, MySQL).
• Must have experience in building data platform – designing and building data model, integrate data from many sources, build ETL and data-flow pipelines, and support all parts of the data platform.
• Strong problem-solving abilities and a passion for tackling complex technical challenges.
• Must have experience in developing application with high performance and low latency
• Experience in Web Services, API integration, Data exchanges with third parties is preferred.
• Data Analysis skill – can make arguments with data and proper visualization.
• Energetic, enthusiastic, detail-oriented, and passionate about producing high-quality analytics deliverable.
• Proven expertise in hands-on engineering on cloud platforms (AWS, Azure, or GCP), including but not limited to: data ingestion, transformation, processing, storage, and serving.
• Demonstrated experience with cloud-native services for data engineering, such as data lakes, data warehouses, data pipelines, and serverless computing.