Data Engineer - Data Engineer

Deqode


Date: 3 weeks ago
City: Bhopāl, Madhya Pradesh
Contract type: Full time
Responsibilities

  • Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation.
  • Work closely with analysts/data scientists to understand impact to the downstream data models.
  • Write efficient and well-organized software to ship products in an iterative, continual release environment.
  • Contribute to and promote good software engineering practices across the team
  • Communicate clearly and effectively to technical and non-technical audiences.

Minimum Qualifications

  • University or advanced degree in engineering, computer science, mathematics, or a related field
  • Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity Catalog, workflows, Optimization techniques)
  • Experience with at least one cloud provider solution (GCP preferred)
  • Strong experience working with relational SQL databases.
  • Strong experience with object-oriented/object function scripting language : Python.
  • Working knowledge in any transformation tools, DBT preferred.
  • Ability to work with Linux platform.
  • Strong knowledge of data pipeline and workflow management tools (Airflow)
  • Working knowledge of Git hub /Git Toolkit
  • Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
  • Experience creating Data pipelines that prepare data for ingestion & consumption appropriately.
  • Experience in maintaining and optimizing databases/filesystems for production usage in reporting, analytics.
  • Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well.
  • Good verbal and written communication skill

(ref:hirist.tech)

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Team Lead - AMZL , ATSPL - MP

Amazon, Bhopāl, Madhya Pradesh
1 week ago
DescriptionAt Amazon, we're working to be the most customer-centric company on earth. To get there, we need exceptionally talented, bright, and driven people. Amazon is seeking Team leads for our transportation team. Amazon is one of the most recognizable brand names in the world and we distribute millions of products each year to our loyal customersWe're seeking Team Lead for...

Deputy Manager-Acquisition (Household)

IDFC FIRST Bank, Bhopāl, Madhya Pradesh
2 weeks ago
Job RequirementsJob Description: Deputy Manager-Acquisition (Household) at IDFC FIRST BankCompany Name: IDFC FIRST BankJob Title: Deputy Manager-Acquisition (Household)Job Type: Full-TimeJob Category: Sales & Relationship Management- Retail BankingDepartment: Retail Banking > Branch Banking > BranchLocation: Bhopal, Madhya Pradesh, IndiaAdditional ParametersIDFC FIRST Bank is a leading financial institution in India, committed to providing innovative and customer-centric banking solutions. We are currently seeking...

Digital Marketing Executive in Bhopal

Satya Kabir E-Solutions Private Limited, Bhopāl, Madhya Pradesh
3 weeks ago
Key Responsibilities Create, curate, and manage published content across social media platforms, including Facebook, Instagram, Twitter, LinkedIn, and others. Develop engaging and relevant content (text, images, videos) that aligns with our brand voice and goals. Collaborate with designers and content creators to produce high-quality visuals and multimedia. Stay updated with the latest trends, tools, and best practices in social media...