Data Engineer - Data Engineer

Deqode


Date: 1 day ago
City: Bhopāl, Madhya Pradesh
Contract type: Full time
Responsibilities

  • Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation.
  • Work closely with analysts/data scientists to understand impact to the downstream data models.
  • Write efficient and well-organized software to ship products in an iterative, continual release environment.
  • Contribute to and promote good software engineering practices across the team
  • Communicate clearly and effectively to technical and non-technical audiences.

Minimum Qualifications

  • University or advanced degree in engineering, computer science, mathematics, or a related field
  • Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity Catalog, workflows, Optimization techniques)
  • Experience with at least one cloud provider solution (GCP preferred)
  • Strong experience working with relational SQL databases.
  • Strong experience with object-oriented/object function scripting language : Python.
  • Working knowledge in any transformation tools, DBT preferred.
  • Ability to work with Linux platform.
  • Strong knowledge of data pipeline and workflow management tools (Airflow)
  • Working knowledge of Git hub /Git Toolkit
  • Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
  • Experience creating Data pipelines that prepare data for ingestion & consumption appropriately.
  • Experience in maintaining and optimizing databases/filesystems for production usage in reporting, analytics.
  • Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well.
  • Good verbal and written communication skill

(ref:hirist.tech)

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Associate Manager-Acquisition (Household)

IDFC FIRST Bank, Bhopāl, Madhya Pradesh
2 days ago
Job RequirementsJob Title: Associate Manager-Acquisition (Household)Company Name: IDFC FIRST BankJob Type: Full-TimeJob Category: Sales & Relationship Management- Retail BankingDepartment: Retail Banking > Branch Banking > BranchLocation: Kolar Rd, Bhopal, Madhya Pradesh, IndiaAdditional ParametersIDFC FIRST Bank is seeking a highly motivated and results-driven individual to join our team as an Associate Manager-Acquisition (Household). As a leading bank in the retail banking...

Banking Loan Officer in Madhya Pradesh, Karnataka, Bhopal, Tamilpadi, Telangana, Andhra Pradesh, Bhuwaneshwar, Rajasthan, Sebakapur, Begumpet, Jharkhandi, Hyderabad, Raipur, Nagpur, Lucknow

WeMakeScholars, Bhopāl, Madhya Pradesh
2 days ago
Key Responsibilities Working on being familiar with the underwriting criteria of our partner banks, which include SBI, BOB, ICICI, Axis Bank, HDFC, etc. Screening the education loan applications, advising students on the documentation, and coordinating with bank staff for smooth processing of the education loan Working on solving students' queries Managing the process from eligibility to the sanctioning of the...

English Trainer

Frankfinn Aviation Services Pvt. Limited, Bhopāl, Madhya Pradesh
2 weeks ago
Giving English Training and teaching on:- English Grammar and Technicality Phonetics and Syllables Vocabulary- Excellent Pronunciation PSK (Public Speech Knowledge) Linguistic Phrases- Excellent Accent and Voice Quality