Senior Data Engineer - 100% Remote

VGreen Technology Solutions (VGreenTEK)


Date: 9 hours ago
City: Chennai, Tamil Nadu
Contract type: Contractor
Remote

Job Title: Senior Data Engineer

Experience: 8–12 Years

Location: Remote

Key Responsibilities:

Design, build, and maintain scalable data pipelines using Databricks and Apache Spark.

Develop and maintain robust data architecture and ETL/ELT frameworks for structured and unstructured data.

Collaborate with Data Scientists and ML Engineers to enable end-to-end ML model pipelines - from data ingestion and feature engineering to model deployment and monitoring.

Ensure data quality, integrity, and governance across various data sources and systems.

Optimize data processing jobs for performance and cost-effectiveness in cloud environments (preferably Azure or AWS).

Implement best practices for CI/CD, data versioning, and workflow orchestration (e.g., using Airflow, MLflow, Delta Lake, etc.).

Required Skills and Qualifications:

8–12 years of experience in data engineering, with a strong background in big data technologies.

Expertise in Databricks, Apache Spark, Delta Lake, and associated cloud data services.

Solid experience in designing and implementing data lakehouses, data warehouses, and real-time/streaming data pipelines.

Proficient in Python, SQL, and at least one cloud platform (Azure preferred; AWS/GCP also acceptable).

Strong understanding of ML lifecycle, including feature stores, model training, and inference pipelines.

Hands-on experience integrating and scaling AI/ML models in production environments.

Experience with CI/CD tools, infrastructure as code, and version control (e.g., Git, Terraform).

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

JUNIOR TRAFFIC MANAGER

Larsen & Toubro, Chennai, Tamil Nadu
17 hours ago
Traffic Manager supervise the activities of assigned engineering and administrative staff and oversee the design of signing and striping, traffic control, traffic signal timing, traffic signal and intelligent transportation systems (ITS), and the preparation of project reports, plans, specifications, estimates, grant applications, progress reports, and other technical documents. Senior Engineers also perform traffic and transportation research, analysis, planning, and design....

Finance - Intern

Valeo, Chennai, Tamil Nadu
21 hours ago
Job SummaryWe are looking for a highly motivated intern to join our finance team on a 6-month internship program. The successful candidate will assist in various financial activities such as budgeting, forecasting, and analyzing financial data. This internship provides an excellent opportunity for someone interested in pursuing a career in finance or accounting.Responsibilities Assist in preparation of monthly/quarterly/annual budgets and...

Data Analytics Internship in Chennai

KritiLabs Technologies, Chennai, Tamil Nadu
4 days ago
Selected Intern's Day-to-day Responsibilities Include Collect, clean, and organize data from multiple sources Perform exploratory data analysis Document data processes and analysis workflowsAbout Company: We are an IoT, AI, and ML-based technology solutions company catering to the B2B sector. Most of our solutions focus on safety, security, and process compliance. Currently, we serve various industries including oil & gas, mines...