Senior Data Engineer - 100% Remote

VGreen Technology Solutions (VGreenTEK)


Date: 7 hours ago
City: Chennai, Tamil Nadu
Contract type: Contractor
Remote

Job Title: Senior Data Engineer

Experience: 8–12 Years

Location: Remote

Key Responsibilities:

Design, build, and maintain scalable data pipelines using Databricks and Apache Spark.

Develop and maintain robust data architecture and ETL/ELT frameworks for structured and unstructured data.

Collaborate with Data Scientists and ML Engineers to enable end-to-end ML model pipelines - from data ingestion and feature engineering to model deployment and monitoring.

Ensure data quality, integrity, and governance across various data sources and systems.

Optimize data processing jobs for performance and cost-effectiveness in cloud environments (preferably Azure or AWS).

Implement best practices for CI/CD, data versioning, and workflow orchestration (e.g., using Airflow, MLflow, Delta Lake, etc.).

Required Skills and Qualifications:

8–12 years of experience in data engineering, with a strong background in big data technologies.

Expertise in Databricks, Apache Spark, Delta Lake, and associated cloud data services.

Solid experience in designing and implementing data lakehouses, data warehouses, and real-time/streaming data pipelines.

Proficient in Python, SQL, and at least one cloud platform (Azure preferred; AWS/GCP also acceptable).

Strong understanding of ML lifecycle, including feature stores, model training, and inference pipelines.

Hands-on experience integrating and scaling AI/ML models in production environments.

Experience with CI/CD tools, infrastructure as code, and version control (e.g., Git, Terraform).

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

P1

Polycab India Limited, Chennai, Tamil Nadu
10 hours ago
Department: - Sales & MarketingPromoting and selling company products at assigned locationsCompleting mandatory product and compliance trainingCollaborating with members of different teamsDeveloping engaging sales pitches for different target customersCollecting customer contact information and following up with leadsMaintaining the customer databaseCreating sales, needs analysis and cost–benefit reportsMust have two-wheeler. Location:- Salem, Coimbatore, Trichy and ErodePreference to be given to Local and...

Architect / Interior Designer

Fueling Brains & Academies, Chennai, Tamil Nadu
3 days ago
About UsFueling Brains is a leader in early childhood education, committed to designing and delivering high-quality learning environments that inspire and nurture young children. As we continue to grow, we areexpanding our real estate and development team to support the creation of new campuses and theenhancement of existing facilities. We are seeking an Architect to support theplanning, execution, and delivery...

Supply Chain Analyst

Ford Motor Company, Chennai, Tamil Nadu
3 days ago
Job DescriptionCollaborate with suppliers to obtain their qualitative shipment plans for a minimum of first 13 weeks against Ford demand in ASCENT tool every week Receive exceptions/issues via ASCENT and triage cases in PEGA platform to concerned Ford teams for issue resolution.ResponsibilitiesCollaborate with multiple skill teams at Ford [ Purchasing , Supplier Technical Assistance , MP&L..] that requires production mitigation...