Data Engineer - SQL/Python
FiftyFive Technologies
Date: 1 week ago
City: Jaipur, Rajasthan
Contract type: Full time
Role
We are looking for a Data Engineer with a minimum of 1 year of experience working with LLMs and a strong background in data pipelines, storage optimization, and AI-driven data processing. The ideal candidate will play a key role in managing, optimizing, and scaling data architectures to support LLM applications and AI :
We are looking for a Data Engineer with a minimum of 1 year of experience working with LLMs and a strong background in data pipelines, storage optimization, and AI-driven data processing. The ideal candidate will play a key role in managing, optimizing, and scaling data architectures to support LLM applications and AI :
- Design and develop scalable, high-performance data pipelines for AI and LLM-powered applications.
- Work with structured and unstructured data, ensuring efficient preprocessing, transformation, and storage.
- Implement and optimize data retrieval and indexing strategies for LLM fine-tuning and inference.
- Manage vector databases (FAISS, Chroma, Pinecone, Weaviate, Astra DB. ) for retrieval-augmented generation (RAG) workflows.
- Build and maintain ETL/ELT workflows using tools like Airflow, Prefect, or Dagster.
- Ensure data quality, governance, and lineage to support AI-driven insights.
- Collaborate with ML engineers and researchers to improve LLM data pipelines and infrastructure.
- Work with cloud-based data storage solutions (AWS S3 GCP BigQuery, Azure Data Lake, etc. ).
- Automate data monitoring, validation, and debugging to ensure seamless pipeline :
- 4+ years of overall experience in data engineering, AI infrastructure, or related fields.
- At least 1 year of hands-on experience working with LLMs and AI data workflows
- Strong expertise in Python, SQL, and distributed data processing frameworks (Spark, Dask, Ray, or similar).
- Experience with vector databases and retrieval systems for AI-driven applications.
- Knowledge of data modeling, indexing, and storage optimization
- Familiarity with ETL/ELT frameworks like Apache Airflow, Prefect, or Dagster.
- Experience handling large-scale datasets and optimizing data ingestion pipelines.
- Understanding of cloud-based data architectures (AWS, GCP, Azure).
- Basic knowledge of MLOps principles and integrating data workflows with AI models.
- Exposure to LLM fine-tuning, embeddings, and retrieval-augmented generation (RAG).
- Experience with LangChain, Hugging Face Transformers, or OpenAI APIs.
- Familiarity with feature stores (Feast, Tecton) and streaming platforms (Kafka).
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Regional Sales Manager
Jubilant Generics Limited,
Jaipur, Rajasthan
2 days ago
Jubilant Pharma Limited is a global integrated pharmaceutical company offering a wide range of products and services to its customers across geographies. We organise our business into two segments, namely, Specialty Pharmaceuticals, comprising Radiopharmaceuticals (including Radio pharmacies), Contract Manufacturing of Sterile Injectable, Non-sterile & Allergy Therapy Products, and Generics & APIs, comprising Solid Dosage Formulations & Active Pharmaceutical Ingredients.Jubilant Generics...
Front Office Executive
Hilton,
Jaipur, Rajasthan
3 days ago
With thousands of hotels in over 100 countries and territories, Hilton offers countless opportunities to delight. From an open door to a welcoming smile and an exceptional experience, we offer the millions of travellers who stay with us every year a welcome they will never forget. In addition to our flagship brand, Hilton Hotels & Resorts, the family of brands...
Business Development Executive in Jaipur
Mathionix Technologies Pvt Ltd,
Jaipur, Rajasthan
2 weeks ago
Key Responsibilities Identify and engage potential clients in the IT sector. Qualify leads through tailored strategies and targeted outreach. Build and nurture client relationships to create long-term partnerships. Collaborate with the sales team to deliver customized IT solutions. Stay ahead of industry trends to position our offerings effectively.About Company: At Mathionix Technologies, we offer a wide range of services, including...
