
Senior Data Engineer
3 days ago
Job Title:
Senior Data Engineer
Location:
Pune
Experience:
2+ years in Data Engineering (preferably with GenAI/LLM exposure)
About the Role
-We are seeking a highly skilled and innovative Data Engineer to join our dynamic team. You will architect, build, and optimise scalable data pipelines and platforms, enabling advanced analytics and AI-driven automation. The ideal candidate will have hands-on experience with distributed data systems, cloud data platforms, and modern data engineering best practices.
Key Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines for real-time and batch data processing using PySpark, Databricks, and Delta Lake.
Build and optimise data ingestion workflows from diverse sources (SQL, NoSQL, cloud data lakes) into scalable storage solutions (e.g., Cosmos DB, PostgreSQL, MongoDB).
Implement and manage orchestration frameworks (Airflow, Azure Data Factory) for automated data workflows.
Collaborate with Data Scientists and ML Engineers to deploy and monitor ML models using MLflow and integrate with business intelligence tools (Power BI, Tableau).
Develop and productionise GenAI/LLM-powered solutions using frameworks such as LangChain, Hugging Face, and FAISS.
Ensure data quality, validation, and transformation using Spark SQL, Hive, and advanced Python scripting.
Drive CI/CD practices for data engineering using Git, Jenkins, Docker, and cloud-native tools.
Optimise performance of distributed data systems through advanced Spark tuning and cluster management.
Document data workflows, pipelines, and architecture for knowledge sharing and maintainability. Required Skills & Qualifications
2+ years of hands-on experience in Data Engineering, with a proven track record of building production-grade data platforms.
Strong expertise in PySpark, Databricks, Delta Lake, Airflow, Hive, SQL, and Spark SQL.
Experience with cloud platforms (Azure, AWS) and orchestration tools (Azure Data Factory, AWS S3).
Proficiency in Python for data engineering, automation, and API development (FastAPI, Django). Solid understanding of data modelling, ETL/ELT processes, and database management (PostgreSQL, Cosmos DB, MongoDB).
Experience with GenAI/LLM frameworks (LangChain, Hugging Face, FAISS) and deploying ML models in production.
Familiarity with MLflow for model tracking and deployment. Strong CI/CD skills with Git, Jenkins, Docker.
Experience with data visualisation tools (Power BI, Tableau).
Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications
Certifications in Data Engineering, Cloud Platforms (Azure/AWS), or Data Science (e.g., IBM Data Science Professional Certificate).
Experience with LLM-powered automation, RAG pipelines, and AI copilots.
Demonstrated leadership in data engineering projects and mentoring junior engineers. Education
Bachelor's or Master's degree in Computer Science, Engineering.
Why Join Us?
Work on cutting-edge data engineering and GenAI projects.
Collaborate with a high-performing, innovative team.
Opportunity to drive impact at scale and shape the future of data-driven automation.
Interested candidates can share updated CV on
-
Senior Data Engineer
1 day ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...
-
Senior Data Analyst
5 days ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior Data Engineer
7 days ago
Pune, Maharashtra, India Populace World Solutions Full time ₹ 8,00,000 - ₹ 20,00,000 per yearDescription : Location : Pune (Kharadi), India Experience : 8 YearsAbout the Role : We are seeking a highly skilled and experienced Senior Data Engineer to join our team in Pune. This role is crucial for designing, building, and optimizing our large-scale data processing systems and platforms. As a senior member of the team, you will apply your...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Sunbrilo Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are hiring for -Role: Senior Data EngineerExperience Range: 3 to 5 YearsQualification:Degree in Computer Science (or similar), alternatively well-founded professionalexperience in the desired fieldRoles & Responsibilities:As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You...
-
Senior GenAI Engineers
2 weeks ago
Pune, Maharashtra, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 30,00,000 per yearReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Location: | Experience: 8+ yearsRole...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per yearNow Hiring: Senior Data Engineer with 6+ Years of ExperienceLocation : Pune Are you a seasoned Data Engineer with a passion for #Azure cloud technologies? We are looking for a skilled professional to join our team in Pune, focusing on cutting-edge projects in data engineering.Key Responsibilities : - Develop and maintain high-performance #ETL/#ELT...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Byond Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Data EngineerLocation:PuneExperience:4–6 yearsEducation:Bachelor's or Master's degree in Computer Science, Information Technology, or a related fieldJob DescriptionByond is hiring for aconfidential clientin the manufacturing domain. We are seeking a highly skilledSenior Data Engineerwith strong expertise inAzure Databricks, PySpark, and distributed...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India NielsenIQ Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Data Engineer (PYTHON, SQL, PYSPARK, Data Modelling, Stored procedures) Job Description NIQ is looking for a Senior Data Engineer to join our Financial Services Engineering team. At NIQ, the Financial Services team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment...
-
Senior GenAI Engineers
2 weeks ago
Pune, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior GenAI Engineers Req ID: 341086 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahārāshtra (IN-MH), India (IN). ...