
Senior Data Engineer
16 hours ago
Job Title:
Senior Data Engineer
Location:
Pune
Experience:
2+ years in Data Engineering (preferably with GenAI/LLM exposure)
About the Role
-We are seeking a highly skilled and innovative Data Engineer to join our dynamic team. You will architect, build, and optimise scalable data pipelines and platforms, enabling advanced analytics and AI-driven automation. The ideal candidate will have hands-on experience with distributed data systems, cloud data platforms, and modern data engineering best practices.
Key Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines for real-time and batch data processing using PySpark, Databricks, and Delta Lake.
Build and optimise data ingestion workflows from diverse sources (SQL, NoSQL, cloud data lakes) into scalable storage solutions (e.g., Cosmos DB, PostgreSQL, MongoDB).
Implement and manage orchestration frameworks (Airflow, Azure Data Factory) for automated data workflows.
Collaborate with Data Scientists and ML Engineers to deploy and monitor ML models using MLflow and integrate with business intelligence tools (Power BI, Tableau).
Develop and productionise GenAI/LLM-powered solutions using frameworks such as LangChain, Hugging Face, and FAISS.
Ensure data quality, validation, and transformation using Spark SQL, Hive, and advanced Python scripting.
Drive CI/CD practices for data engineering using Git, Jenkins, Docker, and cloud-native tools.
Optimise performance of distributed data systems through advanced Spark tuning and cluster management.
Document data workflows, pipelines, and architecture for knowledge sharing and maintainability. Required Skills & Qualifications
2+ years of hands-on experience in Data Engineering, with a proven track record of building production-grade data platforms.
Strong expertise in PySpark, Databricks, Delta Lake, Airflow, Hive, SQL, and Spark SQL.
Experience with cloud platforms (Azure, AWS) and orchestration tools (Azure Data Factory, AWS S3).
Proficiency in Python for data engineering, automation, and API development (FastAPI, Django). Solid understanding of data modelling, ETL/ELT processes, and database management (PostgreSQL, Cosmos DB, MongoDB).
Experience with GenAI/LLM frameworks (LangChain, Hugging Face, FAISS) and deploying ML models in production.
Familiarity with MLflow for model tracking and deployment. Strong CI/CD skills with Git, Jenkins, Docker.
Experience with data visualisation tools (Power BI, Tableau).
Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications
Certifications in Data Engineering, Cloud Platforms (Azure/AWS), or Data Science (e.g., IBM Data Science Professional Certificate).
Experience with LLM-powered automation, RAG pipelines, and AI copilots.
Demonstrated leadership in data engineering projects and mentoring junior engineers. Education
Bachelor's or Master's degree in Computer Science, Engineering.
Why Join Us?
Work on cutting-edge data engineering and GenAI projects.
Collaborate with a high-performing, innovative team.
Opportunity to drive impact at scale and shape the future of data-driven automation.
Interested candidates can share updated CV on
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...
-
Senior QE Engineer
3 weeks ago
Pune, Maharashtra, India NTT Data Full timeJob DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000Job Title: Senior Data Engineer">Job Description:As a senior data engineer, you will be responsible for designing and building robust data pipelines that process and transform data from diverse sources.Key Responsibilities:Design and build efficient data pipelines that ensure data quality, reliability, and availability across the pipeline...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Senior Data Engineer PositionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing and maintaining large-scale data warehouses that support our analytics and intelligence platform.Design and develop advanced SQL queries, stored...
-
Senior Data Engineer
21 hours ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior QA Engineer
2 weeks ago
Pune, Maharashtra, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per yearThe Senior QA Engineer will be responsible for ensuring complete test coverage of data platform and product functionality, development, and maintenance of comprehensive test automation infrastructure, helping with debugging and validating fixes for production issue. This role is responsible for performing a variety of QA engineering tasks including design...
-
Senior Data Engineer
3 weeks ago
Pune, Maharashtra, India True Talents Full timeJob Title : Senior Data EngineerLocation : Pune / NoidaExperience : 4 - 8 YearsEmployment Type : Full-timeNotice Period : Up to 30 DaysAbout the Role :We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong expertise in modern data...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India InfoBeans Full timeGreetings from Infobeans ( Title: Senior Data EngineerSkills: Python, Data EngineeringExperience Required: 5- 7 YearsLocation: PuneNotice Period: Immediate Joiners PreferredAbout the RoleWe are seeking a Senior Data Engineer with a passion for building scalable data infrastructure, fluent Python skills, and a sharp analytical mindset. You will design,...
-
Senior Data Engineer
3 weeks ago
Pune, Maharashtra, India Techmora Full timeJob Title : Senior Data EngineerExperience : 4- 8 YearsLocation : Bangalore / PuneJob Type : Full-time | PermanentNotice Period : Up to 30 DaysAbout the Role :We are looking for an experienced Senior Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India SpeedMart Full timeCompany Profile :Our client is a global IT services company that helps businesses with digital transformation with offices in India and the United States.It helps businesses with digital transformation, provide IT collaborations and uses technology, innovation, and enterprise to have a positive impact on the world of business.With expertise is in the fields...