Senior Data Engineer
4 days ago
Job Title:
Senior Data Engineer
Location:
Pune
Experience:
2+ years in Data Engineering (preferably with GenAI/LLM exposure)
About the Role
-We are seeking a highly skilled and innovative Data Engineer to join our dynamic team. You will architect, build, and optimise scalable data pipelines and platforms, enabling advanced analytics and AI-driven automation. The ideal candidate will have hands-on experience with distributed data systems, cloud data platforms, and modern data engineering best practices.
Key Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines for real-time and batch data processing using PySpark, Databricks, and Delta Lake.
Build and optimise data ingestion workflows from diverse sources (SQL, NoSQL, cloud data lakes) into scalable storage solutions (e.g., Cosmos DB, PostgreSQL, MongoDB).
Implement and manage orchestration frameworks (Airflow, Azure Data Factory) for automated data workflows.
Collaborate with Data Scientists and ML Engineers to deploy and monitor ML models using MLflow and integrate with business intelligence tools (Power BI, Tableau).
Develop and productionise GenAI/LLM-powered solutions using frameworks such as LangChain, Hugging Face, and FAISS.
Ensure data quality, validation, and transformation using Spark SQL, Hive, and advanced Python scripting.
Drive CI/CD practices for data engineering using Git, Jenkins, Docker, and cloud-native tools.
Optimise performance of distributed data systems through advanced Spark tuning and cluster management.
Document data workflows, pipelines, and architecture for knowledge sharing and maintainability. Required Skills & Qualifications
2+ years of hands-on experience in Data Engineering, with a proven track record of building production-grade data platforms.
Strong expertise in PySpark, Databricks, Delta Lake, Airflow, Hive, SQL, and Spark SQL.
Experience with cloud platforms (Azure, AWS) and orchestration tools (Azure Data Factory, AWS S3).
Proficiency in Python for data engineering, automation, and API development (FastAPI, Django). Solid understanding of data modelling, ETL/ELT processes, and database management (PostgreSQL, Cosmos DB, MongoDB).
Experience with GenAI/LLM frameworks (LangChain, Hugging Face, FAISS) and deploying ML models in production.
Familiarity with MLflow for model tracking and deployment. Strong CI/CD skills with Git, Jenkins, Docker.
Experience with data visualisation tools (Power BI, Tableau).
Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications
Certifications in Data Engineering, Cloud Platforms (Azure/AWS), or Data Science (e.g., IBM Data Science Professional Certificate).
Experience with LLM-powered automation, RAG pipelines, and AI copilots.
Demonstrated leadership in data engineering projects and mentoring junior engineers. Education
Bachelor's or Master's degree in Computer Science, Engineering.
Why Join Us?
Work on cutting-edge data engineering and GenAI projects.
Collaborate with a high-performing, innovative team.
Opportunity to drive impact at scale and shape the future of data-driven automation.
Interested candidates can share updated CV on
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Title –Senior Developer - Data EngineeringJob Type –Permanent Relevant Experience – 7+yearsof experience in the field of Datawarehouse, Data Engineering, Big Data, Cloud & Analytics, Data VisualizationReports into –Team Lead - Data EngineeringJob Description:We, at Jet2 (UK's third largest airlines and the largest tour operator), have set up a...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Real Jobs Consulting Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearCompany DescriptionReal Jobs Consulting Services is a reputable firm in the placement domain of Gurgaon, known for providing high-class placement services. Our services include HR consultancy, placement consultancy, manpower recruitment, domestic placement, career consultancy, and work at home services. Our team of expert consultants leverages the business...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India Cortex Consultants Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob Title: Senior Data Engineer (Snowflake, Azure/AWS, Hadoop, Hive, Python, Databases) Experience: 5 to 8 years Location: Pune and Chennai, India Job Description: We are seeking an experienced and talented Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data...
-
Senior Data Analyst
6 days ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...
-
Senior Data Analyst
2 days ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo: Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 24,00,000 per yearResponsibilitiesJob Title: Senior Developer - DataExperience:4-7 yrsRole OverviewWe are looking for a Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and maintenance of data architecture and pipelines. The candidate will provide technical leadership, mentor junior engineers, and drive best practices while...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearResponsibilitiesJob Title: Senior Developer - DataExperience: 4-7 yrsRole OverviewWe are looking for a Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and maintenance of data architecture and pipelines. The candidate will provide technical leadership, mentor junior engineers, and drive best practices...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India StrekTech Consulting Services Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: Senior Data EngineerExperience: 7+ yearsEmployment Type: Full TimeJob Mode: Hybrid / PuneKey Skillsets:SQL, Talend, GCP, BigQuery, and Microsoft Azure, Synapse Analytics, ETL/ELT development, Kafka, Pub/Sub, Event Hubs, Apache Airflow or Azure Data Factory for workflow automationWe are seeking a highly skilled Senior Data Engineer with 7+ years of...