Senior Data Engineer
1 day ago
Job DescriptionAgivant is seeking a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes.
Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
- Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
- Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
- Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
- Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
- Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
- Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
- Contribute to the development and enhancement of our data warehouse architecture
RequirementsMandatory:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
- At least 3+ years of exp in Snowflake data warehousing technologies.
- At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
- Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
- Working experience with Elastic Search and its application in data pipelines.
- Proficiency in SQL and experience with data modelling techniques.
- Strong understanding of cloud-based data storage solutions such as AWS S3.
- Experience working with NFS and other file storage systems.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Job TypePayroll
CategoriesData Engineer (Software and Web Development)
DevOps Engineers (Software and Web Development)
Technical Specialists (Information Design and Documentaion)
Database Administrator (Software and Web Development)
Cloud Architects (Software and Web Development)
Must have Skills- Snowflake - 3 Years
- Intermediate
- ETL(Extract, Transform, Load) - 3 Years
- Intermediate
- Python - 3 Years
- Intermediate
- Apache Airflow - 3 Years
- Intermediate
- ElasticSearch - 1 Years
- Beginner
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Title –Senior Developer - Data EngineeringJob Type –Permanent Relevant Experience – 7+yearsof experience in the field of Datawarehouse, Data Engineering, Big Data, Cloud & Analytics, Data VisualizationReports into –Team Lead - Data EngineeringJob Description:We, at Jet2 (UK's third largest airlines and the largest tour operator), have set up a...
-
Senior Data Engineer
1 day ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...
-
Senior Data Analyst
5 days ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...
-
Senior Data Analyst
1 day ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo: Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Real Jobs Consulting Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearCompany DescriptionReal Jobs Consulting Services is a reputable firm in the placement domain of Gurgaon, known for providing high-class placement services. Our services include HR consultancy, placement consultancy, manpower recruitment, domestic placement, career consultancy, and work at home services. Our team of expert consultants leverages the business...
-
Senior Data Engineer
1 day ago
Pune, Maharashtra, India Cortex Consultants Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob Title: Senior Data Engineer (Snowflake, Azure/AWS, Hadoop, Hive, Python, Databases) Experience: 5 to 8 years Location: Pune and Chennai, India Job Description: We are seeking an experienced and talented Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior Data Engineer
3 days ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 24,00,000 per yearResponsibilitiesJob Title: Senior Developer - DataExperience:4-7 yrsRole OverviewWe are looking for a Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and maintenance of data architecture and pipelines. The candidate will provide technical leadership, mentor junior engineers, and drive best practices while...
-
Senior Data Engineer
3 days ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearResponsibilitiesJob Title: Senior Developer - DataExperience: 4-7 yrsRole OverviewWe are looking for a Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and maintenance of data architecture and pipelines. The candidate will provide technical leadership, mentor junior engineers, and drive best practices...