Senior Data Engineer
6 days ago
Role & responsibilities
We are looking for a Senior Data Engineer who is responsible for the design and development of scalable data pipelines and integrations to support continual increases in data volume and complexity. Work with analytics and business teams to understand their needs, create pipelines, improve data models that feed BI and visualization tools.
Key Responsibilities:
- Data Pipeline Development: Design, develop, and maintain robust ETL pipelines to move data from source systems to our data storage platforms. This includes data ingestion, transformation, and data quality checks to ensure accuracy and completeness.
- Data Modeling: Create and maintain data models and schemas that support business analytics, reporting, and data visualization requirements. Optimize data structures for performance and scalability.
- Data Integration: Integrate data from various internal and external sources, including databases, APIs, flat files, and streaming data sources. Ensure seamless data flow across systems and platforms.
- Performance Optimization: Identify and address performance bottlenecks in data pipelines and database systems. Implement optimizations to improve data processing speed, scalability, and efficiency.
- Data Quality and Governance: Implement data quality checks, validation rules, and data governance policies to maintain the integrity and reliability of our data assets. Monitor data quality metrics and take proactive measures to address issues.
- Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Collaborate with IT teams to ensure alignment with overall technology architecture and standards.
- Documentation and Best Practices: Document data pipelines, data models, and technical specifications. Follow best practices for software development, version control, and deployment processes.
- Continuous Improvement: Stay abreast of industry trends, emerging technologies, and best practices in data engineering. Identify opportunities for process improvement and automation to streamline data workflows and increase productivity.
Preferred candidate profile
- Bachelor's degree in Computer Science, Engineering, or related field.
- 8+ years of experience in data engineering or related roles.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong SQL skills and experience with relational databases (e.g., MySQL, PostgreSQL).
- Experience with data warehousing concepts and technologies (e.g., Snowflake, Redshift).
- Familiarity with big data processing frameworks (e.g., Apache Spark, Hadoop).
- Hands-on experience with ETL tools and data integration platforms.
- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Understanding of data modeling principles and data warehousing design patterns.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
-
Data Engineer
1 week ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Senior Data Engineer
9 hours ago
Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Title –Senior Developer - Data EngineeringJob Type –Permanent Relevant Experience – 7+yearsof experience in the field of Datawarehouse, Data Engineering, Big Data, Cloud & Analytics, Data VisualizationReports into –Team Lead - Data EngineeringJob Description:We, at Jet2 (UK's third largest airlines and the largest tour operator), have set up a...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSenior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Cortex Consultants Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob Title: Senior Data Engineer (Snowflake, Azure/AWS, Hadoop, Hive, Python, Databases) Experience: 5 to 8 years Location: Pune and Chennai, India Job Description: We are seeking an experienced and talented Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data...
-
Senior Data Analyst
2 weeks ago
Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Hevo: Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India BlueCloud Full time ₹ 20,00,000 - ₹ 25,00,000 per yearResponsibilitiesWe are looking for a Senior Data Engineer to join their team and contribute to the design and implementation of data engineering solutions. This role requires strong hands-on experience withDBT and Snowflake. The Senior Data Engineer will be responsible for building, maintaining, and optimizing data pipelines, as well as implementing...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Vanderlande Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob TitleSenior Data EngineerJob DescriptionIf you are passionate about unlocking the power to gain next level insights into a great variety of data, powering data driven decision making through advanced analytics and data science practises, you might have just found your perfect next career step.In this job you will have versatile responsibilities,...
-
Senior Data Engineer
1 week ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 24,00,000 per yearResponsibilitiesWhat You'll do: At Principal Financial Group, we pursue excellence in all aspects of our work. As a Senior Data Engineer, you'll get the opportunity to work on innovative projects that will develop the future of our data capabilities. Your role will be vital in ensuring our data infrastructure is both resilient and innovative, enabling us to...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Crazy Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Data Engineer (Snowflake)Job DescriptionAgivant is seeking a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India Crazy Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per yearSenior Data Engineer (Snowflake)Job DescriptionAgivant is seeking a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and...