Staff Data Engineer

2 weeks ago

Pune, India Everstream Analytics Full time

Staff Data Engineer

Job Description:

As a Staff Data Engineer at Everstream Analytics, you will play a critical role in building and maintaining our data infrastructure. You will work with a team of talented engineers to design, develop, and optimize Python-based data pipelines and data products that support our multi-tenant cloud-native data platform. Technologies include various AWS streaming, ETL, and Data services such as MSK (Kafka), Lambda, Glue, Spark, Athena, Lake Formation, Redshift, S3, and RDS. Ensuring the scalability, reliability, and efficiency of our data infrastructure is essential to the role.

Key Responsibilities:

  • Architect, Develop and “Own” Data and Data Pipelines: Design, implement, and maintain data pipelines that handle large volumes of data from various sources, ensuring data quality, integrity, and availability.
  • Manage team planning, priorities, and deliverables using Agile methodologies.
  • AWS Expertise: Utilize AWS data services to create scalable and cost-effective data solutions.
  • Relational Database Experience: Utilize PostgreSQL on RDS or similar database technologies, where applicable.
  • Graph Database Experience: Utilize Neo4j or other graph databases for specialized data processing and analysis, where applicable.
  • Stream Processing: Experience with Apache Kafka, Apache Spark or similar for real-time data processing and stream analytics.
  • Python Development: Primarily use Python for data engineering tasks, data transformation, and ETL processes.
  • Data Warehouse / Lakehouse: Implement and manage data warehousing and/or data lake solutions for efficient data storage and retrieval to support engineering, data science, applications, and groups across our organization.
  • Collaboration: Work closely with Product Management, Data Science, and the leadership team to understand data requirements and deliver data solutions that meet business needs.
  • Monitoring and Optimization: Continuously monitor the performance of data pipelines and optimize for scalability and efficiency.
  • Documentation: Maintain comprehensive documentation for data engineering processes, ensuring knowledge transfer within the team.
  • Leadership: Lead by example within the data engineering team, taking pride in your team’s deliverables, and performing as technical lead for a scrum team or on various projects, where applicable.

Qualifications:

  • Proven experience in designing and building multi-tenant cloud-native data platforms in a SaaS or PaaS environment.
  • Experience with both relational and graph database technologies in a production environment, specifically PostgreSQL, Athena, and Neo4j
  • Strong expertise in AWS services, including MSK (Kafka), Lambda, Glue, Spark, Lake Formation, Redshift, RDS, Apache Airflow or similar tools and services.
  • Strong expertise in Apache Airflow or similar ETL tools and services.
  • Proficiency in distributed system design, data warehousing, data lakes, and stream processing using Spark or similar.
  • Strong programming skills in Python.
  • Excellent problem-solving and troubleshooting skills.
  • Ability to work collaboratively with cross-functional teams and convey complex technical concepts to non-technical stakeholders.
  • Bachelor's or Master's degree in Computer Science, Data Engineering, related field, or equivalent experience.

  • Staff Data Engineer

    2 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Data EngineerJob Description:As aStaff Data Engineerat Everstream Analytics, you will play a critical role in building and maintaining our data infrastructure. You will work with a team of talented engineers to design, develop, and optimize Python-based data pipelines and data products that support our multi-tenant cloud-native data platform....

  • Staff Data Engineer

    2 weeks ago

    pune, India Everstream Analytics Full time

    Staff Data EngineerJob Description:As a Staff Data Engineer at Everstream Analytics, you will play a critical role in building and maintaining our data infrastructure. You will work with a team of talented engineers to design, develop, and optimize Python-based data pipelines and data products that support our multi-tenant cloud-native data platform....

  • Digital Engineering Staff Engineer

    1 month ago

    Pune, India NTT DATA Services Full time

    Req ID: 291104 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Design,...

  • Digital Engineering Staff Engineer

    1 month ago

    Pune, India NTT DATA Services Full time

    Req ID: 291104  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Staff Data Engineer

    2 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Data Engineer Job Description: As a Staff Data Engineer at Everstream Analytics, you will play a critical role in building and maintaining our data infrastructure. You will work with a team of talented engineers to design, develop, and optimize Python-based data pipelines and data products that support our multi-tenant cloud-native data platform....

  • Staff Data Engineer

    2 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Data EngineerJob Description:As a Staff Data Engineer at Everstream Analytics, you will play a critical role in building and maintaining our data infrastructure. You will work with a team of talented engineers to design, develop, and optimize Python-based data pipelines and data products that support our multi-tenant cloud-native data platform....

  • Digital Engineering Staff Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Grade 10 : Gen AI...

  • Digital Engineering Staff Engineer

    1 month ago

    Pune, India NTT DATA Services Full time

    Req ID: 287744  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Digital Engineering Sr. Staff Engineer

    3 months ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 287381 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Staff Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Senior Data Engineer

    4 months ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    4 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Staff Software Engineer

    2 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Software EngineerPOSITION OVERVIEWOur company delivers operational supply chain insights based on data and predictive analytics. As aStaff Software Engineer , you will help drive our engineering culture, help lead other engineers in an agile environment to develop and deploy applications and features that are used in customer-facing SaaS solutions for...

  • Staff Software Engineer

    2 weeks ago

    pune, India Everstream Analytics Full time

    Staff Software EngineerPOSITION OVERVIEWOur company delivers operational supply chain insights based on data and predictive analytics. As a Staff Software Engineer , you will help drive our engineering culture, help lead other engineers in an agile environment to develop and deploy applications and features that are used in customer-facing SaaS solutions...

  • Staff Software Engineer

    2 months ago

    Pune, India LogicMonitor Full time

    What You'll Do: The Staff Software Engineer is a key member of the LM Logs team. This position ensures that the technical product meets the architectural direction and the product requirements. You keep yourself and the team up to date on the industry trends for logging tools and new technology that will give us a competitive advantage. You will...

  • Staff Software Engineer

    3 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Software EngineerPOSITION OVERVIEW Our company delivers operational supply chain insights based on data and predictive analytics. As a Staff Software Engineer, you will help drive our engineering culture, help lead other engineers in an agile environment to develop and deploy applications and features that are used in customer-facing SaaS solutions for...

  • Staff Software Engineer

    2 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Software Engineer POSITION OVERVIEW Our company delivers operational supply chain insights based on data and predictive analytics. As a Staff Software Engineer , you will help drive our engineering culture, help lead other engineers in an agile environment to develop and deploy applications and features that are used in customer-facing SaaS...

  • Staff Software Engineer

    3 weeks ago

    Pune, India Everstream Analytics Full time

    Staff Software EngineerPOSITION OVERVIEW Our company delivers operational supply chain insights based on data and predictive analytics. As a Staff Software Engineer, you will help drive our engineering culture, help lead other engineers in an agile environment to develop and deploy applications and features that are used in customer-facing SaaS solutions for...

  • Data Scientist

    3 months ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Associate Staff Engineer

    2 months ago

    Pune, Maharashtra, India Nagarro India Pvt Ltd Full time

    Apply for Associate Staff Engineer, Career Progress Consultants in Pune ,Jaipur for 5 - 8 Year of Experience on

  • Technical Lead

    4 weeks ago

    Pune, India Data Axle India Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...