Data Engineer

2 days ago

Pune, Maharashtra, India Purview Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Senior DE:

Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering.

Job responsibilities

  • Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment.
  • Minimum 1 year experience in Scala
  • Promoting development standards, code reviews, mentoring, knowledge sharing
  • Production support & troubleshooting.
  • Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring
  • Liaison with BAs to ensure that requirements are correctly interpreted and implemented.
  • Participation in regular planning and status meetings. Input to the development process – through the involvement in Sprint reviews and retrospectives. Input into system architecture and design.

To be successful in this role, you should meet the following requirements: (Must have Requirements)

  • Scala and Python development and understanding requirements and come up solutions.
  • Experience using scheduling tools such as Airflow.
  • Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).
  • Sound knowledge of working in Unix/Linux Platform
  • Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.
  • Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
  • Understanding of big data modelling techniques using relational and non-relational techniques
  • Experience on debugging code issues and then publishing the highlighted differences to the development team.
  • Flexible to adapt to new tooling.

The successful candidate will also meet the following requirements: (Good to have Requirements)

  • Experience with Elastic search.
  • Experience developing in Java APIs.
  • Experience doing ingestions.
  • Understanding or experience of Cloud design pattern
  • GCP Development experience
  • Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.

This role offers the opportunity to be part of an innovative team, delivering impactful solutions while developing your technical expertise.

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Business Consulting-Data Engineer with Power BI

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...

  • Data Engineer with Power BI

    7 days ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Business Consulting-Data Engineer with Power BI Req ID: 345385 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team...

  • Data Scientist

    6 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are a fast-growing startup based in Pune, India, specializing in cutting-edge Data Science and Data Engineering solutions. Our team of dedicated professionals is committed to solving complex data challenges for companies worldwide.Our CultureWe foster a vibrant startup culture that values:Intellectual curiosityContinuous learningPositive work...

  • Data Science Specialist

    2 days ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Senior Software Engineer

    1 week ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...

  • Senior Software Engineer

    6 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Azure Support Engineer

    2 hours ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID: 338755NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Support Engineer - Digital Solution Consultant Sr. Analyst to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Sr Quality Engineer

    1 week ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 339009NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Quality Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I Who we...

  • Data Engineer

    2 hours ago

    Pune, Maharashtra, India RedPluto Analytics Private Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionRedPluto Analytics is a trusted partner in data science, data engineering, and data analytics. Our passionate team of professionals leverages data to drive efficiency, innovation, and strategic decision-making for businesses across various industries in India. Our services include Data Engineering, Cloud Transformations, Data Management,...