Big Data Specialist

1 day ago

Mumbai Mumbai City Navi Mumbai, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878
Data Engineer

We are seeking a Data Engineer to design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL). You will be responsible for governing and optimizing these pipelines to ensure high reliability and data quality across both on-premise and cloud environments. This role requires strong proficiency in Pyspark and Scala, experience with big data technologies, and proven leadership skills to guide a team of data engineers.

Roles & Responsibilities:

  • Data Pipeline Design & Implementation: Design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL) using technologies such as Pyspark, Scala, and relevant big data frameworks.
  • Data Governance & Optimization: Govern and optimize data pipelines to ensure high reliability, efficiency, and data quality across on-premise and cloud environments.
  • Cross-functional Collaboration: Collaborate closely with data scientists, ML engineers, and business stakeholders to understand data requirements and translate them into robust technical solutions.
  • Best Practices & Compliance: Implement best practices for data governance, metadata management, and compliance with regulatory requirements.
  • Team Leadership: Lead a team of data engineers, providing technical guidance, mentorship, and fostering a culture of innovation and collaboration.
  • Continuous Improvement: Stay updated with industry trends and advancements in big data technologies, contributing to the continuous improvement of data engineering practices.

Skills Required:

  • Strong experience in data engineering with hands-on experience in designing and implementing data pipelines.
  • Strong proficiency in programming languages such as Pyspark and Scala, with experience in big data technologies (Cloudera, Hadoop ecosystem).
  • Proven leadership experience in managing and mentoring a team of data engineers.
  • Excellent communication skills with the ability to collaborate effectively across teams and stakeholders.
  • Experience working in a banking or financial services environment is a plus.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field, or equivalent practical experience.

  • Big Data Developer

    4 days ago

    Navi Mumbai, Mumbai City, Mumbai, India Future Focus Infotech Full time

    Job DescriptionOverview:We are seeking a highly motivated and detail-oriented individual to join our team as a Big Data Developer. This role requires a dynamic professional who can adapt to evolving business needs and drive value through their expertise.Key Responsibilities:- Provide support and expertise in the domain of Big Data Developer.- Collaborate...

  • Big Data Information Systems Engineer

    3 days ago

    Mumbai City, Navi Mumbai, Mumbai, India beBeeDataEngineering Full time US$ 80,000 - US$ 1,20,000

    Role Overview:We are seeking a skilled Big Data Information Systems Engineer to join our team. This individual will be responsible for designing and implementing data-driven solutions that drive business value.Main Responsibilities:Develop and maintain large-scale data processing systems.Collaborate with cross-functional teams to achieve business...

  • Big Data

    2 days ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    3 weeks ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Role Overview:We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices. The ideal candidate will have deep technical expertise in Azure, AWS, CI/CD pipelines, ETL processes, and modern data platforms like Databricks,...

  • Big Data Developer

    2 weeks ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Role Overview: We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices. The ideal candidate will have deep technical expertise in Azure, AWS, CI/CD pipelines, ETL processes, and modern data platforms like Databricks,...

  • Big Data Developer

    4 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Developer

    4 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time

    Position Overview: We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent. You...

  • Big Data Engineer

    3 weeks ago

    Delhi, Mumbai City, Noida, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a skilled Big Data Engineer to join our dynamic team in India. The ideal candidate will be responsible for designing and implementing robust data pipelines, managing large datasets, and collaborating with various stakeholders to ensure optimal data flow and accessibility.Responsibilities- Design, develop, and maintain...

  • Big Data Engineer

    2 days ago

    Mumbai, Maharashtra, India beBeeSparkDeveloper Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Big Data Engineer  

  • Big Data Solutions Architect

    5 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:This role involves the design, development and implementation of end-to-end big data solutions using MapR, Apache Hadoop and associated ecosystem tools.The incumbent will lead data platform modernization efforts including architecture reviews, platform upgrades and migrations.A strong understanding of distributed systems, high availability...