Big Data Engineering Lead

2 weeks ago

Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

Job Overview:

We are seeking an experienced Big Data Engineering Lead to lead our data engineering teams and drive the development of scalable data infrastructure. The successful candidate will be responsible for managing cross-functional collaboration, developing data pipelines, and provisioning data infrastructure.

About You:
  • You have 7-12 years of experience in leading data engineering teams and a strong understanding of big data technologies.
  • You possess excellent communication skills and the ability to work across multiple geographies and time zones.
  • You are familiar with Apache Iceberg, Delta Lake, or similar table formats and have experience with distributed blob storages like Ceph or AWS S3.
  • You have expertise in Kubernetes, including running Spark and Flink jobs.

Key Responsibilities:

  1. Data Infrastructure Development: Design and implement scalable data infrastructure using Apache Spark, Scala, and Python.
  2. Data Pipelines: Develop and maintain efficient data pipelines for large-scale datasets using ingestion, transformation, and enrichment techniques.
  3. Team Leadership: Manage cross-functional collaboration between architects, product managers, and operations teams.
  4. Infrastructure Provisioning: Provision data infrastructure using Infrastructure-as-Code tools like Terraform and Helm.

Requirements:

  • Bachelor's degree in Computer Science or related field.
  • Strong understanding of big data technologies and data engineering principles.
  • Experience with cloud-based platforms and containerization.

What We Offer:

A dynamic work environment, opportunities for growth and development, and a competitive compensation package.

  • Mastering Big Data: Lead Data Engineer

    2 weeks ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000

    Lead Data Engineer - Cloud ComputingThe ideal candidate will have a strong background in data engineering and cloud computing, with experience in designing and developing large-scale data systems.Responsibilities:Design and develop data pipelines using Python to process big dataExperience with cloud platforms, preferably Azure, to deploy scalable solutions5+...

  • Big Data Specialist

    2 weeks ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    About the Role:We are seeking a highly skilled Big Data Administrator to manage our big data platform.The ideal candidate will have experience with Hadoop, Hive, HBase, BigSQL, and other big data technologies. They will be responsible for administering and monitoring big data platform components, handling day-to-day operations, and supporting technical and...

  • Senior Big Data Engineer

    2 weeks ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 17,00,000

    Job Title: Advanced Data Solutions ArchitectJob Summary:We seek an experienced data architect to help build and optimize high-performance data solutions in a scalable environment. The ideal candidate has hands-on experience with Databricks production environments and a deep understanding of modern data architecture.Key Responsibilities:Design, develop, and...

  • Senior Big Data Specialist

    2 weeks ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job Opportunity: Data Engineer Role OverviewAs a data engineer, you will play a crucial role in designing and implementing large-scale distributed data systems. Your primary responsibilities will include monitoring performance, optimizing existing projects, researching new big data tools and frameworks, understanding business/data requirements, and...

  • High Impact Big Data Professional

    2 weeks ago

    Nashik, Maharashtra, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Role:We seek a seasoned Big Data professional to spearhead high-impact projects.The ideal candidate will thrive in a fast-paced technical environment, exceling at coaching and mentoring junior engineers.You will work on challenging client projects, provide technical guidance, contribute to solution delivery, and serve as a technical mentor for less...

  • Big Data Developer

    2 weeks ago

    Nashik, Maharashtra, India beBeeDataScience Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data ScientistLocation: Nashik, IndiaAbout the Role:Main ResponsibilitiesDevelop and implement big data solutions using Scala, Spark, and related technologies.Create and optimize data pipelines, transformation logic, and data models for large-scale data processing.Work on implementation projects with a focus on big data analytics and...

  • Big Data Architect

    2 weeks ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job Title: Big Data Architect - Cloud and Scalability ExpertOur team is seeking a highly skilled Big Data Architect to lead the design, implementation, and maintenance of large-scale data systems. Key Responsibilities: Design and implement robust data pipelines using Python, SQL, PySpark, and bash scripts to extract insights from complex datasets....

  • Architect - Big data and Cloud

    2 weeks ago

    Nashik, Maharashtra, India Societe Generale Global Solution Centre Full time

    Role: Cloud and Big data ArchitectRole DescriptionWe are looking for skilled and passionate Azure Cloud experts with a strong focus on Big Data management and data quality skills to join our team at Société Générale Global Solution Centre in Bengaluru.This is a full-time hybrid role for Digital & Data Solutions (DDS), offering flexibility for remote...

  • Big Data Solutions Expert

    2 weeks ago

    Nashik, Maharashtra, India beBeeDataScientist Full time ₹ 8,00,000 - ₹ 15,00,000

    ">Job Overview">Must have skills: Big Data, Scala, AWS and Python or Java.">",

  • Senior Cloud Data Engineer Position

    2 weeks ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    As a seasoned big data engineer, you will be responsible for designing and implementing efficient data engineering solutions on the cloud.Key Responsibilities:Develop scalable data pipelines using advanced data processing frameworksWork with massive datasets to create streamlined data processing workflowsCollaborate with cross-functional teams to implement...