Lead Data Engineer

5 days ago

Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Our organization is seeking an experienced Data Engineer to lead the development of scalable data pipelines using Oracle Data Flow and Apache Spark (PySpark).

  • We are looking for a highly skilled professional with 3-12 years of experience in building and managing large-scale data systems, including Data Lakes, Data Warehouses, and Data Pipelines.
  • The ideal candidate will have strong expertise in designing and developing efficient data processing scripts using Python, PySpark, and SQL, as well as proficiency in orchestrating data workflows across various data services.
About the Role
  • Bulk Data Ingestion: Develop and implement scalable data ingestion solutions using Oracle Data Flow or Apache Spark (PySpark) for bulk data ingestion into Data Lakes, Data Warehouses, and Data Pipelines.
  • Data Processing: Design and develop efficient data processing scripts using Python, PySpark, and SQL to extract insights from large datasets.
  • Orchestration: Use cloud-based workflow orchestration tools to manage and automate data workflows across various data services.

Key Responsibilities include:

  • Developing and implementing data engineering solutions using Oracle Data Flow and Apache Spark (PySpark)
  • Designing and developing efficient data processing scripts using Python, PySpark, and SQL
  • Proficiently orchestrating data workflows across various data services
  • Maintaining high-quality code and adhering to industry standards and best practices

The successful candidate will be able to collaborate effectively across teams and engage with stakeholders to deliver high-quality results on time. Relevant qualifications include:

  • 3-12 years of experience in building and managing large-scale data systems
  • Strong expertise in designing and developing efficient data processing scripts using Python, PySpark, and SQL
  • Proficiency in orchestrating data workflows across various data services

We are committed to providing a work environment that promotes innovation, collaboration, and growth opportunities for all employees. If you're passionate about working with data and want to be part of a dynamic team, please apply today

  • Data Engineering Lead

    1 week ago

    Erode, Tamil Nadu, India beBeeSnowflake Full time ₹ 15,00,000 - ₹ 20,10,000

    Senior Snowflake DeveloperWe are seeking a seasoned Senior Snowflake Developer and Infrastructure Integration Expert to lead full lifecycle implementations of secure platforms, cloud integration, and high-performance data pipeline development.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps,...

  • Data Engineering Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are looking for a Data Engineering Lead to join our team.The ideal candidate will have experience in designing and implementing data pipelines, developing scalable data storage solutions, and collaborating with cross-functional teams.Responsibilities:Design and implement data pipelines using Python, Apache Beam, or Spark.Develop scalable data storage...

  • Senior Data Engineering Lead

    5 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 18,00,000

    Job DescriptionWe are seeking a seasoned Senior Data Engineering Lead to spearhead our data scraping initiatives. The ideal candidate will possess extensive experience in IT scraping, with a proven track record of leading high-performing teams and driving complex projects forward.This role requires exceptional technical expertise in advanced scraping...

  • Senior Data Engineering Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Description">We are seeking a seasoned data expert to lead our cloud-based data engineering efforts. The successful candidate will have a strong background in designing and implementing scalable data systems on AWS.Our ideal candidate will have experience working with various data tools and technologies, including Python, Pyspark, and data modeling. They...

  • Data Engineering Lead

    1 week ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistWe are seeking an experienced data engineer to join our team. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

  • Data Engineering Lead

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing ETL pipelines using FiveTran, DBT Cloud, and custom frameworks.Design and implement client-specific data transformations for HighTouch integration.Collaborate with the QC team for ETL...

  • Data Engineering Lead

    5 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Data Engineering PositionWe are seeking an experienced and skilled Data Engineer to join our team.The ideal candidate will have a strong background in designing, building, and maintaining robust data pipelines for processing channel activity data from multiple sources. This involves working on AWS cloud infrastructure and orchestration tools like...

  • Data Engineer Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a highly skilled and experienced Cloud Data Engineer to join our team.This is an exciting opportunity for a talented professional to leverage their technical expertise and passion for data engineering to drive business growth and success.ResponsibilitiesAnalyze and understand existing data warehouse implementations to support...

  • Data Engineering Test Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeTechnology Full time ₹ 1,75,00,000 - ₹ 2,15,00,000

    Job DescriptionWe are seeking a seasoned Test Lead to drive comprehensive testing strategy and execution for complex data engineering pipelines and product delivery initiatives.The ideal candidate will have expertise in designing and implementing end-to-end testing frameworks, ensuring test coverage across ETL / ELT, data transformation, lineage, and...

  • Data Engineering Expert

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    As a skilled data engineer, you will be responsible for designing and developing robust data pipelines using industry-leading tools.Key Responsibilities:Design and develop robust data pipelines using industry-leading tools.Develop skills in data engineering using Python, EMR/Spark, and Kafka/Kinesis streaming.Collaborate with cross-functional teams to...