Data Engineer Lead

2 days ago

Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title

We are seeking a highly skilled and experienced Cloud Data Engineer to join our team.

This is an exciting opportunity for a talented professional to leverage their technical expertise and passion for data engineering to drive business growth and success.

Responsibilities
  • Analyze and understand existing data warehouse implementations to support migration and consolidation efforts.
  • Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.
  • Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation.
  • Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks.
  • Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards.
  • Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform.
  • Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability.
  • Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination.
  • Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform.
  • Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming.
  • Triage, debug and fix technical issues related to Data Lakes.
  • Maintain and Manage Code repositories like Git.
Qualifications

A Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field.

Required Skills
  • 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations.
  • 3+ years of experience in designing and implementing data lake architectures on Databricks.
  • Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures.
  • Hands-on experience with data modeling and warehouse design principles.
  • Proficiency in at least one programming language (Python, Scala, Java).
  • Experience working in Agile environments and contributing to iterative development cycles.
Preferred Skills

Databricks cloud certification is a big plus. Exposure to enterprise data governance and metadata management practices.

  • Data Engineering Lead

    7 days ago

    Erode, Tamil Nadu, India beBeeSnowflake Full time ₹ 15,00,000 - ₹ 20,10,000

    Senior Snowflake DeveloperWe are seeking a seasoned Senior Snowflake Developer and Infrastructure Integration Expert to lead full lifecycle implementations of secure platforms, cloud integration, and high-performance data pipeline development.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps,...

  • Data Engineering Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are looking for a Data Engineering Lead to join our team.The ideal candidate will have experience in designing and implementing data pipelines, developing scalable data storage solutions, and collaborating with cross-functional teams.Responsibilities:Design and implement data pipelines using Python, Apache Beam, or Spark.Develop scalable data storage...

  • Lead Data Engineer

    5 days ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Our organization is seeking an experienced Data Engineer to lead the development of scalable data pipelines using Oracle Data Flow and Apache Spark (PySpark). We are looking for a highly skilled professional with 3-12 years of experience in building and managing large-scale data systems, including Data Lakes, Data Warehouses, and Data Pipelines.The ideal...

  • Senior Data Engineering Lead

    4 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 18,00,000

    Job DescriptionWe are seeking a seasoned Senior Data Engineering Lead to spearhead our data scraping initiatives. The ideal candidate will possess extensive experience in IT scraping, with a proven track record of leading high-performing teams and driving complex projects forward.This role requires exceptional technical expertise in advanced scraping...

  • Senior Data Engineering Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Description">We are seeking a seasoned data expert to lead our cloud-based data engineering efforts. The successful candidate will have a strong background in designing and implementing scalable data systems on AWS.Our ideal candidate will have experience working with various data tools and technologies, including Python, Pyspark, and data modeling. They...

  • Data Engineering Lead

    1 week ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistWe are seeking an experienced data engineer to join our team. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

  • Data Engineering Lead

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing ETL pipelines using FiveTran, DBT Cloud, and custom frameworks.Design and implement client-specific data transformations for HighTouch integration.Collaborate with the QC team for ETL...

  • Data Engineering Lead

    5 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Data Engineering PositionWe are seeking an experienced and skilled Data Engineer to join our team.The ideal candidate will have a strong background in designing, building, and maintaining robust data pipelines for processing channel activity data from multiple sources. This involves working on AWS cloud infrastructure and orchestration tools like...

  • Data Engineering Test Lead

    2 days ago

    Erode, Tamil Nadu, India beBeeTechnology Full time ₹ 1,75,00,000 - ₹ 2,15,00,000

    Job DescriptionWe are seeking a seasoned Test Lead to drive comprehensive testing strategy and execution for complex data engineering pipelines and product delivery initiatives.The ideal candidate will have expertise in designing and implementing end-to-end testing frameworks, ensuring test coverage across ETL / ELT, data transformation, lineage, and...

  • Data Engineering Expert

    1 day ago

    Erode, Tamil Nadu, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    As a skilled data engineer, you will be responsible for designing and developing robust data pipelines using industry-leading tools.Key Responsibilities:Design and develop robust data pipelines using industry-leading tools.Develop skills in data engineering using Python, EMR/Spark, and Kafka/Kinesis streaming.Collaborate with cross-functional teams to...