Data Engineering Expert

2 days ago

Mumbai, Maharashtra, India beBeeEngineering Full time ₹ 50,000 - ₹ 13,00,000
Job Description

We are seeking a highly skilled Data Engineering Expert to lead our data team. This role will be responsible for designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.

Key Responsibilities
  • Data Pipeline Development: Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.
  • Data Ingestion and Transformation: Work with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms.
  • Data Lake and Warehouse Solutions: Build data lake and data warehouse solutions using AWS S3, Azure Data Lake.
  • Collaboration: Collaborate with data scientists, analysts, and application developers to support advanced analytics, reporting, and ML workflows.
  • Pipeline Maintenance: Implement job orchestration, monitoring, and error handling for reliable pipeline execution. Perform maintenance and support of Data Pipeline.
Required Skills and Qualifications
  • Experience: Around 8+ years of experience in data engineering or cloud computing data development.
  • Technical Skills: Apache Spark (PySpark or Scala), AWS Glue, Azure Data Factory, AWS S3, Azure Data Lake.
  • Collaboration: Experience working with cross-functional teams, including data scientists, analysts, and application developers.
Benefits
  • Data Support: Investigate Glue job failures and restart. Fix minor transformation logic or input data issues. Resolve dependency failures in Glue workflows. Tune job configurations.
  • Impact Analysis: Perform impact analysis and root cause analysis.
  • Availability: Work on an 8x5 support model.

  • Data Engineering Expert

    7 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Data Engineering ExpertWe are seeking a highly skilled Data Engineering Expert to join our team.

  • Data Engineering Expert

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Your primary focus will be on creating efficient data pipelines that move data from various sources to storage and...

  • Expert Data Engineer

    2 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 35,00,000

    Job Title: Data Engineering ExpertYou will play a key role in designing, developing, and implementing data pipelines using Apache Spark and Databricks notebooks to process and transform large datasets.A strong understanding of data processing concepts, ETL/ELT pipelines, and big data architectures is required. You must have experience with SQL, relational...

  • Senior Data Engineering Expert

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Data Engineering ExpertThe ideal candidate will be an expert in data engineering with a strong understanding of cloud-based platforms, particularly Databricks. They will have hands-on experience with Delta Lake, Genie, and ML Flow, as well as proficiency in Python, R, and other programming languages used in data processing.The selected...

  • Senior Data Engineering Expert

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer - ExpertCoforge Ltd. is seeking a Senior Data Engineer with expertise in designing and implementing robust data pipelines to steer business strategies.If you excel in tackling intricate data hurdles and enjoy guiding others, this opportunity could be your next career move. Job Overview:Develop and refine intricate ETL pipelines for processing...

  • Highly Experienced Data Engineering Expert

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to spearhead the development of a self-service data platform for reporting and analytics.This individual will lead the creation of scalable data solutions using Databricks, SQL, Python, Spark, and Delta Lake on Azure.A key aspect of this role is ensuring best practices for ETL/ELT and data...

  • Network Engineer

    2 days ago

    Mumbai, Maharashtra, India YOUR HRM EXPERT Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionYOUR HRM EXPERT offers innovative solutions including analytics, social media management, SEO optimization, and more, ensuring a comprehensive approach to elevate brands' digital presence worldwide. Our team navigates the dynamic realm of digital marketing with confidence and expertise, helping clients achieve unprecedented success.Role...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India AMISEQ Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Data EngineerNavi Mumbai, MHJob Description:As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India AMISEQ Full time

    Data Engineer Navi Mumbai, MH Job Description: As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...

  • Data Engineer

    4 days ago

    Mumbai, Maharashtra, India AMISEQ Full time

    Data EngineerNavi Mumbai, MH Job Description:As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...