Highly Skilled Data Engineer

7 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 5,00,000 - ₹ 8,00,000
Data Engineer

We are seeking a highly skilled Data Engineer to join our team. As a key member of the team, you will be responsible for designing and implementing data pipelines in Azure Synapse to transform and load data into ADLS in Delta format.

Our ideal candidate has hands-on experience with Azure Synapse, ADLS, Delta format, and metadata-driven data pipelines. They are also experienced in implementing dimensional (star/snowflake) and 3NF data models, as well as performing Source-to-Target Mapping (STM) by analyzing source systems and defining transformation logic.

The successful candidate will have strong problem-solving and analytical skills for debugging and optimizing data pipelines in Azure Synapse. They will also have familiarity with CI/CD practices in Git and Azure DevOps, as well as working experience in Azure DevOps-based development environment.

Key Responsibilities
  • Design and implement PySpark-based data pipelines in Azure Synapse to transform and load data into ADLS in Delta format
  • Implement dimensional (star/snowflake) and 3NF data models
  • Perform unit testing of data pipelines and its transformations
  • Design and build metadata driven data pipelines using Pyspark in Azure Synapse
  • Analyze and optimize Spark SQL queries
Requirements
  • 7+ years of experience in: SQL, PySpark
  • Hands-on experience with Azure Synapse, ADLS, Delta format, and metadata-driven data pipelines
  • Experienced in implementing dimensional (star/snowflake) and 3NF data models
  • Experienced in PySpark and Spark SQL, including query optimization and performance tuning
Benefits

You will have the opportunity to work with a talented team of professionals who share your passion for innovation and excellence. You will also have access to ongoing training and development opportunities to help you grow in your career.

About Us

We are a leading provider of technology solutions that enable businesses to thrive in today's digital landscape. Our team is dedicated to delivering high-quality results that meet and exceed our clients' expectations.

  • Highly Skilled Data Engineer Wanted

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 15,00,000

    About this Role:We are seeking a highly skilled Senior Data Engineer with strong expertise in data engineering, modeling, and visualization to lead our data initiatives.This role demands a hands-on technologist who can design, develop, and optimize large-scale data solutions ensuring high availability, performance, and scalability.The candidate will work...

  • Highly Skilled Data Engineering Expert

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 30,00,000

    Senior Data Engineering ProfessionalWe are seeking a highly skilled Senior Data Engineering Professional to join our team. This individual will be responsible for managing and developing tax data pipelines, supporting our Tax Data Warehouse and Data Lake, and delivering business intelligence solutions.The successful candidate will lead data engineering...

  • Highly Skilled Data Professional

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data EngineerJob DescriptionWe are seeking a highly skilled and motivated Data Engineer to join our organization.

  • Highly Skilled Data Engineering Professional

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Lead Data EngineerWe are seeking a highly skilled and innovative Data Engineer to join our team. As a key member, you will play a vital role in designing and developing cutting-edge data products that drive business growth.Key responsibilities include:Designing and implementing scalable data architecturesDeveloping efficient data pipelines using Apache...

  • Highly Skilled Data Expert

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,40,000

    Job SummaryWe are seeking a highly skilled Data Engineer to join our Global Business Analytics team. As a key member of this team, you will be responsible for designing, developing, and maintaining large-scale data systems.

  • Highly Skilled Data Engineer Wanted

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 40,00,000

    Data Engineering ProfessionalImpetus is seeking a highly skilled data engineer to design and implement robust and scalable data pipelines using cloud services. The ideal candidate will have 4-7 years of experience in data engineering and ETL/ELT processes, with expertise in designing and implementing solutions using pySpark and Spark SQL.Main...

  • Highly Skilled Data Engineer Wanted

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Description">Are you an experienced professional looking for a challenging role as a data engineer? We are seeking highly skilled individuals to join our data and AI delivery team. In this capacity, you will design and develop scalable data engineering solutions using Scala and Spark. Your strong technical skills in HDFS, Hive, Oozie, and Yarn will...

  • Highly Skilled Data Engineer Wanted

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to spearhead our team's data initiatives. The ideal candidate will have 4-6 years of experience with Big Data technologies, including pySpark, Hadoop, and Hive.Main ResponsibilitiesCreate efficient ETL pipelines using AWS services such as S3, IAM, Glue, EMR, and Redshift.Develop comprehensive...

  • Highly Skilled Data Professional

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data EngineerWe are looking for a highly skilled data professional to join our team.Key Responsibilities:Design and develop scalable data pipelines on the Azure cloud platform.Work closely with cross-functional teams to ensure seamless integration of data engineering solutions.Maintain and document deliverables as needed.Participate in peer reviews for...

  • Highly Skilled Data Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are currently seeking a highly skilled Azure Data Engineer to join our organization. As an expert in Azure cloud services, you will design and implement efficient data pipelines, architectures, and datasets.Key Responsibilities:Design and build scalable data pipelines using Azure Data Factory and Azure Databricks.Develop and optimize 'big data' datasets...