Expert Data Engineer

2 days ago

Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 35,00,000
Job Title: Data Engineering Expert

You will play a key role in designing, developing, and implementing data pipelines using Apache Spark and Databricks notebooks to process and transform large datasets.

A strong understanding of data processing concepts, ETL/ELT pipelines, and big data architectures is required. You must have experience with SQL, relational databases, Python programming, and data manipulation libraries.

The ideal candidate has 4-9 years of experience in data engineering or a related field and a Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field (or equivalent experience).

Key Responsibilities:

  • Design and Develop Data Pipelines: Using Apache Spark and Databricks notebooks, you will design and develop data pipelines that optimize performance, scalability, and cost-effectiveness.
  • Collaborate with Cross-Functional Teams: You will work closely with data scientists, analysts, and other engineers to understand data requirements and translate them into technical solutions.
  • Optimize Data Infrastructure: Configure and manage Databricks clusters for optimal performance and resource utilization, implement security best practices, and monitor and troubleshoot Databricks jobs.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field (or equivalent experience)
  • 4-9 years of experience in data engineering or a related field
  • Proven experience working with Apache Spark and the Databricks platform
  • Strong understanding of data processing concepts, ETL/ELT pipelines, and big data architectures
  • Experience with SQL and familiarity with relational databases
  • Proficiency in Python programming with experience in data manipulation libraries

What We Offer:

This role requires excellent problem-solving and analytical skills, as well as strong communication and collaboration skills. The ability to work independently and as part of a team is also essential. By joining our team, you will have the opportunity to work on challenging projects and contribute to the growth and development of our organization.

  • Data Engineering Expert

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Data Engineering ExpertWe are seeking a highly skilled Data Engineering Expert to join our team.

  • Data Engineering Expert

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Your primary focus will be on creating efficient data pipelines that move data from various sources to storage and...

  • Senior Data Engineering Expert

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Data Engineering ExpertThe ideal candidate will be an expert in data engineering with a strong understanding of cloud-based platforms, particularly Databricks. They will have hands-on experience with Delta Lake, Genie, and ML Flow, as well as proficiency in Python, R, and other programming languages used in data processing.The selected...

  • Data Engineering Expert

    2 days ago

    Mumbai, Maharashtra, India beBeeEngineering Full time ₹ 50,000 - ₹ 13,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineering Expert to lead our data team. This role will be responsible for designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Key ResponsibilitiesData Pipeline Development: Design, develop, and optimize ETL/ELT data pipelines...

  • Senior Data Engineering Expert

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer - ExpertCoforge Ltd. is seeking a Senior Data Engineer with expertise in designing and implementing robust data pipelines to steer business strategies.If you excel in tackling intricate data hurdles and enjoy guiding others, this opportunity could be your next career move. Job Overview:Develop and refine intricate ETL pipelines for processing...

  • Highly Experienced Data Engineering Expert

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to spearhead the development of a self-service data platform for reporting and analytics.This individual will lead the creation of scalable data solutions using Databricks, SQL, Python, Spark, and Delta Lake on Azure.A key aspect of this role is ensuring best practices for ETL/ELT and data...

  • Network Engineer

    2 days ago

    Mumbai, Maharashtra, India YOUR HRM EXPERT Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionYOUR HRM EXPERT offers innovative solutions including analytics, social media management, SEO optimization, and more, ensuring a comprehensive approach to elevate brands' digital presence worldwide. Our team navigates the dynamic realm of digital marketing with confidence and expertise, helping clients achieve unprecedented success.Role...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India AMISEQ Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Data EngineerNavi Mumbai, MHJob Description:As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India AMISEQ Full time

    Data Engineer Navi Mumbai, MH Job Description: As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...

  • Data Engineer

    4 days ago

    Mumbai, Maharashtra, India AMISEQ Full time

    Data EngineerNavi Mumbai, MH Job Description:As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...