Senior Data Engineer

5 days ago

Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

We are seeking a skilled data engineer to join our team.

Job Description:

A highly skilled Databricks PySpark Developer is required to design, develop and maintain ETL processes. This key member of the team will be instrumental in extracting, transforming and loading data from various sources into a data lake and data warehouse.

The main responsibilities include:

  • ETL Development:
    • Design and develop ETL processes using Databricks PySpark to extract, transform and load data.
    • Optimize ETL workflows for performance and scalability.
    • Implement robust error handling and monitoring mechanisms.
    • Organize data into Bronze, Silver and Gold layers following the Medallion Architecture principles.
    • Ensure data quality throughout the ETL lifecycle.
  • Data Pipeline Management:
    • Create advanced data pipelines using Databricks workflows.
    • Develop and maintain data pipelines using Databricks PySpark.
    • Collaborate with other teams to translate data requirements into efficient ETL workflows and pipelines.
  • Data Analysis and Query Optimization:
    • Write and optimize complex SQL queries within Databricks PySpark applications.
  • Project Coordination and Continuous Improvement:
    • Participate in project planning and coordination activities.
    • Stay updated on the latest developments in Databricks PySpark.
    • Document ETL processes and data lineage.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science or related field.
  • Minimum 3 years experience as an ETL developer with strong focus on Databricks PySpark development.
  • Proficiency in Python programming.
  • In-depth understanding of Spark architecture and internals.
  • Expertise in writing and optimizing complex SQL queries.
  • Proven experience working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills.
  • Excellent communication and collaboration skills.

Preferred Qualifications:

  • Experience with cloud platforms.
  • Experience with data platform tools such as DataBricks, Snowflake and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark or related technologies.

  • Senior Data Engineering Specialist

    5 days ago

    Jodhpur, Rajasthan, India beBeeDataEngineering Full time ₹ 60,00,000 - ₹ 90,00,000

    Senior Data Engineering SpecialistWe are seeking an experienced Data Engineering professional to lead the design, development, and maintenance of large-scale data processing systems.The ideal candidate will have a strong background in Palantir Foundry, Pyspark, and Typescript, with a proven track record of delivering high-quality solutions.A collaborative...

  • Senior Data Architect

    12 hours ago

    Jodhpur, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,12,500

    Job Title: Senior Data EngineerAs a Senior Data Engineer, you will have a direct impact on our tooling and development cycles.About the Role:The ideal candidate will be responsible for processing large amounts of data, developing reports and analyses, and supporting the data warehouse in identifying and revising reporting requirements.Key...

  • Azure Data Engineer Senior Test Manager Position

    4 days ago

    Jodhpur, Rajasthan, India beBeeTest Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Test Lead/Manager Job Overview:This is a full-time remote position for a senior test professional in Azure Data Engineering. The successful candidate will oversee the entire testing lifecycle, develop strategic plans for testing, coordinate with various teams, manage test execution, and ensure the quality of Azure Data solutions.

  • Cloud Data Systems Engineer

    4 days ago

    Jodhpur, Rajasthan, India beBeeDataSystems Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:Senior Cloud Data Systems EngineerJob Summary:Our team seeks a Senior Cloud Data Systems Engineer to design, develop, and maintain large-scale data systems. This role requires a deep understanding of cloud technologies, such as Apache Ray, AWS, and GCP.Key Responsibilities:Operate, monitor, and troubleshoot all aspects of production and...

  • Data Engineering Leader

    4 days ago

    Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled data engineer to design and implement scalable, high-performance data pipelines. This role involves building and optimizing ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases.The ideal candidate will...

  • Unlock Data Engineering Potential

    5 hours ago

    Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000

    Senior Data Engineer RoleThe primary objective of this role is to design, develop, and maintain large-scale data processing systems.Key responsibilities include designing and implementing data pipelines using a combination of Airflow and Python, collaborating with cross-functional teams to develop and maintain data engineering solutions, troubleshooting and...

  • Senior Data Architect

    2 days ago

    Jodhpur, Rajasthan, India beBeeData Full time ₹ 23,00,000 - ₹ 26,00,000

    Job Title: Senior Data ArchitectDescriptionWe are seeking a seasoned Senior Data Architect to spearhead our data warehousing efforts. As a key member of our team, you will be responsible for designing and implementing cutting-edge data solutions that drive business growth.Required Skills and Qualifications10+ years of experience in software development with...

  • Advanced Data Engineer Position

    12 hours ago

    Jodhpur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining high-performance data pipelines that support our consulting and analytics solutions.The ideal candidate will have strong technical expertise in data engineering and excellent communication...

  • Data Engineer

    2 weeks ago

    Jodhpur, Rajasthan, India Firstsource Full time

    Key Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Data Engineering Lead

    12 hours ago

    Jodhpur, Rajasthan, India beBeeEngineering Full time ₹ 30,00,000 - ₹ 40,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineering Lead to spearhead the development and implementation of our data pipelines.The ideal candidate will have extensive experience in software architecture and solution design, as well as expertise in Python and Spark.This role requires strong technical knowledge of AWS services and cloud solutions,...