Senior Data Engineer Specialist

4 days ago

Alwar, Rajasthan, India beBeeData Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

Job Opportunity: Data Solutions Architect

We are seeking a highly skilled Data Solutions Architect to design, develop, and maintain efficient data pipelines that extract, transform, and load data from various sources into data lake and data warehouse.

Main Responsibilities:

We are looking for a professional who will be instrumental in:

  • Designing and Developing ETL Processes: Develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
  • Optimizing ETL Workflows: Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Error Handling and Monitoring: Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Data Solution Implementation: Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.
  • Data Cleansing and Enrichment: Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.

Key Requirements:

To be successful in this role, you will need:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Proven experience in working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Qualifications:

A plus if you have:

  • Experience with cloud platforms with a preference for AWS.
  • Experience with data platform tools such as DataBricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.

  • Senior Data Infrastructure Specialist

    4 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing, building, and maintaining high-performance data pipelines.The Senior Data Engineer will play a critical role in scaling and optimizing our data processing...

  • Senior Data Architect

    6 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Role: Senior Data EngineerWe are seeking an expert in Telemetry, Big Data, and backend engineering to help implement a large-scale application for a prominent retailer.5+ years of experience as a Data Engineer with expertise in Python, Pyspark, and SQL;Hands-on coding experience in Python/PySpark with strong Big Data experience and a preference for...

  • Data Engineer

    4 days ago

    Alwar, Rajasthan, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Azure Data Engineer and Quality Assurance Specialist

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Senior Manual Test Lead/Manager Role Description**This is a full-time remote position for a senior test leader/manager in Azure Data Engineering. The role involves overseeing the entire testing lifecycle, developing test strategies, coordinating with various teams, managing test plans, and ensuring quality of Azure Data solutions.The senior test...

  • Senior Data Engineer

    5 days ago

    Alwar, Rajasthan, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    About Data EngineeringData engineers play a vital role in harnessing the power of data to drive business growth and success. At our organization, we are seeking talented and motivated data engineers to join our dynamic team.We design, implement, and maintain scalable data infrastructure to support customer experience and management initiatives. Our data...

  • Visionary Data Engineer for Innovation

    2 days ago

    Alwar, Rajasthan, India beBeeData Full time US$ 1,50,000 - US$ 1,80,000

    Senior Full Stack SDE with Data EngineeringTruckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven trucking science-as-a-service platform. We're creating breakthrough data science to transform trucking — and we're...

  • Senior Data Engineering Expert

    3 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About the OpportunityWe're seeking a Data Engineering Specialist with expertise in Azure to craft scalable data solutions and support analytics initiatives.Key ResponsibilitiesDesign, build, and maintain efficient data pipelines using Azure Data Factory and Synapse Analytics.Create and optimize lakehouse architectures on Azure using Delta Lake.Collaborate...

  • Senior T24 Data Migration Specialist

    4 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Senior T24 Data Migration SpecialistWe are seeking an experienced data migration expert to lead end-to-end data migration activities for T24 core banking system implementations. This individual will possess strong expertise in ETL processes, data mapping, and migration techniques to ensure accuracy, compliance, and smooth transition throughout the...

  • Data Ingestion Specialist

    1 day ago

    Alwar, Rajasthan, India beBeeIngestion Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data Ingestion SpecialistAbout the Role:We are seeking an experienced Data Ingestion Specialist to join our team. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.Main Responsibilities:Data Ingestion Pipelines: Design, develop, and...

  • Senior Azure Data Engineering Specialist

    4 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data Engineer Job OpportunityWe are seeking a skilled Azure Data Engineer to join our team.The ideal candidate will have experience with designing, building, and maintaining robust data pipelines using Azure cloud services.Key responsibilities include working with cross-functional teams to ensure data integrity, security, and accessibility.Azure Data...