Senior Data Engineering Specialist

10 hours ago

Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
Job Opening

This is a contract position seeking a highly motivated Data Engineer with experience in building, optimizing, and maintaining large-scale data processing solutions.

The ideal candidate will have strong knowledge of Spark, Hive, SQL, and Unix shell scripting, as well as experience with Databricks in a production environment and Azure cloud services. Additionally, they should have hands-on experience with Apache Kafka or other real-time streaming technologies and strong problem-solving skills.

Responsibilities
  • Design and develop data pipelines using Spark and Python to optimize data processing and scalability.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources for seamless data transformations.
  • Develop and maintain Hive queries to ensure efficient data extraction and processing.
  • Write and optimize SQL queries for large datasets to improve performance and accuracy.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka to deliver timely insights.
  • Work on Databricks to create, manage, and optimize data workflows for increased efficiency.
  • Deploy and manage solutions in Azure cloud services to ensure scalability and reliability.
  • Debug, troubleshoot, and optimize code for performance and scalability through collaboration with cross-functional teams.
Requirements
  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services.
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
Benefits

This role offers opportunities for growth and professional development in a dynamic team environment.

  • Data Engineering Specialist

    1 week ago

    Meerut, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistAt our organization, we are seeking a highly skilled data engineering professional to join our team. As a key member of our technical team, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and develop end-to-end data...

  • Senior Data Architect

    2 weeks ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Job Title: Senior Software Engineer/ Technical Specialist

  • Senior Data Engineer Position

    4 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Lead Data Platform SpecialistWe are seeking a highly skilled and experienced Lead Data Platform Specialist to join our team.Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system.Supervise junior data engineering teams to ensure they carry out their duties in line with...

  • Senior Data Migration Specialist

    1 week ago

    Meerut, Uttar Pradesh, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Title: Data Migration SpecialistData migration is a crucial process in today's digital landscape. It involves the transfer of data from one system to another, often with significant complexities and challenges.As a senior specialist in this field, you will be responsible for leading and executing data migration projects, working closely with...

  • Senior Data Engineer

    4 days ago

    Meerut, Uttar Pradesh, India SID Information Technologies Full time

    Role: Senior Data EngineerExperience: 4–8 yearsLocation: HyderabadWork Mode: Hybrid (3 days/week in-office)Join Time: ImmediateMust-Have Technical Skills:Strong programming skills in Python and/or ScalaHands-on experience with Apache Spark for big data processing on AWS cloudProficiency with AWS services such as S3, Glue, Redshift, EMR, LambdaStrong SQL...

  • Senior Data Management Specialist

    1 week ago

    Meerut, Uttar Pradesh, India beBeeDataManagement Full time ₹ 9,00,000 - ₹ 10,95,000

    Job Description:We are seeking a skilled professional to join our team as a Senior Data Management Specialist. The ideal candidate will have hands-on experience in designing database and reporting solutions, developing and maintaining analytics data warehouses, and contributing to the design and development of technical solutions.The Role:This position...

  • Data Engineering Leader

    1 day ago

    Meerut, Uttar Pradesh, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleSenior Software Engineer/ Technical SpecialistThis is a challenging role for an experienced software engineer looking to work on complex data engineering projects. The ideal candidate will have strong experience in Azure Data Engineering with Data Factory, Synapse, Fabric, Databricks.Design and implement scalable data architectures following...

  • Senior Data Engineering Professional

    4 days ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock the Power of Data-Driven InsightsAbout the RoleThis senior data engineering position involves contributing to the development of innovative digital solutions.Main ResponsibilitiesCollaborate with stakeholders to identify and deliver data requirements through technical solutions.Design, develop, and deploy scalable data pipelines using...

  • Senior Data Engineering Lead

    4 days ago

    Meerut, Uttar Pradesh, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data ArchitectWe are seeking a seasoned Data & AI Specialist to spearhead our data and AI endeavors.The ideal candidate is a visionary strategist who can function as an independent consultant, guiding projects from conceptualization to delivery.Leverage cutting-edge architecture to design and implement highly scalable and reliable data platforms and AI...

  • Senior Healthcare Data Infrastructure Specialist

    6 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a Senior Data Engineer to spearhead the development of scalable, event-driven data pipelines that support real-time clinical workflows.This is a critical role where you will create robust systems to ingest, track, and update clinical events in real-time.You will work closely with software engineers, ML specialists, and our...