Senior Data Engineer

8 hours ago

Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 10,00,000
Job Title: Senior Data Engineer

This role is an excellent opportunity to leverage your expertise in data engineering and take on a challenging project with our team. As a senior data engineer, you will design, develop, and optimize large-scale data processing solutions using PySpark, Python, SQL, and real-time data streaming.

Our ideal candidate will have 3–4 years of experience in building, maintaining, and optimizing data pipelines in cloud environments such as Azure. You will be responsible for implementing ETL/ELT solutions to integrate structured and unstructured data from multiple sources.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
  • Adhere to best practices for coding, testing, and deployment.

Required Skills & Qualifications:

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Senior Data Engineer Role

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Title:Senior Data Engineer RoleA senior data engineer is required to build data pipelines and integrate healthcare data with expertise.

  • Senior Data Engineer

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain large-scale data pipelines and ETL processes on Databricks.The ideal candidate will have 7+ years of experience in Data Engineering and a proven track record of delivering...

  • Senior Data Engineering Specialist

    6 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title: Senior Data Engineering SpecialistAbout the RoleWe are seeking an experienced data engineering specialist to join our team. As a key member, you will be responsible for designing and developing end-to-end data integration solutions, optimizing workflows, and collaborating with business and technical stakeholders to deliver scalable and...

  • Senior Data Engineer

    9 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Data Engineer - Contract OpportunityOverview:The role of Senior Data Engineer- Contract is an exciting opportunity for a skilled professional to join our organization and contribute to the development of innovative data solutions.Key Responsibilities:Design, develop, and implement advanced data models using star schema, facts & dimensions...

  • Senior Data Engineering Professional

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Senior Data Engineering ProfessionalWe are seeking a highly skilled professional with 4+ years of experience in Azure Data Engineering, holding strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies. The ideal candidate will have hands-on experience designing, building, and optimizing ETL pipelines, working...

  • Distinguished Data Engineering Professional

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer Job DescriptionWe are seeking an experienced Senior Data Engineer to play a key role in designing, developing, and maintaining large-scale data pipelines using various tools such as FiveTran, DBT Cloud, and custom frameworks.Some of the key duties and responsibilities of this role include:Developing and maintaining ETL pipelines for...

  • Unlock Career Potential as a Senior Data Engineer

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataengineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to play a critical role in the integration, development, and support of our newly implemented Fabric Data & Analytics Platform.Main Responsibilities:Designing, developing, and maintaining ETL pipelines to extract, transform, and load data into various...

  • Senior Data Engineering Professional

    20 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Overview:We are seeking a highly skilled and detail-oriented Senior Data Engineer to design, develop, and execute automated and manual test cases for data validation and transformation processes.About the Role:The ideal candidate will have strong experience in Python, Pandas, REST API, and testing with a solid understanding of data validation, data...

  • Senior Data Engineer Opportunity

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 19,00,000

    Job DescriptionWe are seeking a senior data engineer to join our team.Design, develop, and maintain large-scale data processing systems.Key Responsibilities:Develop efficient data pipelines using Python.Implement data warehousing and business intelligence solutions using Snowflake.Required Skills and QualificationsEssential Skills:Proficiency in Python...

  • Highly Skilled Data Engineering Expert

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a highly skilled data engineer to join our team. As a senior data engineer, you will be responsible for providing technical direction and setting high standards for code quality in data-intensive environments.The ideal candidate will have prior experience as a principal engineer, leading teams and mentoring members, with a...