High-Tech Data Pipeline Specialist

3 days ago

Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Data Engineer

We are seeking a skilled professional to join our team and play a crucial role in building and optimizing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.

  • Key Responsibilities:
  • Develop high-quality database programming requirements for the sprint
  • Create and deploy scalable ETL/ELT pipelines with Azure Databricks using PySpark and SQL
  • Design and implement Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing
  • Collaborate with scrum teams to ensure data governance with Unity Catalog
  • Analyze, solve, and correct issues in real-time, providing end-to-end problem resolution
  • Develop unit tests to automate testing
  • Apply SOLID development principles to maintain data integrity and cohesiveness
  • Interact with product owners and business representatives to determine and satisfy needs
  • Maintain a sense of ownership and pride in performance and its impact on company success
Requirements

To be successful in this role, you will need:

  • 4-7 years of experience as a Data Engineer
  • A self-driven attitude with minimal supervision
  • Proven experience with T-SQL programming, Azure Databricks, Spark (PySpark/Scala), Delta Lake, Unity Catalog, ADLS Gen2
  • Microsoft TFS, Visual Studio, DevOps exposure
  • Experience with cloud platforms such as Azure or any
  • An analytical, problem-solving mindset
Benefits

This is an excellent opportunity to grow your career and contribute to a dynamic team. As a valued member of our organization, you can expect:

  • A competitive salary
  • A comprehensive benefits package
  • Ongoing training and development opportunities
  • The chance to work with a talented team and make a meaningful impact

  • Data Pipelines Specialist

    3 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerAs a seasoned data professional, you will design and implement high-quality, secure, and scalable data pipelines and systems. The ideal candidate has 4–5 years of experience in designing, building, and maintaining complex data flows.Key Responsibilities:Design and build scalable data pipelines using Snowflake, Fivetran, DBT, and...

  • Data Pipeline Assurance Specialist

    3 days ago

    Gandhinagar, Gujarat, India beBeeSeniorTestEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Test EngineerAbout the Role:We are seeking an experienced Senior Test Engineer to join our team. As a key member of our engineering department, you will play a critical role in ensuring the accuracy, integrity, and performance of our ETL pipelines deployed into Azure cloud environments.Responsibilities:Evaluate and Validate Data Flows:...

  • Data Pipeline Architect

    3 days ago

    Gandhinagar, Gujarat, India beBeeAdministration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewAs a Kafka expert, you will be responsible for designing and implementing scalable data pipelines to optimize message processing efficiency.You will work on automating the installation and configuration of production-grade Kafka clusters using tools such as Ansible and Chef, and troubleshoot critical issues to ensure high availability and fault...

  • High-Volume Financial Data Specialist

    2 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer for High-Volume Financial Data PipelinesWe are seeking a highly skilled data engineer to join our team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.Design and develop end-to-end data pipelines for stocks, crypto, and other financial...

  • Senior Data Pipeline Specialist

    5 days ago

    Gandhinagar, Gujarat, India beBeeTalent Full time ₹ 18,00,000 - ₹ 20,00,000

    Talend ETL Developer Job OpeningWe are looking for a highly skilled and experienced Talend ETL developer to join our team on a contractual basis. The ideal candidate will have expertise in Talend Open Studio, BigQuery, PostgreSQL, Python, and GCP.The role requires strong analytical skills, attention to detail, and the ability to design, optimize, and deploy...

  • Chief Data Infrastructure Specialist

    4 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About this roleWe are seeking a highly skilled Data Engineer with experience in building scalable data pipelines and integrating healthcare data.This critical position involves designing and operating event-driven data pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to our machine...

  • Expert Python Data Pipeline Specialist

    2 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionAs a Freelance Data Engineer with Python expertise, you will design and develop data pipelines using AWS Glue, PySpark, and Step Functions. Your primary responsibility will be to create efficient and scalable data engineering workflows that meet the needs of our organization.In this role, you will work closely with cross-functional teams to...

  • Senior Data Pipeline Engineer

    3 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    ETL TesterWe are seeking an ETL Tester to join our team. As a key member of the QA team, you will be responsible for ensuring the quality and accuracy of our data pipelines.Key Responsibilities:Design and execute test cases for ETL processesIdentify and report defects in data pipelinesCollaborate with development teams to resolve issuesDevelop and maintain...

  • Data Engineering Specialist

    3 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 14,00,000

    Data Engineering SpecialistWe are seeking an experienced Data Engineer to join our global engineering team. This is a unique opportunity to bring data engineering expertise to a multi-year project initiative.Key Responsibilities:Design and Implement Scalable Data PipelinesDevelop and Maintain Efficient Data Processing SystemsCollaborate with Cross-Functional...

  • Data Ingestion Specialist

    1 week ago

    Gandhinagar, Gujarat, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Ingestion Specialist to join our team.This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient...