Scalable Data Engineer

3 days ago

Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking an experienced data professional to design and develop scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.

The role involves working closely with cross-functional teams to create data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing.

Key Responsibilities
  • Develop high-quality database programming requirements in collaboration with scrum teams.
  • Utilize Azure cloud tools and possess hands-on experience with Azure SQL, Advanced Python Programming, Databricks, Data Factory (ADF), Data Lake, Data Storage, SSIS, and T-SQL expertise.
  • Create and deploy scalable ETL/ELT pipelines using Azure Databricks and PySpark, along with creating Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing.
  • Experience is required in Unity Catalog for centralized data governance, access control, and data lineage tracking.
  • Independently analyze, solve, and correct issues in real-time while providing end-to-end problem resolution.
  • Develop unit tests to be automatically tested.
  • Apply SOLID development principles to maintain data integrity and cohesiveness.
  • Interact with product owners and business representatives to determine and satisfy needs.
Requirements

Education: Bachelor's degree in Computer Science or related field.

Experience: 4–7 years of experience in data engineering and development.

Skills: Strong knowledge of Azure cloud services, including Azure SQL, Advanced Python Programming, Databricks, Data Factory (ADF), Data Lake, Data Storage, SSIS, and T-SQL.

Benefits

Opportunity to work on cutting-edge projects.

Chance to collaborate with a team of experienced professionals.

Professional growth and development opportunities.

  • Scalable Data Solutions Developer

    3 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    Data Engineering Expert WantedWe are seeking an accomplished Data Engineer to join our team and spearhead the development of scalable data solutions utilizing Google Cloud Platform (GCP) and AtScale. The ideal candidate will possess extensive experience in designing, building, and optimizing data pipelines, implementing efficient data models, and ensuring...

  • Cloud Engineer with Scalable Data Solutions

    4 days ago

    Surat, Gujarat, India beBeeDataArchitect Full time US$ 10,00,000 - US$ 15,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to lead the design, development, and optimization of our data engineering architecture.The ideal candidate will have a deep understanding of cloud-native data engineering on Microsoft Azure, and experience with AWS and GCP.They will be responsible for building scalable data pipelines,...

  • Building Scalable Data Solutions

    3 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000

    Cloud Data EngineerWe're seeking a seasoned IT Professional with hands-on experience in Snowflake Data Cloud to lead the design, implementation, and optimization of scalable data solutions. As a key member of our team, you will be responsible for architecting and delivering end-to-end data solutions on Snowflake.Design and implement scalable data solutions...

  • Strategic Data Engineer

    4 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer Job DescriptionAs a seasoned Data Engineer, you will be responsible for designing and implementing scalable data pipelines that power our analytics, reporting, and strategic initiatives. This role is ideal for someone with deep expertise in ETL development, data modeling, and financial data domains.The successful candidate will be instrumental...

  • Senior Data Engineer

    3 days ago

    Surat, Gujarat, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Building Scalable Systems

    1 week ago

    Surat, Gujarat, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Unlock your potential as a Senior Backend Engineer and take on the challenge of architecting and maintaining our platform's core services and infrastructure.Job DescriptionWe are seeking an experienced Backend Engineer to join our team, responsible for designing and implementing scalable, high-performance systems that empower cross-functional teams through...

  • Azure Data Engineer Position

    4 days ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems on Azure.Key ResponsibilitiesDevelop scalable data pipelines using Azure Data Factory, Apache Kafka, and other relevant...

  • Big Data Engineer

    5 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerOverview:We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.Build and...

  • Intelligent Data Engineer

    18 hours ago

    Surat, Gujarat, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    As a data engineer, you will be responsible for designing and building scalable data pipelines to transform raw events into actionable insights. Your expertise in Python, SQL, and machine learning libraries such as scikit-learn, LightGBM, and XGBoost will be crucial in defining and computing labels from historical events.You will work closely with backend...

  • Advanced Azure Data Engineering Position

    4 days ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,10,000

    Azure Data Engineer OpportunityThis role offers the chance to contribute to cutting-edge projects by designing, building and maintaining data pipelines using Azure technologies.Key Responsibilities:Design and implement scalable and secure data pipelines using ADF and ADB.Develop and maintain data processing workflows using PySpark and SQL.Collaborate with...