Mastering Large-Scale Data Engineering

7 days ago


Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Engineer

The ideal candidate will have 3-5 years of experience in data engineering and a strong background in distributed data processing and storage.

Key Responsibilities:

  • Design, develop, and maintain large-scale data pipelines using Python, SQL, and cloud-based technologies.
  • Collaborate with cross-functional teams to integrate data into various systems and applications.
  • Develop and implement data quality checks and metrics to ensure high-quality data.
  • Stay up-to-date with industry trends and emerging technologies in data engineering.

Nice to Have:

  • Experience with Azure Databricks.
  • Knowledge of DevOps - ETL pipeline orchestration using tools like GitHub actions, Terraform, Databricks workflows, and Azure DevOps.
  • Certifications in Databricks, Azure, AWS, or GCP.

Requirements:

  • Proficient in Python, including popular packages like Pandas and NumPy.
  • Strong background in distributed data processing and storage, including Apache, Spark, and Hadoop.
  • Large scale (TBs of data) data engineering skills, including model data and creating production-ready ETL pipelines.
  • Development experience with at least one cloud platform, preferably Azure, AWS, or GCP.
  • Knowledge of data lake and data lake house patterns.
  • Knowledge of ETL performance tuning and cost optimization.
  • Knowledge of data structures and algorithms and good software engineering practices.


  • Vadodara, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    As a seasoned data engineer, you will play a pivotal role in designing and building large-scale data systems.Key Responsibilities:Design and Develop Data PipelinesOptimize SQL Queries for PerformanceCollaborate with Cross-Functional TeamsDevelop Analytical Skills to Tackle Complex Data ChallengesRequirements:Strong Experience with Trino...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer Position OverviewWe are seeking a skilled Data Engineer to design, develop, and maintain large-scale data processing systems.This role involves designing and implementing scalable data pipelines using cloud-based services.Developing robust data models using big data tools and technologies is a key responsibility.Collaborating with...


  • Vadodara, Gujarat, India beBeeService Full time ₹ 20,00,000 - ₹ 25,00,000

    Order Management Opportunity">We are seeking an experienced ServiceNow developer to support a large-scale transformation project.">Key Responsibilities">">Design and implement Order Management processes in ServiceNow.">Implement ServiceNow OM and CSM modules, including order capture and orchestration.">Collaborate with technical leads to ensure best...


  • Vadodara, Gujarat, India beBeeCloudMigration Full time ₹ 25,00,000 - ₹ 30,00,000

    Senior Cloud Migration SpecialistAbout the Role:We are seeking an experienced Senior Cloud Migration Specialist to lead large-scale cloud migration projects. The ideal candidate will have a strong background in migrating on-premise data systems to the cloud.The Key Responsibilities include:Design and develop robust and scalable data pipelines for migrating...

  • Chief Architect

    2 weeks ago


    Vadodara, Gujarat, India beBeePlatform Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewAs a Lead Python Platform Engineer, you will be responsible for designing and building a shared component library/SDK for pipelines, as well as defining patterns/templates for Apache Beam pipelines and Databricks jobs.Key Responsibilities:Design and build a shared component library/SDK for pipelines: ingestion, parsing/OCR, extraction,...

  • Data Engineer

    3 days ago


    Vadodara, Gujarat, India beBeeBackend Full time ₹ 12,00,000 - ₹ 25,00,000

    Senior Data Integration SpecialistDesign and implement scalable data pipelines, including crawling, parsing, deduplication, and embeddings.Connect external systems and interfaces to enhance data quality and efficiency.The ideal candidate will have a strong background in backend/data engineering, including experience with design and implementation of data...


  • Vadodara, Gujarat, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Senior Data Architect Role">As a Senior Data Architect, you will lead our team in designing and implementing data architectures for large-scale distributed systems. This is an exciting opportunity to work on some of the most challenging data problems at private and public sector organizations.">Key Responsibilities:">">• Design and implement data...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerKey Responsibilities:Design, develop, and automate scalable data pipelines using Python and Pandas.Implement and manage large-scale ETL workflows using Hive SQL for data warehousing.Configure, monitor, and optimize Elasticsearch clusters for indexing, searching, and analytics performance.Build and maintain RESTful APIs using...


  • Vadodara, Gujarat, India beBeeLanguage Full time US$ 1,40,000 - US$ 1,70,000

    AI Model DeveloperWe are seeking an experienced AI model developer to join our team. As a senior data scientist, you will be responsible for developing and fine-tuning large language models (LLMs) tailored to specific business needs.You will work closely with cross-functional teams to integrate LLMs into production systems and ensure their performance,...


  • Vadodara, Gujarat, India beBeeProgram Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Technical Program Manager for Cloud and Data EngineeringWe are looking for an experienced Technical Program Manager to lead large-scale cloud and data engineering projects. This role involves managing complex ecosystems, overseeing teams, ensuring governance, and driving innovation through data and AI.Plan, execute, and deliver large-scale data engineering...