Senior Data Pipeline Developer

2 days ago

Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Our team is seeking a highly skilled Data Engineer to join our ranks. As a key member of our organization, you will be responsible for designing, developing, and maintaining complex data pipelines using PySpark.Key Responsibilities:The ideal candidate will have
  • a strong background in PySpark, with hands-on experience in building scalable data pipelines.
  • expertise in using Spark SQL, DataFrame, and RDD APIs to implement complex business logic.
  • proficiency in programming skills, particularly in Python (preferred), with a solid understanding of data structures, algorithms, and software engineering principles.
  • experience in designing, developing, and maintaining batch and streaming data pipelines.
  • knowledge of ETL/ELT processes and best practices for data transformation, data quality, and performance optimization.
  • familiarity with modern data engineering ecosystems, including distributed data processing, storage systems, and workflow orchestration tools.
  • experience working with cloud services, such as AWS S3, AWS Glue/EMR, AWS Lambda, Step Functions, Redshift, or other cloud data warehouses.
  • ability to choose and apply the right Spark APIs (DataFrame, Dataset, RDD) for performance-efficient implementation of business logic at scale.
Benefits:This role offers a unique opportunity to work on cutting-edge projects, collaborate with a talented team, and develop your skills in a rapidly evolving field. We are committed to providing a dynamic and supportive work environment that fosters growth and innovation.About Us:We are a forward-thinking organization dedicated to harnessing the power of data to drive business success. Our team is passionate about leveraging technology to solve complex problems and deliver exceptional results.

  • Senior Data Engineer

    4 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Transforming Data into InsightsAbout This RoleWe are seeking an experienced data engineer to drive the development and maintenance of efficient data pipelines. The ideal candidate will possess a strong background in extract, transform, and load (ETL) processes, data engineering, and experience working with cloud-based data platforms.Data Pipeline...

  • ETL Pipeline Specialist

    1 day ago

    Surat, Gujarat, India beBeeTestEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Test EngineerAbout this role:We are seeking a skilled Senior Test Engineer to join our team and contribute to the development of reliable ETL pipelines in Azure cloud environments.You will be responsible for designing and developing comprehensive test cases using Python scripting and Pytest framework, ensuring accuracy, integrity, and performance of...

  • Data Pipeline Architect

    22 hours ago

    Surat, Gujarat, India beBeeDataPipeline Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Job OverviewWe are seeking a highly skilled and experienced Data Pipeline Architect to join our team.This role is ideal for individuals who have a passion for designing, implementing, and managing data pipelines using Azure Data Factory.The successful candidate will be responsible for creating scalable data processing solutions within Azure Synapse Analytics...

  • Data Pipeline Specialist

    17 hours ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Data Engineer with expertise in designing and implementing scalable, high-performance data pipelines. The role involves building and optimizing ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases.

  • Data Engineer for Large-Scale Data Pipelines

    17 hours ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    At ThreatXIntel, we take a proactive approach to security by continuously monitoring and testing clients' digital environments to identify vulnerabilities before they can be exploited.About the RoleWe are seeking an experienced Freelance Data Engineer with expertise in Python, SQL, and AWS to design, build, and optimize large-scale data pipelines.Key...

  • High-Performance Data Pipeline Specialist

    3 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerJob Description:We are looking for a skilled Big Data Engineer to join our team. As a key member of the Professional Services department, you will design, build, and maintain high-performance data pipelines that process massive amounts of data.Key Responsibilities:Design and implement scalable batch processing systems using...

  • Senior Data Developer

    1 day ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Key Role: Data EngineerJob Summary:We are seeking a highly skilled professional to join our data platform implementation team as a key member. The successful candidate will be responsible for designing, developing, and maintaining ETL processes to extract, transform, and load data into our data lake and data warehouse.Main Responsibilities:ETL...

  • Senior Data Engineer

    2 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionAs a senior data engineer, you will be responsible for designing and implementing automated data pipelines to support business analytics initiatives. You will work closely with cross-functional teams to develop production-ready workflows that incorporate data governance and quality metrics.This role involves building ETL/ELT pipelines in...

  • Senior Data Engineer

    2 days ago

    Surat, Gujarat, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • A talented professional sought to architect and implement advanced data pipelines

    18 hours ago

    Surat, Gujarat, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Pipeline ArchitectPerficient India seeks a skilled Data Pipeline Architect to design, build, and maintain serverless data pipelines using AWS services.Key Responsibilities:Data Pipeline Design: Develop scalable and efficient data pipelines utilizing AWS Glue, Apache Spark, and other AWS services.ETL to ELT Migration: Assist clients in migrating from ETL...