Senior Data Pipeline Developer

12 hours ago


Kolkata, West Bengal, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

We are seeking a seasoned Data Pipeline Specialist to join our team for an in-house project.

">Key Responsibilities
  • Develop and execute advanced SQL queries for data validation, reconciliation, and transformation checks across complex data pipelines and enterprise-grade data systems.
  • Design and maintain data validation automation frameworks using Python, with seamless integration into CI/CD pipelines.
  • Collaborate with DevOps teams for automation workflows and contribute to version-controlled repositories on GitHub.
  • Perform comprehensive testing of ETL processes, ensuring high-quality data delivery and integrity.
Requirements
  • Strong hands-on experience in ETL Testing is mandatory.
  • Expertise in advanced SQL for large-scale data operations is mandatory.
  • Proven ability to automate data validation using Python, with exposure to CI/CD tools and GitHub is mandatory.
Nice to Have
  • Working knowledge of AWS cloud services, especially S3 and Airflow.
  • Experience with PostgreSQL, Oracle, or SQL Server databases.


  • Kolkata, West Bengal, India beBeeCloud Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Title: Senior AWS Data EngineerWe are seeking an experienced Senior AWS Data Engineer to design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure.


  • Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Master Data Pipeline Developer">'>Key Responsibilities:">">(''Design and develop scalable data pipelines to integrate data from Oracle Flexcube and other sources into the Cloudera Data Platform">">('">'Utilize Hadoop for efficient data storage and Hive Impala for querying and processing">">('">'Ensure the reliability, scalability, and performance...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    We are looking for a skilled data engineer to design, implement and manage continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions or similar tools.Key ResponsibilitiesCreate efficient data pipelines using Python and SQL.Develop and maintain robust unit tests and validation checks for data workflows.Configure and manage...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer for Real-Time & Big QueryWe're seeking an experienced Senior Data Engineer to join our team in India. This is a remote opportunity for a specialist with 10+ years of experience to work on challenging projects for industries like Energy, Oil & Gas, Healthcare, and Finance.This role will be at the forefront of our data solutions,...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled professional to lead the design and optimization of our distributed data pipelines, infrastructure, and tools that power insights across our business.You will collaborate closely with software developers, architects, analysts, and data scientists to ensure smooth, secure, and efficient data delivery across multiple...


  • Kolkata, West Bengal, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000

    We are seeking a Data Specialist to join our organization, responsible for designing and developing robust data pipelines in Databricks PySpark. The ideal candidate will possess exceptional skills in ETL processes and the ability to collaborate with cross-functional teams.About This RoleThe Data Specialist will play a crucial role in ensuring efficient data...


  • Kolkata, West Bengal, India beBeePlatformEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About this Role:Lead Python Platform EngineerWe are seeking a highly skilled Lead Python Platform Engineer to join our team. This individual will be responsible for designing and implementing scalable and efficient data pipelines using Apache Beam and Databricks.This role requires strong expertise in Python, with at least 7 years of experience in performance...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Expert Data Pipeline EngineerWe are seeking a highly skilled and experienced data engineer to join our team. The ideal candidate will have expertise in designing, building, and maintaining robust data pipelines that efficiently curate and ingest data.The successful applicant will work closely with cross-functional teams to ensure data integrity, security,...


  • Kolkata, West Bengal, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Transforming Data into InsightsAbout the RoleWe are seeking a skilled Data Engineer with hands-on experience designing and implementing large-scale data pipelines. This role involves building, maintaining, and optimizing production-level data workflows to deliver high-quality insights.


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job SummaryWe seek a skilled Data Engineer to develop and maintain ETL pipelines utilizing cutting-edge technologies.This role involves transforming data, supporting ingestion and quality checks during client onboarding, optimizing Snowflake queries, and collaborating with the QC team.Key Responsibilities:Develop data transformations for HighTouch...