Senior Data Pipeline Developer

2 days ago


Kota, Rajasthan, India beBeeSoftware Full time ₹ 1,81,68,000 - ₹ 2,01,12,000
Job Title

We are seeking a Senior Developer to lead the design and implementation of large-scale data pipelines using Apache Beam, Databricks, and other relevant technologies.

About the Role:
  • Develop and maintain efficient, scalable, and reliable data processing systems.
  • Collaborate with cross-functional teams to identify requirements and implement solutions.
  • Design and implement architecture for data processing systems.
Key Responsibilities:
  • Lead the development of large-scale data pipelines using Apache Beam and/or Spark.
  • Implement robust error handling and exception management mechanisms.
  • Conduct thorough testing and quality assurance to ensure system reliability and performance.
Required Expertise:
  • 10+ years of experience in software development, specifically with Python and large-scale data processing systems.
  • Hands-on experience with Apache Beam and/or Spark.
  • Strong knowledge of data structures, algorithms, and software design patterns.
  • Experience with cloud-based platforms, such as AWS or GCP.
  • Ability to collaborate effectively with cross-functional teams.
Benefits:
  • Competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • A collaborative and dynamic work environment.
About Us:

We are a forward-thinking organization dedicated to delivering innovative solutions. We value creativity, collaboration, and a commitment to excellence.



  • Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 25,00,000

    Key Role: Data EngineerWe are seeking a highly skilled and motivated data engineer to design, develop and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data.Primary Responsibilities:Design and implement data pipelines for processing structured and unstructured data.Develop and maintain ETL/ELT...


  • Kota, Rajasthan, India beBeeDatastage Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: ETL Developer  This is a challenging opportunity for an experienced ETL developer to join our team.We are looking for a skilled professional to design, develop and maintain efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue and Snowflake.You will work on building scalable data flows for loading curated datasets into...


  • Kota, Rajasthan, India beBeeDatabase Full time ₹ 18,90,000 - ₹ 25,20,000

    Job SummaryWe are seeking an experienced Data Engineer to design, develop and test complex data pipelines using ETL tools.We aim to hire a highly skilled individual with a strong understanding of ETL concepts, data warehouse testing methodologies, and manual testing. If you have a passion for delivering high-quality database scripts and collaborating with...


  • Kota, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 20,00,000

    Azure Data Engineer Role OverviewWe are seeking an experienced Azure Data Engineer to fill a key data engineering position. This role involves designing, developing, and running complete end-to-end data pipelines on the Azure platform.Key Responsibilities:Design and develop ETL processes using PySpark, SQL, and Azure Data Factory (ADF)Create and manage data...

  • GCP Data Engineer

    2 days ago


    Kota, Rajasthan, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...


  • Kota, Rajasthan, India beBeeDataQuality Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Quality Specialist PositionWe are seeking a highly skilled Senior Data Quality Specialist to ensure the accuracy and integrity of our data.The successful candidate will play a critical role in developing and executing tests using SQL, Tricentis, Python (PySpark), and data quality frameworks. They will also be responsible for testing and...


  • Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data EngineerAbout the RoleWe're seeking a skilled Data Engineer to create and maintain our data infrastructure. In this position, you'll be responsible for designing and developing ETL processes to extract, transform, and load data from various sources into our data lake and warehouse.Main Responsibilities:ETL DevelopmentDesign and develop ETL...


  • Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    We are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The ideal candidate will have expertise in Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.


  • Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to design, build, and operate the backbone of our AI-powered applications. As a critical member of our team, you will create scalable data pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to our machine learning systems...


  • Kota, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to oversee the design, implementation, and management of our data pipeline architecture.The successful candidate will have expertise in CI/CD practices, Databricks (Spark), Python, GitHub, and SQL. They will be responsible for building and automating data pipelines, managing...