Data Pipeline Specialist

1 week ago


Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 12,00,000

Job Overview:

We are seeking an accomplished Data Engineer to spearhead our data pipeline initiatives.

About the Role:

The ideal candidate will possess experience in designing and implementing data pipelines utilizing Google Cloud Platform and Azure Databricks. Proficiency in DBT and a solid understanding of secure coding practices are essential.

In addition, the candidate should have expertise working with retail offline and online data sets, as well as Personally Identifiable Information (PII) data. Experience with unstructured data and knowledge of data science concepts are also highly desirable.

Key Responsibilities:

  • Design and implement data pipelines on Google Cloud Platform and Azure Databricks
  • Develop and maintain DBT models for data processing and transformation
  • Ensure adherence to secure coding practices and data governance policies
  • Collaborate with cross-functional teams to integrate data into business applications
  • Develop and maintain data quality metrics and monitoring processes

Required Skills and Qualifications:

  • Google Cloud Platform certification
  • Azure Databricks expertise
  • DBT development and deployment experience
  • Secure coding practices and data governance knowledge
  • Retail industry experience
  • Data science knowledge and/or experience producing ML models

Benefits:

  • Competitive salary and benefits package
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment

Additional Information:

  • Cloud Computing
  • Big Data
  • Machine Learning
  • Database Management


  • Allahabad, Uttar Pradesh, India beBeeSenior Full time ₹ 12,00,000 - ₹ 30,00,000

    Job Title: Senior Test Engineer">The role of a senior test engineer is multifaceted, requiring expertise in designing and executing manual and automated test cases for complex data pipelines.">Key Responsibilities:">">Design and develop test cases for Azure Data Factory ETL pipelines using Python and Pytest.">Validate data transformations, mappings, and...


  • Allahabad, Uttar Pradesh, India beBeeDatabaseEngineer Full time ₹ 18,90,000 - ₹ 25,20,000

    Database Engineering and Testing SpecialistThis role presents an excellent opportunity to leverage your expertise in database engineering and testing.Key Responsibilities:Design efficient data pipelines utilizing ETL concepts and data warehouse testing methodologies.Maintain and monitor scripts for data integrity and quality.Proficiently work with RDBMS:...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior AWS Data EngineerAs a Senior AWS Data Engineer, you will design and deploy end-to-end data pipelines on the AWS cloud infrastructure. You will utilize services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Develop and implement data processing and transformation workflows using Apache Spark and SQL to support analytics and reporting...


  • Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:As a data pipeline developer, you will be responsible for designing and implementing efficient data processing systems. You will collaborate with teams to meet business data needs and ensure data accuracy.Key Responsibilities:Develop and maintain data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue.Implement and...


  • Allahabad, Uttar Pradesh, India beBeeSnowflake Full time ₹ 20,00,000 - ₹ 25,00,000

    Snowflake Data EngineerWe're looking for a skilled data engineer to design and implement data pipelines using Snowflake Tasks, Streams, and Stored Procedures.Design and build ETL/ELT pipelines using Snowflake Tasks, Streams, and Stored Procedures to efficiently manage and process large datasets.Develop data models with clustering keys and optimize...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Highly skilled data professionals are sought after to spearhead the development of complex data pipelines. This role involves leveraging expertise in streaming data environments and frameworks such as Apache Spark, Streamsets, or Apache NIFI to ensure high-quality data delivery.Mandatory Skills:Experience with Kafka Framework, including kSQL and Mirror...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer with deep expertise in designing, building, and operating data pipelines that support real-time clinical workflows. This is a critical role where you will create scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Azure Data Engineer OpportunityDear candidate, we are seeking a skilled professional to design, build, and maintain scalable data pipelines using cloud-based data platforms.The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark, and SQL. They will work closely with cross-functional teams to develop...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Data Architect SpecialistWe are seeking a Senior Data Engineer to join our team of experts in cloud-native data engineering. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering automation.


  • Allahabad, Uttar Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistJob Overview:As a Data Engineering Specialist, you will play a pivotal role in designing and developing large-scale data processing systems using cutting-edge technologies.This challenging position requires expertise in big data technologies, including PySpark and Hive. Familiarity with Spark, HBase, and data quality...