Senior Data Pipeline Specialist

19 hours ago


Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 27,00,000

Meet the requirements for a senior data engineer position to create and maintain ETL/ELT pipelines in our organization.

Key Responsibilities
  • Pipeline Development: Design, build, and manage efficient ETL/ELT pipelines using AWS services like Lambda, DMS, and Glue.
  • Data Transformation: Implement complex business logic and data transformations utilizing Snowflake stored procedures.
  • Scheduled Workflows: Monitor and oversee scheduled data workflows with Apache Airflow.
  • Data Quality Checks: Establish and maintain robust data quality checks for accuracy and reliability of all datasets and reports.
  • Project Delivery: Follow the project delivery lifecycle, including requirement gathering, design, implementation, documentation, and UAT approvals.

We're looking for an individual with 6-10 years of experience in data engineering or a related field. The ideal candidate will possess strong SQL scripting skills, proficiency in Python for data manipulation, and hands-on experience with AWS Cloud services.

Requirements
  • Experience with workflow orchestration using Apache Airflow.
  • A solid understanding of data warehousing concepts and practical experience using Snowflake.
  • Excellent problem-solving skills to design and implement solutions based on business needs.


  • Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,50,000

    Job Description:As a skilled data engineer, you will be responsible for designing and implementing robust data pipelines using Python and SQL. You will work with modern DevOps/configuration management tools to manage multi-environment deployments.Design, implement, and manage CI/CD pipelines using Github Actions or equivalent tools.Configure and maintain...


  • Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking an experienced Data Engineer to design, develop, and maintain large-scale data pipelines using Azure Databricks and PySpark. This role involves collaboration with cross-functional teams to integrate data engineering solutions with business requirements, ensuring data quality, security, and compliance throughout the data...


  • Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines using Databricks and PySpark.The ideal candidate will have a strong background in cloud architecture and data engineering, with expertise in AWS services such as S3, Glue, Lambda, EMR, and Redshift.Key Responsibilities:Design and...


  • Varanasi, Uttar Pradesh, India beBeeMachine Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AI Pipeline SpecialistAs a pivotal member of our team, you will play a critical role in designing, implementing, and deploying cutting-edge Artificial Intelligence (AI) and Machine Learning (ML) pipelines across various cloud environments.Key ResponsibilitiesDesign and develop AI/ML pipelines using AWS services like SageMaker, Fargate, and Bedrock.Apply...


  • Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We're looking for a highly skilled and experienced Senior Data Engineer to join our team.About the Role:As a Senior Data Engineer, you will be responsible for designing, developing, and implementing complex data pipelines for migrating data from various on-premise sources to cloud platforms. You will serve as a subject matter expert in project core...


  • Varanasi, Uttar Pradesh, India beBeeDataArchitect Full time US$ 80,000 - US$ 1,40,000

    Data Architect SpecialistAre you a data expert looking for a challenging role in the field of data engineering? Do you have experience with designing and developing scalable data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue? If so, we want to hear from you!Key Responsibilities:Data Pipeline Development: Develop and maintain...


  • Varanasi, Uttar Pradesh, India beBeeMachine Full time ₹ 37,75,255 - ₹ 50,31,850

    We're looking for a skilled Machine Learning Specialist to join our team.Key Responsibilities:Proficient in Python language and familiar with Tensorflow/Keras frameworks.Experience in building ML Pipeline and setting up big data processing pipelines.Ability to evaluate models and benchmark various model versions on different data and report...


  • Varanasi, Uttar Pradesh, India beBeeETLDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking a talented and motivated individual to join our data engineering team as a Senior Data Engineer.About the RoleThis role involves designing, developing, and maintaining large-scale data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake. You will work closely with cross-functional teams to ensure...

  • Cloud Data Specialist

    17 hours ago


    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data SpecialistWe are seeking a skilled Data Engineer to join our organization. The successful candidate will work on designing, building and maintaining large-scale data systems using Azure technologies.Key Responsibilities:Design and develop scalable data pipelines using cloud-based services such as Azure Data Factory (ADF) and Azure Databricks...


  • Varanasi, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 6,00,000 - ₹ 12,00,000

    Our organization is seeking a highly skilled Data Systems Specialist to design, develop, and maintain large-scale data processing systems. This individual will work closely with cross-functional teams to identify business requirements and develop solutions that meet those needs.Key ResponsibilitiesData Pipelines: Design and implement efficient data pipelines...