Data Pipeline Specialist

3 days ago

Nellore, Andhra Pradesh, India beBeeCloudMigrationEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
About the Role:

We are seeking a highly skilled Senior Cloud Migration Engineer with extensive experience in large-scale cloud migration projects. This role involves designing, developing, and deploying robust and scalable data pipelines for migrating data from various on-premise sources to cloud platforms.

  • Design and implement efficient cloud migration strategies and data transformation solutions in collaboration with architects and technical leads.
  • Serve as a subject matter expert in Datastage, Azure Data Factory (ADF), Databricks, and PySpark.

The ideal candidate will have at least 10 years of experience in data engineering and ETL development, with a strong background in migrating on-premise data systems to the cloud.

Key Responsibilities:
  1. Develop and Implement: Design, develop, and deploy robust and scalable data pipelines.
  2. Technical Expertise: Serve as a subject matter expert in core technologies.
  3. Solution Design: Collaborate with architects and technical leads to design cloud migration strategies and data transformation solutions.
  4. Code Quality: Ensure high-quality, well-documented code.
  5. Performance Optimization: Analyze and optimize performance of data pipelines.
  6. Problem-Solving: Troubleshoot and resolve complex technical issues.
  7. Mentorship: Provide guidance and technical support to junior engineers.
Required Skills and Qualifications:
  • Minimum of 10 years of experience in IT industry, focusing on data engineering and ETL development.
  • Extensive hands-on experience with Datastage.
  • Proven experience in Cloud Migration projects.
  • In-depth knowledge of Azure Data Factory (ADF).
  • Strong proficiency in Databricks and its ecosystem.
  • Expertise in PySpark.
  • Solid understanding of cloud platforms, preferably Microsoft Azure.
  • Experience with SQL and database concepts.

  • Data Pipeline Specialist

    3 days ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the Role","This role involves designing and implementing pipelines to extract relevant data from unstructured documents. The focus is on combining deterministic extraction techniques with cutting-edge automation to scale attribute mapping, quality assurance, and comparisons across hundreds of datasets."],

  • Expert Data Pipelines Engineer

    2 days ago

    Nellore, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Integration SpecialistJob Title: Senior Consultant Data EngineeringWe are seeking a highly skilled data integration specialist to join our team.The ideal candidate will be responsible for designing and developing end-to-end data pipelines, optimizing workflows, and collaborating with business and technical stakeholders to deliver scalable and...

  • Senior Data Pipeline Specialist

    3 days ago

    Nellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a candidate who is comfortable working on non-standard shifts.Develop and maintain data pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client onboardingOptimize cloud-based queries, compute usage,...

  • Data Pipeline Architect

    2 days ago

    Nellore, Andhra Pradesh, India beBeeFinancial Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Big Data EngineerWe are seeking a skilled professional to join our team as a Big Data Engineer. In this role, you will be responsible for designing and building robust data pipelines that handle high-volume financial data.Key Responsibilities:Design end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data...

  • Senior Data Pipeline Specialist

    2 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 24,00,000

    Job OverviewWe're seeking a skilled Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark, AWS, and Databricks.Key Responsibilities:Perform data profiling, validation, and transformation using Python and SQL.Optimize and monitor workflows for performance, scalability, and cost efficiency.Collaborate with analytics teams to...

  • Data Pipeline Architect

    2 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,60,00,000

    Job Title: Data Pipeline ArchitectAbout the Role:We are looking for a seasoned professional to design and develop efficient data pipelines using AWS Glue and DBT.The ideal candidate will have experience with serverless and AWS ecosystem services for data ingestion and transformation, aligning with Gartner's approach on data transformation.This role involves...

  • Data Pipeline Architect

    3 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to lead the development and implementation of large-scale data pipelines, multi-environment deployments, and modern DevOps/configuration management tools.Main Responsibilities:Design, implement, and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or...

  • Data Pipeline Architect

    3 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineer Position OverviewThe ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.This role requires a highly skilled professional to design, develop, and optimize large-scale data pipelines and distributed data...

  • Building Scalable Data Pipelines

    5 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking an experienced data architect to lead the design and implementation of our data pipelines using Snowflake, AWS Lambda, Glue, and SQL.Key Responsibilities:Design and implement scalable data pipelines that integrate with multiple internal and external sources.Develop ETL/ELT pipelines using AWS Glue, Lambda, and DBT for...

  • Cloud Data Pipeline Architect

    2 days ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned data engineer to lead our data pipeline development efforts, focusing on scalability and efficiency.The ideal candidate will design, develop, and optimize ETL/ELT pipelines using Apache Spark, AWS Glue, and Azure Data Factory for seamless data integration.Collaboration with cross-functional teams is essential in building...