Data Pipeline Specialist

20 hours ago

Solapur, Maharashtra, India beBeeEtloperator Full time ₹ 90,00,000 - ₹ 1,20,00,000
ETL Testing Job

We are seeking a skilled ETL Tester to join our team.

Job Responsibilities:
  • Develop in-depth understanding of technical requirements from high-level and low-level design documents.
  • Configure development and user acceptance testing environments in Teradata, Unix, and Hadoop.
  • Allocate space for Teradata databases in system integration testing and user acceptance testing environments.
  • Migrate seed data from production to test environment using Teradata utilities.
  • Create a forklift job in the mainframe to move production data to mainframe files using the Fast-Export Utility and NDM.
  • Set up Extract, Transform, Load (ETL) jobs in regression efforts and execute workflows in Autosys and Mainframe.
  • Assign tasks to team members, participate in defect review meetings, and collaborate with the development team.
  • Prepare test cases with Test Plans and review them with the development team.
  • Create SQL scripts to validate Change Data Capture logic in Teradata.
  • Develop automation script modules in Tosca to execute regression scripts and upload results to Qtest/QC.
Required Skills and Qualifications:
  • Strong understanding of ETL concepts and technologies.
  • Experience with GCP and its related tools.
  • Familiarity with Teradata, Unix, Hadoop, and mainframe systems.
  • Proficiency in SQL scripting and programming.
  • Excellent communication and collaboration skills.
Benefits:

This role offers a challenging and rewarding opportunity to work with a talented team and contribute to the success of our organization.

Others:

Please note that this is a full-time position. We offer a competitive salary and benefits package, as well as opportunities for growth and professional development.

  • Data Pipelines Specialist

    2 days ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking an experienced Senior Data Engineer to join our team.This is a critical role in designing, developing, and maintaining data pipelines and infrastructure.Your Key Responsibilities:Designing and implementing scalable data pipelines using Azure Data Factory and Databricks for efficient data ingestion,...

  • Azure Data Pipeline Specialist

    7 days ago

    Solapur, Maharashtra, India beBeeData Full time US$ 9,00,000 - US$ 12,00,000

    Job Description:We are seeking a skilled Azure Data Engineer to design, build, and maintain robust data pipelines that efficiently curate and ingest data. This role involves working with cross-functional teams to ensure data integrity, security, and accessibility.Key Responsibilities:Design, build, and maintain data pipelines for efficient data curation and...

  • Senior Data Pipelining Specialist

    1 week ago

    Solapur, Maharashtra, India beBeeTalendDateveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled professional to fill the role of a Talend ETL Developer with expertise in BigQuery, PostgreSQL, and Python for an immediate contract position.Job Summary:Talend ETL Developers design, optimize, and deploy complex data pipelines using Talend Open Studio. The ideal candidate will have experience with partitioning, clustering, federated...

  • Senior Data Pipeline Specialist

    6 days ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,20,000

    Key Responsibilities:Design and maintain complex data pipelines utilizing Python, AWS (S3, Redshift, Lambda, Glue), and other relevant technologies.Implement and optimize Extract, Transform, Load (ETL) processes for large-scale datasets to ensure efficient data processing.Guarantee the integrity, security, and accessibility of data assets while adhering to...

  • Principal Data Pipeline Specialist

    1 hour ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,10,000

    Data Engineer Position OverviewWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will have the opportunity to work on complex data engineering projects using Databricks.Key Responsibilities:Design, develop, and deploy scalable data pipelines and ETL processes in Databricks.Collaborate with stakeholders to...

  • High-Performance Data Pipelines Specialist

    1 week ago

    Solapur, Maharashtra, India beBeeData Full time US$ 1,80,000 - US$ 2,40,000

    Big Data Engineer Job DescriptionWe're seeking a skilled Big Data Engineer to help us scale and optimize our data processing capabilities. Our platform processes massive amounts of data to provide actionable insights to clients.The ideal candidate will design, build, and maintain high-performance data pipelines that process terabytes of data. This includes...

  • Data Ingestion Specialist

    1 week ago

    Solapur, Maharashtra, India beBeeDataIngestion Full time US$ 80,000 - US$ 1,50,000

    Job Title: Azure Databricks EngineerWe are seeking a skilled Data Ingestion Specialist to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.Design, develop, and optimize data ingestion pipelines using modern technologies and methodologies.Implement and maintain Continuous Integration/Continuous Deployment...

  • Data Pipeline Quality Assurance Specialist

    7 days ago

    Solapur, Maharashtra, India beBeeTest Full time ₹ 80,00,000 - ₹ 1,50,00,000

    About this opportunity :We are seeking an experienced professional to join our team as a Test Engineer, specializing in ETL and Power BI.This role will involve ensuring the accuracy, integrity, and performance of ETL Pipelines deployed into Azure cloud environments.The ideal candidate will have experience with Python scripting and Pytest framework,...

  • Advanced Data Pipeline Validator

    20 hours ago

    Solapur, Maharashtra, India beBeeDataValidator Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL Tester Job DescriptionWe are seeking a skilled ETL Tester to validate data pipelines and transformations.Expertise in ETL testing methodologies, debugging data issues, and working with large datasets in cloud environments is required.The ideal candidate will have 6 years of experience and be able to identify and resolve data discrepancies efficiently.Key...

  • Lead Data Pipeline Developer

    7 days ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering ExpertWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines, as well as expertise in working with cloud-based services.Key Responsibilities:Develop and maintain ETL/ELT data pipelines to ingest data from various sources into our...