Data Pipeline Specialist

22 hours ago

Agra, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Teradata with DataStage Developer

Job Description:

  • We are seeking a skilled data pipeline developer to design, build and optimize ETL jobs using IBM DataStage.

Key Responsibilities:

  • Design and develop efficient ETL workflows using IBM DataStage.
  • Write optimized SQL queries for data extraction, transformation, validation and quality assurance.
  • Collaborate with cross-functional teams including data analysts, business users and developers to implement integration solutions.
  • Perform manual and automated data validation, reconciliation and troubleshooting.
  • Conduct root cause analysis for data discrepancies and ETL failures.
  • Develop reusable DataStage job components, follow data modeling best practices and ensure data integrity.
  • Monitor ETL jobs, manage dependencies via Job Sequencers or Airflow and troubleshoot issues.
  • Document workflows, mappings and data dictionaries for future reference.
  • Support cloud migration and integration initiatives to improve scalability and efficiency.

Requirements:

  • IBM DataStage, Teradata, SQL, Oracle and related technologies.

Prior Experience:

  • Python, Shell Scripting, Unix/Linux, Apache Airflow, Cloud Platforms and Agile Methodologies.

Apart from technical skills, strong analytical and problem-solving skills, effective communication, teamwork, adaptability, attention to detail and time management skills are essential for success in this role.

  • Data Pipeline Specialist

    2 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Data Engineer Role SummaryAs a seasoned data professional with 10+ years of experience, you will work on challenging projects for various industries. You will design, develop, and maintain scalable data pipelines for both batch and real-time processing using GCP tools.About the PositionThis is a remote opportunity to join a leading provider of Data and...

  • Data Engineer

    1 week ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job Title: Data Engineer - Extraction SpecialistAbout the RoleWe're seeking a skilled Data Engineer to design and implement robust pipelines that transform large, messy datasets into high-quality structured data.The core focus is on extracting structured attributes from various documents using cutting-edge technologies like LLMs, OCR, regex, and digitization...

  • Data Pipeline Architect

    7 days ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline Architect">This role involves designing, developing and maintaining scalable data pipelines to support business growth and decision making. The ideal candidate will have a strong understanding of big data technologies and experience working with cloud-based platforms.Develops and maintains complex data pipelines using cloud-based...

  • ETL Pipeline Developer

    7 days ago

    Agra, Uttar Pradesh, India beBeeEtlSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    About UsWe are a leading provider of technical solutions, with a strong focus on innovation and customer satisfaction.Job DescriptionWe are seeking an experienced ETL Specialist to join our team. As an ETL Specialist, you will be responsible for ensuring the accuracy and integrity of our data pipelines.Design and develop comprehensive test cases for ETL...

  • Data Pipeline Architect

    7 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time US$ 1,80,000 - US$ 2,50,000

    Job DescriptionWe are seeking a skilled Senior Data Engineer to lead the optimization and scalability of our data pipeline architecture.Architect, build, and maintain robust, high-throughput data pipelines and infrastructure.Partner with cross-functional teams to design solutions that meet evolving data requirements and business objectives.Establish best...

  • Cloud-Based Data Pipeline Specialist

    5 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Summary:We are seeking a highly skilled and experienced Data Engineer to create, implement, and maintain robust data pipelines that drive real-world impact.Responsibilities:Data Pipeline Development: Develop and maintain scalable data pipelines using cloud services such as GCP, AWS, or Azure.Data Ingestion & Storage Solutions: Implement data ingestion,...

  • Senior Data Pipeline Engineer

    2 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Key Responsibilities:Data Engineering ExpertDevelop and deploy data warehousing solutions with Azure Synapse Analytics.Collaborate with cross-functional teams to integrate data engineering capabilities into business applications.Provide guidance on data architecture, data governance, and data security best practices.Requirements:7+ years of experience in...

  • Data Pipeline Architect

    4 days ago

    Agra, Uttar Pradesh, India beBeeetl Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior ETL Developer PositionWe are seeking a highly skilled and experienced Senior ETL Developer to join our team.The ideal candidate will have extensive experience in designing, developing, and maintaining complex ETL pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Our Senior ETL Developer will be...

  • Senior Data Pipeline Developer

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a skilled Data Engineer to join our team. This role involves designing and implementing data pipelines, ensuring the smooth flow of data between systems.

  • Senior Data Pipelines Engineer

    1 week ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Utilize your expertise as a skilled data engineer to develop and maintain scalable data pipelines.About the Role:Design, develop, and maintain ETL/ELT data pipelines utilizing cloud services like AWS Lambda, DMS, and Glue.Develop and optimize Snowflake stored procedures for implementing complex business logic and data transformations.Manage and monitor...