ETL LEAD with IBM DataStage experienced

7 days ago

Lucknow, Uttar Pradesh, India IntraEdge Full time

Job Title: ETL Developer – DataStage, AWS, Snowflake

Experience: 5–7 Years

Location: Remote

Job Type: Full-time

About the Role

We are looking for a talented and motivated ETL Developer / Senior Developer to join our data engineering team. You will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake. You will collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets supporting analytics and AI/ML use cases.

Key Responsibilities

  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
  • Adhere to agile delivery practices, sprint planning, and documentation requirements.

Required Skills and Experience

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.

Good to Have

  • Experience with Collibra, BigID, or other metadata/governance tools
  • Exposure to Data Mesh/Data Domain models
  • Experience with agile/Scrum delivery and Jira/Confluence tools
  • AWS or Snowflake certification is a plus

  • Senior Data Pipelines Architect

    6 days ago

    Lucknow, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    ETL Developer/Senior DeveloperDesign and develop scalable data pipelines using IBM DataStage and AWS Glue/Lambda.Collaborate with architects, business analysts, and data modelers to ensure timely delivery of critical data assets supporting analytics and AI/ML use cases.Required Skills:At least 4 years of experience in ETL development with at least 1–2...

  • ibm db2

    3 weeks ago

    Lucknow, Uttar Pradesh, India Randstad Digital Full time

    We are seeking an experienced DB2 Database Administrator (DBA) with over 8 years of hands-on experience in managing and supporting IBM DB2 databases. The ideal candidate will have a strong background in database performance tuning, backup and recovery, and automation through scripting. This role requires a proactive individual who can manage complex database...

  • Expert IBM iSeries Application Developer

    1 day ago

    Lucknow, Uttar Pradesh, India beBeeRPGLE Full time ₹ 15,00,000 - ₹ 20,00,000

    IBM iSeries DeveloperProgrammers.IO is actively seeking talented individuals who are skilled in IBM iSeries platform and RPGLE programming. If you're looking for a flexible work environment that allows you to contribute from anywhere, we want to hear from you.About the Role:As an experienced IBM AS400 iSeries developer, you will be responsible for designing,...

  • Data Management and Governance Lead

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeGovernance Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Job Title: Data Governance SpecialistJob Description:As a seasoned data governance specialist, you will play a key role in establishing and maintaining our enterprise-wide metadata management program.Working closely with cross-functional teams, you will be responsible for designing and implementing metadata policies, procedures, and standards to ensure data...

  • Cloud Migration Specialist

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeCloudMigration Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Migration ExpertThe role requires a highly skilled and experienced Cloud Migration Expert to join our team. The ideal candidate will have a minimum of 10 years of experience in data engineering and ETL, with a strong background in migrating on-premise data systems to the cloud.This role involves designing, developing, and implementing complex data...

  • Experienced Application Support Specialist Wanted

    4 days ago

    Lucknow, Uttar Pradesh, India beBeeSupport Full time ₹ 20,00,000 - ₹ 25,00,000

    About the Job:We are seeking an experienced Application Support Specialist to support and develop high-level billing applications. The ideal candidate will have a strong background in programming languages such as IBM Informix 4GL, Java, C#, VB.NET, and Shell scripting.Main Responsibilities:Develop, maintain, and support billing applications including IAS,...

  • Expert Supply Chain Logistics Professional

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeSpecialist Full time ₹ 25,00,000 - ₹ 30,00,000

    Supply Chain Logistics SpecialistJob Summary:We are seeking a highly skilled and experienced professional with IBM Sterling Order Management (Sterling 9.1) experience to implement, customize, develop, and support IBM Sterling solutions for our clients.As an expert in supply chain logistics, you will be responsible for leading the implementation and...

  • Senior AS400/RPG Systems Developer

    24 hours ago

    Lucknow, Uttar Pradesh, India beBeeAS400 Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking an experienced AS400/RPG Lead Developer to join our team.About the Role:Lead a team of developers in designing, developing and maintaining complex business applications on the IBM i / AS/400 platform.Oversee the development life cycle including requirements gathering, design, implementation, testing and deployment of applications.Work...

  • Chief Enterprise Performance Management Strategist

    4 days ago

    Lucknow, Uttar Pradesh, India beBeeConsultant Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior EPM ConsultantThis role is an opportunity to lead high-impact implementations for enterprise clients and build our solution delivery capabilities in a rapidly expanding market.EPM implementation track record - Led end-to-end financial planning/budgeting system deployments for enterprise clientsKey Responsibilities:Lead end-to-end EPM...

  • Experienced Freelance Data Integration Specialist

    20 hours ago

    Lucknow, Uttar Pradesh, India beBeeAzure Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Description:">ThreatXIntel, a pioneering cybersecurity company, safeguarded businesses from cyber threats with its tailored services. Cloud security, web and mobile security testing were provided to meet clients' specific needs.">The company took a proactive approach to security by continuously monitoring and testing digital environments to identify...