Highly Skilled ETL Architect

7 days ago

Varanasi, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000
Senior ETL Developer

We are seeking a skilled Senior ETL Developer to join our data engineering team.

The ideal candidate will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.

Responsibilities include designing, developing, and maintaining ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.

You will collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets supporting analytics and AI/ML use cases.

Main Responsibilities:
  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
Required Skills and Experience:
  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.
Good to Have:
  • Experience with Collibra, BigID, or other metadata/governance tools.
  • Exposure to Data Mesh/Data Domain models.
  • Experience with agile/Scrum delivery and Jira/Confluence tools.
  • AWS or Snowflake certification is a plus.

  • Highly Skilled Data Architect

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job DescriptionA highly skilled Senior Data Engineer with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure is required.This role is perfect for someone who thrives in a fast-paced, engineering-driven environment.

  • Highly Skilled Backend Architect Wanted

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Technical Systems ArchitectOverview:We are seeking a highly experienced technical systems architect to design and build scalable backend systems.The ideal candidate will be proficient in Node.js (NestJS framework preferred) and TypeScript, with strong experience in GraphQL API design and implementation.This role requires expertise across...

  • ETL Specialist

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeEtl Full time ₹ 18,00,000 - ₹ 25,00,000

    ETL SpecialistWe are seeking a highly skilled ETL Specialist to develop and maintain ETL processes, reports, and database solutions using SSIS, SSRS, and SQL Server.This role requires strong technical expertise to deliver high-quality code, optimize performance, and collaborate with cross-functional teams in an Agile/Kanban environment.Design, develop, and...

  • ETL Data Engineering Expert

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Are you an expert in data engineering and architecture looking to drive business growth through technological advancements? Our client is seeking a seasoned ETL Developer to join their team.Job OverviewThis is a full-time opportunity for a talented individual to design, develop, and test ETL architecture, transformation jobs, and workflow schedules. The...

  • Senior Data Infrastructure Specialist

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeData Architect Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled data architect to design and develop robust data systems for our slot games. This role will involve creating scalable data infrastructure ensuring high-quality reliable data for player behavior analysis game performance and optimization.Key ResponsibilitiesCreate maintain and optimize large-scale data pipelines for slot game and...

  • Chief Data Architect

    14 hours ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AWS Data Architect PositionAt a leading organization, we're seeking a highly skilled AWS Data Architect to lead the design and implementation of scalable data solutions on AWS.Key Responsibilities:Design and implement data pipelines, warehouses, and data lakes on AWS.Work on data modeling, ETL/ELT processes, and performance tuning.Collaborate with business...

  • Highly Skilled Data Integration Expert Wanted

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior ETL DeveloperExpert Data Integration Specialist sought to design, develop and implement efficient ETL solutions using Fivetran, Matillion ETL and Qlik Sense.About the RoleFull-time position requires 3-7 years of experience in ETL development.Hands-on experience with cloud data warehouses (Snowflake, Redshift, BigQuery, or Azure Synapse) is...

  • Highly Skilled Cloud Automation Expert Wanted

    13 hours ago

    Varanasi, Uttar Pradesh, India beBeeAutomation Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a highly skilled Senior Infrastructure Architect to lead the design and implementation of a cutting-edge infrastructure automation framework for our cloud environment. The successful candidate will have a proven track record of delivering scalable and maintainable solutions, with expertise in Ansible, Python, and related infrastructure...

  • Highly Skilled Data Engineer Wanted

    19 hours ago

    Varanasi, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a highly skilled engineer to lead our Big Data initiatives and drive innovation in scalable data solutions. Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing. Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets....

  • Highly Skilled Backend Architect

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeSenior Full time ₹ 3,50,00,000 - ₹ 4,50,00,000

    We are seeking a highly skilled Senior Full Stack Developer to join our team.The successful candidate will have a proven track record of designing and implementing scalable full-stack applications, with expertise in NodeJS, React JS/ES7/VueJS, and AWS infrastructure.Key ResponsibilitiesDesigning and developing RESTful APIs using NodeJSBuilding front-end...