Data Pipeline Architect

20 hours ago

Agra, Uttar Pradesh, India beBeeetl Full time ₹ 18,00,000 - ₹ 25,00,000
Senior ETL Developer Position

We are seeking a highly skilled and experienced Senior ETL Developer to join our team.

  • The ideal candidate will have extensive experience in designing, developing, and maintaining complex ETL pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.
Key Responsibilities:

Our Senior ETL Developer will be responsible for:

  1. Designing, developing, and optimizing data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  2. Participating in code reviews, performance tuning, and defect triage sessions.
  3. Collaborating with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  4. Contributing to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  5. Troubleshooting and resolving issues in QA/UAT/Production environments as needed.
Required Skills and Experience:

To be successful in this role, the candidate should possess:

  • At least 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
Benefits:

This role offers:

  • A competitive salary package.
  • A comprehensive benefits program.
  • Ongoing training and professional development opportunities.
Others:

We offer a collaborative and dynamic work environment with opportunities for growth and development. If you are a motivated and detail-oriented individual with a passion for ETL development, we encourage you to apply.

  • Data Pipeline Architect

    5 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time US$ 1,80,000 - US$ 2,50,000

    Job DescriptionWe are seeking a skilled Senior Data Engineer to lead the optimization and scalability of our data pipeline architecture.Architect, build, and maintain robust, high-throughput data pipelines and infrastructure.Partner with cross-functional teams to design solutions that meet evolving data requirements and business objectives.Establish best...

  • Data Pipeline Architect

    5 days ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline Architect">This role involves designing, developing and maintaining scalable data pipelines to support business growth and decision making. The ideal candidate will have a strong understanding of big data technologies and experience working with cloud-based platforms.Develops and maintains complex data pipelines using cloud-based...

  • Data Engineer

    5 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job Title: Data Engineer - Extraction SpecialistAbout the RoleWe're seeking a skilled Data Engineer to design and implement robust pipelines that transform large, messy datasets into high-quality structured data.The core focus is on extracting structured attributes from various documents using cutting-edge technologies like LLMs, OCR, regex, and digitization...

  • Data Architect

    11 hours ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Solutions ArchitectLocation: RemoteJob Type: Full-TimeShift timings: Flexible HoursAbout the Role:We are seeking an experienced Data Solutions Architect to design and develop scalable, high-performance data solutions using Databricks.The ideal candidate has hands-on experience in Databricks production environments, a deep understanding of...

  • Cloud Data Architect

    6 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 16,00,000 - ₹ 25,10,000

    Job Title: Cloud Data ArchitectLocation: Remote Work EnvironmentJob Type: Full-TimeAbout the RoleWe are seeking an experienced Cloud Data Architect to lead the design and implementation of scalable, secure, and highly available data engineering solutions using Azure Data Engineering technologies.The ideal candidate will have a strong background in cloud...

  • Technical Data Architect

    2 days ago

    Agra, Uttar Pradesh, India beBeeData Full time US$ 1,00,000 - US$ 1,50,000

    Senior Technical Solutions ArchitectWe are seeking a highly skilled and experienced Senior Technical Solutions Architect to join our team. As a key member of our technical team, you will be responsible for designing and implementing scalable data architectures that meet the needs of our clients.Develop and optimize ETL/ELT pipelines using Azure Data Factory...

  • Senior Serverless Data Architect

    4 days ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Serveless Data ArchitectWe are seeking a skilled Serveless Data Architect to join our team. As a key member of our data solutions group, you will be responsible for designing and implementing serverless architectures using AWS services.Data Ingestion: Develop serverless data ingestion pipelines using AWS services such as Kinesis, S3, and Glue.Data...

  • Data Solutions Architect

    5 hours ago

    Agra, Uttar Pradesh, India beBeeDataSolutionsArchitect Full time ₹ 12,26,000 - ₹ 20,24,000

    About the Role:As an experienced data solutions architect, you will play a key role in designing and developing scalable data pipelines using Oracle Data Flow or Apache Spark (PySpark) with a solid understanding of data patterns, Python, and SQL.Key Responsibilities:Built and managed large-scale data platforms, including data lakes, data warehouses, and data...

  • Senior Data Solutions Architect

    4 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data Solutions ArchitectAzure data engineers play a crucial role in designing, building, and maintaining robust data pipelines to curate and ingest data efficiently.Design, build, and maintain scalable data solutions using Azure cloud services.Work with cross-functional teams to deploy and manage data workflows.Implement and maintain CI/CD...

  • Senior Data Architect

    5 days ago

    Agra, Uttar Pradesh, India beBeeDataArchitecture Full time ₹ 90,00,000 - ₹ 1,80,00,000

    Lead Data ArchitectJob Description:The ideal candidate will be a seasoned data architect responsible for designing and overseeing the architecture of Microsoft Fabric solutions. This includes integration with Power BI, Synapse, Data Factory, and other Azure services.Key Responsibilities:Design and implement scalable and secure data solutionsCollaborate with...