Data Pipeline Architect

6 days ago

Bharatpur, Rajasthan, India beBeeEtldeliver Full time ₹ 20,00,000 - ₹ 25,00,000
Job Title: ETL Developer - Data Engineering RoleWe are seeking a highly motivated ETL Developer to join our data engineering team. As an integral part of our organization, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Your key responsibilities will include:
  1. Design and Develop ETL Pipelines: You will design and develop ETL pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from various sources.
  2. Build and Optimize Data Flows: You will build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  3. Collaborate with Data Governance Teams: You will collaborate with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  4. Troubleshoot and Resolve Issues: You will troubleshoot and resolve issues in QA/UAT/Production environments as needed.
To succeed in this role, you will need:
  1. 4+ Years of Experience in ETL Development: You should have at least 1–2 years of experience in ETL development with IBM DataStage (preferably CP4D version).
  2. Hands-on Experience with AWS Glue and AWS Lambda: You should have hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  3. Experience Working with Snowflake: You should have experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  4. Proficiency in SQL, Unix Scripting, and Basic Python: You should have proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
If you have the required skills and experience, we encourage you to apply for this exciting opportunity. 

  • Data Pipeline Architect

    1 week ago

    Bharatpur, Rajasthan, India beBeePipeline Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Pipeline ArchitectAbout the Role:We are seeking a highly skilled Data Pipeline Architect to join our team. In this role, you will design and develop data pipelines using Oracle Data Flow or Apache Spark (PySpark) with a solid understanding of data patterns, Python, and SQL.Key Responsibilities:Develop data pipelines that ensure seamless...

  • Data Pipeline Architect

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a Data Engineering professional to design, develop, and maintain our data pipelines using cutting-edge technologies. This role is ideal for an analytical and problem-solving expert with hands-on experience in Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.Key ResponsibilitiesDevelop scalable and reliable data pipelines using AWS services...

  • Data Pipeline Architect

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 25,00,000

    Cloud Data SpecialistWe are seeking a highly skilled Cloud Data Specialist with expertise in building scalable data pipelines and working on modern cloud & big data platforms.Key Responsibilities:Design, build, test, and deploy large-scale data processing systems using Python, PySpark, SQL, and Bash scripting.Develop ETL processes and data pipelines using...

  • Chief Data Pipeline Architect

    5 days ago

    Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a motivated data engineer with 3-4 years of experience in building, designing and maintaining large-scale data processing solutions using PySpark and Python.The ideal candidate will bring expertise in designing scalable data pipelines in cloud environments such as Azure. Responsibilities include designing, developing and...

  • Enterprise Data Architect

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataArchitect Full time ₹ 32,32,000

    Enterprise Data ArchitectThis is a challenging role for an experienced data architect to design and implement scalable, secure, and high-performance data architectures using Azure.We are seeking a seasoned professional with strong expertise in Azure Services, hands-on experience with AWS/GCP, and advanced knowledge of Azure Data Factory and ETL/ELT...

  • Data Pipeline Engineer

    2 weeks ago

    Bharatpur, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:ETL Developer - Data Pipeline SpecialistKey Responsibilities:Design and develop ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for data ingestion from diverse sources.Create and optimize data flows for loading curated datasets into Snowflake, incorporating best practices for schema design, partitioning, and transformation...

  • Data Pipelines Specialist

    2 weeks ago

    Bharatpur, Rajasthan, India beBeeAzure Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Freelance Azure Data FactoryJob Description:We are seeking a skilled professional to support our data integration and ETL needs. The ideal candidate will have hands-on expertise in designing, building, and maintaining ADF pipelines for scalable and secure data flows.The role involves several key responsibilities, including:Designing and optimizing...

  • Chief Data Architect

    2 weeks ago

    Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,30,00,000

    Unlock Your Career PotentialWe are seeking a talented Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining ETL pipelines using Azure Data Factory.As a Data Engineer, you will work closely with data architects, analysts, and business stakeholders to understand data requirements and implement data...

  • Cloud Data Architect Opportunity

    1 week ago

    Bharatpur, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 21,00,000

    Cloud Data Architect OpportunityWe are seeking a highly skilled data architect to design, develop and optimize data pipelines and integration solutions in the cloud. This is a fantastic opportunity for an individual with strong technical skills and a passion for designing scalable data architectures.Key Responsibilities:Design and develop advanced ETL...

  • Cloud Data Architect

    1 week ago

    Bharatpur, Rajasthan, India beBeeCloudDataArchitect Full time ₹ 35,00,000 - ₹ 45,00,000

    About the RoleThis is a highly experienced Cloud Data Architect position requiring 5+ years of experience in designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP).Design and implement highly scalable, reliable, and secure data pipelines on GCP using Google Cloud Storage (GCS), BigQuery, and Apache...