Senior AWS Data Pipeline Architect

2 days ago

Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Job Summary

We are seeking an experienced Data Engineer with expertise in AWS to join our organization. As a Data Engineer, you will design and implement robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making across multiple domains.

The ideal candidate will have a strong command of SQL for creating, managing, and optimizing data structures and complex queries, as well as expertise in AWS services such as S3, EC2, RDS, Redshift, and AWS Glue.

You will work closely with cross-functional teams to gather and address technical and design requirements, ensuring the integrity, security, and performance of data processing and storage systems.

In this role, you will also be responsible for:

  • Designing and implementing robust data pipelines using AWS, Python, and SQL.
  • Ensuring data integrity and performance of data processing and storage systems.
  • Optimizing data flows and architecture within AWS to enhance performance, scalability, and reliability.
  • Developing and maintaining scalable and efficient ETL processes and APIs for data interaction.
  • Collaborating with cross-functional teams to gather and address technical and design requirements.
Key Responsibilities
  • Expertise in AWS services such as S3, EC2, RDS, Redshift, and AWS Glue.
  • Proficiency in Python, with a solid understanding of libraries and frameworks for data engineering (e.g., Pandas, PySpark).
  • Strong command of SQL for creating, managing, and optimizing data structures and complex queries.
  • Familiarity with orchestration tools (e.g., Airflow) and data integration techniques.
Requirements
  • Minimum of Two years of experience in data engineering or a related field.
  • Strong proficiency in building and maintaining data pipelines in AWS environments.
  • Experience with Python for scripting and data manipulation.
  • Advanced SQL knowledge for complex querying and database interaction.

  • Advanced Data Pipeline Solutions Lead

    23 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to lead the development of our data pipeline solutions. As a Senior Data Engineer, you will design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Responsibilities:Develop scalable ingestion and transformation workflows across...

  • Data Architect

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 12,01,000 - ₹ 20,10,000

    Job Title: Data ArchitectWe are seeking a skilled professional to design, build and optimize scalable data pipelines.The ideal candidate will be responsible for enabling seamless data integration, transformation and analytics to support business intelligence and advanced analytics initiatives.Main Responsibilities:Design and maintain ETL/ELT pipelines using...

  • Data Pipeline Specialist

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewAs a seasoned data pipeline specialist, we seek a highly skilled and motivated ETL developer to join our team.The ideal candidate will have extensive experience in designing, developing, and maintaining efficient data pipelines using IBM DataStage (Cloud Pak for Data) and AWS Glue/Lambda for ingestion from varied sources such as flat files, APIs,...

  • Senior Data Systems Architect

    18 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Systems ArchitectWe are excited to announce an opportunity for a skilled data architect to join our team.About the Role: As a senior data systems architect, you will play a crucial role in designing, developing, and deploying large-scale data processing systems using cutting-edge technologies like PySpark and...

  • High Performance Data Solutions Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title:">High-Performance Data Solutions Architect">About the Role:">We are seeking an experienced Senior Databricks Data Engineer to lead the design and development of scalable data pipelines using Databricks and PySpark.">Design, develop, and maintain high-performance data solutions on AWS using services like S3, Glue, Lambda, EMR, and...

  • Optimize Cloud Data Pipelines

    18 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Freelance Data EngineerWe are seeking an experienced Freelance Data Engineer with expertise in Python and AWS services. The ideal candidate will design, develop, and optimize data pipelines using AWS Glue, PySpark, and Step Functions.

  • Cloud-Based Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer Job DetailsWe are seeking a highly skilled Senior Data Engineer to design and maintain cloud-based data architectures, deploy and optimize data solutions on various cloud platforms, and develop ETL/ELT pipelines for structured and unstructured data.Design and maintain scalable data architectures, including data lakes, lakehouses, and...

  • Lead Cloud Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000

    **Senior AWS Data Engineer Role Overview**We are seeking an experienced Senior AWS Data Engineer to join our team. As a key member of the data engineering group, you will design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.The ideal candidate will have...

  • Freelance Data Pipeline Architect

    12 hours ago

    Tirupati, Andhra Pradesh, India beBeeAzureDataFactory Full time ₹ 30,00,000 - ₹ 40,00,000

    We are seeking a highly skilled Freelance Azure Data Factory Specialist to support our data integration and ETL needs.About the RoleThe ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations using Azure Data Factory (ADF).Key...

  • Cloud Data Architect

    3 days ago

    Tirupati, Andhra Pradesh, India beBeeIntegration Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title:Senior Integration SpecialistSeeking an experienced Senior Integration Specialist with strong expertise in Cloud Data Integration (CDI), Cloud Application Integration (CAI), and SaaS Master Data Management (MDM).The ideal candidate will have proven experience in developing, configuring, and troubleshooting MDM data models, reference codelists, and...