AWS Data Engineering Expert

1 week ago

Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
AWS Data Engineer Job Post

We are seeking a highly skilled and experienced Data Engineer to drive our data engineering initiatives.

The ideal candidate should have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modelling, Python, SQL, PartiQL, and integrating third-party APIs from scratch.

  1. Design and implement end-to-end data engineering solutions from ground up on the AWS platform using services such as Glue, EMR, Lambda, and more.
  2. Design and implement scalable DynamoDB databases, optimizing performance and ensuring data consistency, throughput, and storage efficiency.
  3. Collaborate with cross-functional teams and stakeholders to gather data requirements and understand business objectives.
  4. Architect and implement data models and schemas that align with best practices and optimize query performance.
  5. Build robust and scalable data pipelines to extract, transform, and load (ETL) data from diverse sources into target systems.
  6. Integrate third-party APIs to retrieve and ingest data from external systems, ensuring data accuracy and reliability.
  7. Perform data profiling, data cleansing, and data quality checks to ensure accuracy and consistency.
  8. Optimize SQL queries and database performance, leveraging SQL tuning techniques and indexing strategies.
  9. Implement data governance and security measures to protect sensitive data throughout the pipeline.
  10. Develop and maintain documentation for data pipelines, data flows, and data transformations.
  11. Stay up-to-date with industry trends and emerging technologies in data engineering, AWS services, and third-party API integrations.
Requirements:
  • Bachelor's degree in Computer Science or a related field.
  • Minimum of 2+ years of experience in data engineering, specifically in building and maintaining data pipelines from scratch
  • Strong proficiency in AWS services such as Glue, EMR, Lambda, Dynamo DB, Postgres.
  • Expertise in data modelling, schema design, and relational and non-relational database concepts.
  • Solid working knowledge of SQL, SQL tuning, and data modeling best practices.
Key Skills:
  • Experience in designing and implementing single-table architecture in DynamoDB, optimizing data models for scalability, efficient query patterns, and minimal read/write costs.
  • Proficiency in using PartiQL to query and manipulate data in DynamoDB, with a focus on optimizing queries for performance and integrating complex business logic.
  • Experience in developing and optimizing SQL queries for performance.
  • Proficiency in Python programming for data manipulation, transformation, and scripting tasks.
  • Familiarity with data warehouse concepts, OLAP, and Big Data technologies.
  • Experience in integrating third-party APIs to retrieve and ingest data from external systems.
Personal Attributes:
  • Team player with good interpersonal skills and problem-solving abilities.
  • Self-motivator and collaborative team player.
  • Excellent time management skills and ability to assume leadership roles when necessary.
  • Agile, action-oriented, and quick learner.
  • Out-of-box thinker.
Benefits:
  • Flat hierarchy.
  • Employee Stock Ownership Plan (ESOPs).
  • Group Medical Coverage.
  • 30 days of Leave.
  • Gender-neutral parental, marriage, and compassionate leave policy.

  • AWS Big Data Engineer

    1 week ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    AWS Big Data EngineerWe are seeking a highly skilled professional to design, develop and optimize large-scale Big Data architectures leveraging AWS services. The ideal candidate will bring strong hands-on experience in designing and implementing scalable data engineering solutions.

  • AWS Cloud Expert

    1 week ago

    Agra, Uttar Pradesh, India beBeeCloudEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an accomplished AWS Cloud Expert to join our team. As a key player in designing and managing cloud solutions, you will be responsible for crafting scalable, secure, and efficient cloud architectures using your expertise in AWS technologies.Key Responsibilities:Create and manage AWS cloud infrastructure according to best practicesDevelop...

  • AWS Engineering Lead

    1 week ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    AWS Data ArchitectWe are seeking a highly skilled Senior AWS Data Engineer to join our data engineering team.Design, develop, and maintain robust ETL/ELT pipelines on AWS using Spark and PySpark.Optimize large-scale data processing workflows for performance and reliability.Work with AWS services such as Glue, EMR, S3, Lambda, and Redshift.

  • Data Engineering Expert

    1 week ago

    Agra, Uttar Pradesh, India beBeeEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Data Engineering ExpertWe are seeking hands-on data engineers with strong experience in migrating data pipelines and working with diverse database systems.Migrate ETL pipelines from Fivetran into Nexla/Snowflake and optimize them for performance.Design, build, and maintain ETL pipelines using Python, PySpark, DBT, and related tools to ensure...

  • AWS Certified Cloud Data Engineer Role

    1 week ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data EngineerWe are seeking a Cloud Data Engineer to design, develop and maintain data pipelines and ETL processes using AWS services. The ideal candidate will have hands-on experience with AWS cloud services and strong programming skills in Python.Data Ingestion and Processing: Design and implement scalable data ingestion and processing workflows...

  • AWS Senior Technical Lead

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Senior Data Engineer, your key responsibilities will include studying existing technology landscapes and understanding current data integration frameworks. You will analyze data processing, integration, modeling, and reporting requirements, defining data loading strategies considering volume, data types, frequency, and analytics specifications.The ideal...

  • Data Engineering Leader

    1 week ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering ExpertWe are seeking a highly skilled Data Engineer to lead the development of robust data pipelines and scalable data architectures.About the RoleDesign, build, and maintain ETL pipelines using PySpark, AWS Glue, and other technologies to ensure high-quality data delivery.Collaborate closely with analysts to guarantee data accuracy,...

  • DBA – AWS Redshift

    2 weeks ago

    Agra, Uttar Pradesh, India AS Technology Corporation Full time

    Role: DBA – AWS RedshiftWork Location: GurugramMode of work: Hybrid (2 to 3 days in a week)Experience level: 6 to 12 YrsJob Description:Senior Redshift DBA will be responsible for managing Redshift clusters and support AWS services (EC2, RDS, Redshift, S3, ELB, NLB). Candidate will have extensive experience with Database platforms including AWS Redshift,...

  • Data Engineering Expert

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 13,71,500 - ₹ 21,35,900

    Seeking a Data Engineering Expert to lead the development and implementation of scalable data solutions.Required Skills and Qualifications:Bachelor's or Master's degree in Computer Science, Information Systems, Data Science, or related field.6+ years of experience in data analysis, engineering, or solution design in Compliance, Risk, or Financial Services...

  • Expert Software Engineer

    1 week ago

    Agra, Uttar Pradesh, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Software Engineering ExpertWelcome to a leading global IT consulting and business solutions organization. We are seeking an experienced Software Engineering Expert to join our team.Job Description:As a Software Engineering Expert, you will be responsible for designing, developing, and maintaining complex software systems. Your primary focus will be on...