Senior Data Engineer with AWS Expertise

23 hours ago

Kannur, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

Our company is looking for a highly skilled and experienced Data Engineer to join our team.

Job Description:

The ideal candidate will have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modelling, Python, SQL, PartiQL, and integrating third-party APIs from scratch.

Required Skills & Qualifications:
  • Design, develop, and implement end-to-end data engineering solutions from ground up on the AWS platform using services such as Glue, EMR, Lambda, and more.
  • Design and implement scalable DynamoDB databases, optimizing performance and ensuring data consistency, throughput, and storage efficiency.
  • Collaborate with cross-functional teams and stakeholders to gather data requirements and understand business objectives.
  • Architect and implement data models and schemas that align with best practices and optimize query performance.
  • Build robust and scalable data pipelines to extract, transform, and load (ETL) data from diverse sources into target systems.
  • Integrate third-party APIs to retrieve and ingest data from external systems, ensuring data accuracy and reliability.
  • Perform data profiling, data cleansing, and data quality checks to ensure accuracy and consistency.
  • Optimize SQL queries and database performance, leveraging SQL tuning techniques and indexing strategies.
  • Implement data governance and security measures to protect sensitive data throughout the pipeline.
  • Develop and maintain documentation for data pipelines, data flows, and data transformations.
Benefits:
  • A flat hierarchy.
  • ESOPs.
  • Group Medical Coverage.
  • 30 days of Leave.
  • A gender-neutral parental, marriage, and compassionate leave policy.
Additional Information:

Experience in designing and implementing single-table architecture in DynamoDB, optimizing data models for scalability, efficient query patterns, and minimal read/write costs.

Proficiency in using PartiQL to query and manipulate data in DynamoDB, with a focus on optimizing queries for performance and integrating complex business logic.

Experience in developing and optimizing SQL queries for performance.

Proficiency in Python programming for data manipulation, transformation, and scripting tasks.

Familiarity with data warehouse concepts, OLAP, and Big Data technologies.

Experience in integrating third-party APIs to retrieve and ingest data from external systems.

  • AWS Cloud Data Engineer

    4 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:A Senior Data Engineer for Cloud Infrastructure DevelopmentJob Description:As a seasoned Senior Data Engineer, you will design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Key Responsibilities:Develop data processing and transformation workflows using Apache...

  • AWS Data Engineer

    2 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description">We are seeking an experienced Data Engineer with a strong understanding of AWS services to design, develop, test and support data pipelines and applications using Python and PySpark.Proficiency in PL/SQL, T-SQL for data querying, manipulation and database interactions is required.The ideal candidate will lead projects from planning to...

  • Senior AWS Data Specialist

    24 hours ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 16,00,000

    Job Title:AWS Data EngineerWe are seeking a skilled AWS Data Engineer to join our team.Design and implement data architectures for all AWS data services.Develop ETL processes to load data into the data warehouse.Collaborate with stakeholders to identify business needs and requirements for data-related projects.Required Skills:Experience in Athena, Python...

  • Senior AWS Data Engineering Specialist

    1 week ago

    Kannur, Kerala, India beBeeRedshift Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description">We are seeking a highly skilled Senior Redshift Engineer to lead our team in architecting, optimizing and scaling AWS Redshift environments.Lead architecture review and validation for multiple AWS Redshift clustersValidate sizing assumptions and provide right-sizing recommendationsDefine and implement operational excellence best practices...

  • Senior Data Engineer Position

    4 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 22,49,954 - ₹ 29,85,957

    Job Opportunity: We are seeking a highly skilled data engineer to contribute to our organization's success.The ideal candidate will possess extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.They will also have expert-level knowledge of Python and Spark, with a deep...

  • Unlock Career Advancement as a Senior Data Engineer

    7 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Career Advancement as a Senior Data EngineerJob Title: Senior Data Engineer (Lead)We are seeking an experienced Senior Data Engineer to spearhead our data engineering initiatives. With 6+ years of experience in data engineering or cloud computing data development, you will conceptualize, develop, and optimize ETL/ELT data pipelines using Apache Spark,...

  • Senior Azure Data Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Unlock limitless opportunities in data-driven insights and cutting-edge digital solutions as a Senior Azure Data Engineer.A senior role awaits you where you will craft technical solutions to meet complex data requirements, collaborating with stakeholders to drive business growth. Key Responsibilities:Craft scalable data pipelines and ETL processes using...

  • Senior Data Engineer for Transportation Analytics

    6 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,33,44,000 - ₹ 1,65,60,000

    Senior Data Engineer for Transportation AnalyticsWe are seeking a seasoned Data Engineer to join our team and drive the development of cutting-edge software solutions for transportation analytics. As a key member of our engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines, data processing jobs, and...

  • AWS with Java

    3 weeks ago

    Kannur, Kerala, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS with Java Experience: 7-12 YearsNotice Period: Immediate- 15 daysPositions: 10 Demands for Custom ApplicationsAWS with Java1 - Senior-level positionExperience: 7 -12 years4 - Senior Associate positionsExperience: 7-10 yearsOpen...

  • Expert AWS Data Architect

    1 week ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer with AWSAbout the Role:We seek a skilled data engineer to design and implement robust data pipelines using AWS, Python, and SQL. As a key member of our team, you will ensure data integrity, security, and performance in data processing and storage systems.Responsibilities:Design and implement efficient data architectures and pipelines...