AWS Data Engineer with Dynamo DB Experience

Position Title:
AWS Data Engineer with Dynamo DB Experience

Location:
Bengaluru, Karnataka

About the Company:

Sustainability is a global organisation targeting the markets of US, Japan, EU, UK, Canada and Singapore. As a pioneer, our focus is on the Lifecycle Management of E2E Net-Zero transitions while leveraging our automation-first approach. We offer our collaborative services at an international level and counsel our clients on transition solutions and decarbonisation strategies. With our team of professionals who have extensive domain and technical knowledge, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary:

We are seeking a highly skilled and experienced Data Engineer with a minimum of 2+ years of AWS hands-on experience in creating data pipeline to join our dynamic team. The ideal candidate should have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modelling, Python, SQL, PartiQL and integrating third-party APIs from scratch.

Key Tasks & Accountability:

• Design, develop, and implement end-to-end data engineering solutions from ground up on the AWS platform using services such as Glue, EMR, Lambda, and more.
• Design and implement scalable DynamoDB databases, optimizing performance and ensuring data consistency, throughput, and storage efficiency.
• Collaborate with cross-functional teams and stakeholders to gather data requirements and understand business objectives.
• Architect and implement data models and schemas that align with best practices and optimize query performance.
• Build robust and scalable data pipelines to extract, transform, and load (ETL) data from diverse sources into target systems.
• Integrate third-party APIs to retrieve and ingest data from external systems, ensuring data accuracy and reliability.
• Perform data profiling, data cleansing, and data quality checks to ensure accuracy and consistency.
• Optimize SQL queries and database performance, leveraging SQL tuning techniques and indexing strategies.
• Implement data governance and security measures to protect sensitive data throughout the pipeline.
• Develop and maintain documentation for data pipelines, data flows, and data transformations.
• Stay up-to-date with industry trends and emerging technologies in data engineering, AWS services, and third-party API integrations.
• Mentor junior team members and provide technical guidance and support as needed.
• Manage and analyze geospatial data, implementing solutions for storing, retrieving, and processing location-based information while integrating geospatial indexing and query optimization techniques.

Education and Experience:

Domain expertise and qualifications include, but are not limited to:

• Bachelor's degree in Computer Science or a related field.
• Minimum of 2+ years of experience in data engineering, specifically in building and maintaining data pipelines from scratch
• Strong proficiency in AWS services such as Glue, EMR, Lambda, Dynamo DB, Postgres.
• Expertise in data modelling, schema design, and relational and non-relational database concepts.
• Solid working knowledge of SQL, SQL tuning, and data modeling best practices.

Skills:

• Experience in designing and implementing single-table architecture in DynamoDB, optimizing data models for scalability, efficient query patterns, and minimal read/write costs.
• Proficiency in using PartiQL to query and manipulate data in DynamoDB, with a focus on optimizing queries for performance and integrating complex business logic.
• Experience in developing and optimizing SQL queries for performance.
• Proficiency in Python programming for data manipulation, transformation, and scripting tasks.
• Familiarity with data warehouse concepts, OLAP, and Big Data technologies.
• Experience in integrating third-party APIs to retrieve and ingest data from external systems.

Personal Attributes:

• A team player with good interpersonal skills and problem-solving abilities.
• A self-motivator and a collaborative team player.
• Excellent time management skills and the ability to assume leadership roles when necessary.
• Agile, action oriented and a quick learner.
• Out of box thinker.

Benefits at Sustainability Economics:

• A flat hierarchy.
• ESOPs.
• Group Medical Coverage.
• 30 days of Leave.
• A gender-neutral parental, marriage, and compassionate leave policy.

And above all, if you have a passion to work, join us in our pursuit for sustainability