AWS Data Engineer with Dynamo DB Experience

3 weeks ago

bangalore, India Sustainability Economics Full time
Job description
Position Title: AWS Data Engineer with Dynamo DB Experience
Location:
Bengaluru, Karnataka
About the Company:
Sustainability Economics is a global organisation targeting the markets of US, Japan, EU, UK, Canada and Singapore. As a pioneer, our focus is on the Lifecycle Management of E2E Net-Zero transitions while leveraging our automation-first approach. We offer our collaborative services at an international level and counsel our clients on transition solutions and decarbonisation strategies. With our team of professionals who have extensive domain and technical knowledge, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.
Role Summary:
We are seeking a highly skilled and experienced Data Engineer with a minimum of 2+ years of AWS hands-on experience in creating data pipeline to join our dynamic team. The ideal candidate should have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modelling, Python, SQL, and integrating third-party APIs from scratch.
Key Tasks & Accountability:
Design, develop, and implement end-to-end data engineering solutions from ground up on the AWS platform using services such as Glue, EMR, Lambda, and more.
Design and implement scalable DynamoDB databases, optimizing performance and ensuring data consistency, throughput, and storage efficiency.
Collaborate with cross-functional teams and stakeholders to gather data requirements and understand business objectives.
Architect and implement data models and schemas that align with best practices and optimize query performance.
Build robust and scalable data pipelines to extract, transform, and load (ETL) data from diverse sources into target systems.
Integrate third-party APIs to retrieve and ingest data from external systems, ensuring data accuracy and reliability.
Perform data profiling, data cleansing, and data quality checks to ensure accuracy and consistency.
Optimize SQL queries and database performance, leveraging SQL tuning techniques and indexing strategies.
Implement data governance and security measures to protect sensitive data throughout the pipeline.
Develop and maintain documentation for data pipelines, data flows, and data transformations.
Stay up-to-date with industry trends and emerging technologies in data engineering, AWS services, and third-party API integrations.
Mentor junior team members and provide technical guidance and support as needed.
Manage and analyze geospatial data, implementing solutions for storing, retrieving, and processing location-based information while integrating geospatial indexing and query optimization techniques.
Education and Experience:
Domain expertise and qualifications include, but are not limited to:
Bachelor's degree in Computer Science or a related field.
Minimum of 2+ years of experience in data engineering, specifically in building and maintaining data pipelines from scratch
Strong proficiency in AWS services such as Glue, EMR, Lambda, Dynamo DB, Postgres.
Expertise in data modeling, schema design, and relational database concepts.
Solid working knowledge of SQL, SQL tuning, and data modeling best practices.
Skills:
Possess proficient working knowledge of NoSQL databases, emphasizing efficient data modeling, query optimization, and scalable solutions.
Experience in developing and optimizing SQL queries for performance.
Proficiency in Python programming for data manipulation, transformation, and scripting tasks.
Familiarity with data warehouse concepts, OLAP, and Big Data technologies.
Experience in integrating third-party APIs to retrieve and ingest data from external systems.
Personal Attributes:
A team player with good interpersonal skills and problem-solving abilities.
A self-motivator and a collaborative team player.
Excellent time management skills and the ability to assume leadership roles when necessary.
Agile, action oriented and a quick learner.
Out of box thinker.
Benefits at Sustainability Economics:
A flat hierarchy.
ESOPs.
Group Medical Coverage.
30 days of Leave.
A gender-neutral parental, marriage, and compassionate leave policy.
And above all, if you have a passion to work, join us in our pursuit for sustainability
has context menuParagraph

  • AWS/Node.js Developer

    4 weeks ago

    Bangalore/Hyderabad/Chennai/Mumbai/Pune/Kolkata, India Cephas Consultancy Services Private Limited Full time

    Role : AWS(Lambda) Node JS Developer Experience Level : 8-12 years Location : Position Type : Full-time Notice Period : Immediate Job Description : We are seeking an experienced AWS (Lambda) Node.js Developer to join our dynamic team. The ideal candidate will have a strong background in web development, particularly with Node.js, and possess...

  • Big Data Engineer

    2 weeks ago

    bangalore, India Coforge Full time

    Job Description Job description Role and responsibilities : - Experience required- 4 to 10 Years Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for...

  • AWS Data Architect

    2 months ago

    Bangalore,Chennai,Gurgaon,Gurugram,Hyderabad,Pune, India HuQuo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning.  Role and ...

  • Engineer - Java & AWS

    2 weeks ago

    bangalore, India Softpath Technologies LLC Full time

    POSITION: Engineer (Java & AWS) LOCATION: Bangalore, IN (ONSITE) EXPERIENCE: 5 to 8 experience in design and development with Java Must have AWS working experience Solid working experience in Spring Framework (Boot, MVC, Integration, Cloud, etc.) Must have experience with AWS Services like API Gateway, Cloud formation, LAMBDA, Dynamo DB Hands-on experience...

  • Python AWS

    2 weeks ago

    bangalore, India Sonata Software Full time

    Job Title: Full Stack DeveloperDepartment: TechnologyJob Type: Full-time Job Description:We are currently seeking a talented Full Stack Developer with a diverse skill set and experience in various technologies. The ideal candidate should have expertise in Python, AWS Web Services, and a range of AWS components including S3, Kinesis, SQS, SNS, Events,...

  • Cloud Support Engineer

    2 months ago

    bangalore, India AWS India - Delhi Full time

    Amazon Web Services is the global market leader and technology forerunner in the Cloud business. As a member of the AWS Support team in Amazon Web Services Private Limited (AWS India), you will be at the forefront of this transformational technology, assisting a global list of companies and developers that are taking advantage of a growing set of services...

  • Senior Data Engineer

    2 months ago

    Bangalore, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB. Job Description : 1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting...

  • Senior Data Engineer

    1 month ago

    Bangalore, Karnataka, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

  • Big Data Engineer

    1 month ago

    Rajasthan,Karnataka,Metros,Jaipur,Udaipur,Bangalore,Raipur, India ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    1 month ago

    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Azure/aws Architect(iot)

    2 months ago

    bangalore, India Nityo Infotech Full time

    Position: AWS Azure Architect/AWS IOT ArchitectExperience: 10+ YearsJob Location: BangaloreBudget: 36-37 LPA •12 years of experience as a professional software engineer with recent 8 years of relevant experience in Cloud PaaS/SaaS technologies•Hands-on experience IoT related tools and technologies. Azure is preferred. (Options: IoT Central, IoT HUB,...

  • AWS Data Engg Specialist

    2 months ago

    bangalore, India Bosch Full time

    Job Description Mandatory Requirement Overall 8+ years of experience in IT 3+ year experience working on Data Engineering using Databricks, Redshift, Glue, EMR.Atleast 4 Project experience in Building and maintaining ETL / ELT pipelines for large data sets , complex data and feature engineering processesMust Have skills : AWS Glue, Databricks...

  • Data Engineer

    3 days ago

    bangalore, India StoneX Full time

    Overview #LI-SA1 #stoneX #dataengineer #pyspark #azuredatabricks #sql #streamingdata Connecting clients to markets – and talent to opportunity With 4,300 employees and over 400,000 retail and institutional clients from more than 80 offices spread across five continents, we’re a Fortune-100, Nasdaq-listed provider, connecting clients to the...

  • NodeJs & AWS Developer

    2 months ago

    bangalore, India Quinnox Full time

    No of Position – 3 Please send your resume to the following email address along with Job Title as the subject line to & Experience in Designing, Development, Testing and Deploying Node JS & AWS applications. Should have at least 5+ years of Node Js Experience Should have at least 3+ years of AWS Experience Knowledge of and frameworks,...

  • Lead Database Engineer

    2 months ago

    Bangalore, India iMind Your Business Solutions Private Limited Full time

    For a $150Million, Series C funded Fintech company Headquartered in Bangalore, we are looking for an outstanding Database Engineer with deep knowledge and experience with a variety of relational and non-relational database technologies in a highly scalable environment. The ideal candidate should demonstrate superb technical competency in delivering...

  • Lead Database Engineer

    1 month ago

    Bangalore, Karnataka, India iMind Your Business Solutions Private Limited Full time

    For a $150Million, Series C funded Fintech company Headquartered in Bangalore, we are looking for an outstanding Database Engineer with deep knowledge and experience with a variety of relational and non-relational database technologies in a highly scalable environment. The ideal candidate should demonstrate superb technical competency in delivering...

  • AWS Data Engg Specialist

    2 months ago

    bangalore, India Global Pharma Tek Full time

    REQ. - REFN AWS Data Engg Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global...

  • Node.js Developer

    2 months ago

    Bangalore, India Muoro Full time

    Exp 4 to 5.5 yrs1). Experience in Designing, Development, Testing and Deploying Node JS & AWS applications.2). Primary Skill: Node JS, Secondary: AWS3). Should have at least 3+ years of Node Js Experience4). Should have atleast 3+ years of AWS Experience5). Knowledge of Node.js and frameworks, Javascript6). Thorough understanding of relational databases7)....

  • AWS Data Engineer

    1 week ago

    bangalore, India Lilly Full time

    We’re looking for people who are determined to make life better for people around the world. Job Description As a Cloud Data Engineer, you will play a crucial role in designing, implementing, and maintaining our cloud-based data infrastructure. You will collaborate with cross-functional teams to ensure data availability, reliability, and security,...

  • Java/AWS Developer

    1 day ago

    Bangalore, India Selsoft Full time

    Role : Java - Cloud AWS DeveloperExperience : 5 + YearsLocation : Bangalore(Hybrid)Need Immediate JoineeMandatory Skills : - 5 + years of in-depth knowledge in Java 8+, Spring DI, Spring MVC, REST, JMS, Hibernate, JDBC, PL/SQ - 1+ years of experience in serverless architecture and exposure using AWS Lambda/Azure Functions - 1+ years of experience in...