AWS Data Engineer

4 weeks ago


BangaloreAnywhere in IndiaMultiple Locations, IN TalentPulse Consultant Full time

Overview :

- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.

- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.

- This position is essential for leveraging data-driven insights to drive business decisions and enhance our products and services.

Key Responsibilities :

- Designing, building, and maintaining scalable data pipelines and ETL processes in AWS

- Optimizing data models and data architecture for performance and reliability

- Implementing data security and privacy measures in compliance with industry standards and regulations

- Developing and maintaining data infrastructure on AWS, such as Redshift, S3, Glue, and EMR

- Collaborating with data scientists and analysts to support their data needs and analysis

- Monitoring, troubleshooting, and optimizing data workflows to ensure data quality and reliability

- Automating data processes and workflows to improve efficiency

- Implementing best practices for data governance, storage, and access control

- Supporting the integration of new data sources and technologies into the data ecosystem

- Documenting data pipelines, workflows, and processes for knowledge sharing and future reference

- Providing technical leadership and mentorship to junior data engineering team members

- Staying updated with the latest AWS data technologies and best practices

- Collaborating with cross-functional teams to understand and address their data needs

- Participating in on-call support and incident response activities when necessary

- Contributing to the continuous improvement of data engineering processes and standards

Required Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field

- Proven experience in designing, building, and maintaining data solutions in AWS

- Strong proficiency in SQL, ETL processes, and data modeling

- Hands-on experience with AWS services such as Redshift, S3, Glue, EMR, Lambda, and Kinesis

- Proficiency in at least one programming language such as Python, Java, or Scala

- Experience with big data technologies and frameworks such as Hadoop, Spark, or Hive

- Knowledge of data warehousing concepts and best practices

- Experience in implementing data security and compliance measures in AWS

- Excellent problem-solving and troubleshooting skills related to data systems and workflows

- Effective communication and collaboration skills to work across teams and departments

- Ability to work in a fast-paced, dynamic environment and manage multiple priorities

- Experience with version control systems and continuous integration/continuous deployment (CI/CD) pipelines

- Understanding of Agile methodologies and practices

- AWS certifications such as AWS Certified Big Data - Specialty or AWS Certified Solutions Architect

Skills : AWS, data engineering, etl, sql, python, big data, data modeling, data warehousing

(ref:hirist.tech)
  • Aptus Data Labs

    16 hours ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full time

    Responsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...

  • UsefulBI Corporation

    4 weeks ago


    Anywhere in India/Multiple Locations, IN USEFULBI CORPORATION Full time

    Job Description :Minimum 5+ years' Experience in Data Engineering.Must have good knowledge and experience in Python.Mush have good Knowledge of Pyspark or Spark.Mush have good Knowledge of Databricks.Must have good experience in AWS (Glue, EMR)Typically requires relevant analysis work and domain-area work experience.Expert in the management,...


  • Bangalore/Anywhere in India/Multiple Locations, IN RapidBraiins Full time

    Job Title: Database Migration Engineer (AWS). Experience: 5 10 Years. Location: Remote. Position Type: Full-Time. Notice Period: Immediate. Job Description: We are seeking an individual who can provide an "outsider's perspective" to ESG, offering in-depth expertise in AWS database migration and practices. Working closely with our L6 database workstream...

  • Data Engineer

    2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Talent Socio Full time

    Job Description :The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and databases. The Data Engineer will also be responsible for data integration, data modeling, ETL processes, and data analytics.Requirements :- Data Engineering, ETL, Data Warehousing, and Data Modeling skills.- Experience in...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...

  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    Job Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • AWS Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations/Gurgaon/Gurugram, IN Invitas Full time

    Job Position : AWS-Python- PySpark Engineer Job Type : Full-TimeLocation : GurgaonExperience : 5+ YearsMust Have : - Cloud Platforms (AWS), Automation Tools such as (Jenkins or Ansible)- Python and PySpark, EKS or AKS, Amazon EMR, Amazon Athena- AWS Glue, Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Bangalore, IN Mobile Programming LLC Full time

    Job Description :Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...

  • Platform Engineer

    4 weeks ago


    Chennai/Anywhere in India/Multiple Locations, IN Mobile Programming LLC Full time

    Job Description :Job Description : Platform EngineerTitle : Platform Engineer Location : Chennai Work Mode : Hybrid (Remote and Chennai Office) Experience : 6+ years Responsibilities :- Administer systems including configuration, monitoring and maintenance of Application servers;- Able to discern stakeholder needs, effectively communicate development plans,...

  • AWS Data Architect

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Teksands Full time

    Job Details :Must Have Skills/Competencies :- Architecting, designing and developing Data warehouse solutions (in premise and on the cloud)- Assess, capture, and translate complex business issues and requirements into structured analytics use case, including rapid learning of industry/domain/client dynamics and development of effective work-stream plans-...

  • MLOps Engineer

    16 hours ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • AWS/Cloud Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN The Bigcjobs.com Full time

    Job Description :- Cloud DevOps engineer with 4-8 years of experience- Be able to create CI/CD pipelines using Azure DevOps (Pipelines - yaml)- Be able to reverse engineer an existing AWS infrastructure to Terraform and maintain the same.- Be able to migrate pipelines from existing solutions like AWS CodePipeline, GitHub actions etc. to Azure Pipelines...

  • CloudOps Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Bangalore, IN ALP Consulting Full time

    Designation : CloudOps Engineer Location : Bangalore Experience : 1-4 Years Skills : Cloud Operation, AWS/Azure, Kubernetes or Docker, TerraformJob Description :- Develop And Deploy AWS-Cloud Based Multi Server Architecture capable of handling more than 100K concurrent users. - Configure And Deploy Auto Scaling parameters for high performance and cost...


  • Anywhere in India/Multiple Locations, IN RECRUITING AND STAFFING Full time

    Designation : Technical Service Engineer ExpertSkills : AWS cloudLocation : PAN INDIAExperience : 7 to 9 YrsJob description :Must Have Skillset :- Cloud : AWS, Ali Cloud, GCP Source code control GitHub , GIT(exp on Repo Management/Branching CI / CD : Atlantis, Jenkins (designing / multistage / Multi account /Multi Region/ Multi Account/ creating secured...

  • WovV Technologies

    4 days ago


    Anywhere in India/Multiple Locations, IN Wovv Technology Full time

    Job Description : Data Engineer Location : Remote Experience : 5+ years. Durations : 3 months with a very likely extension Mandatory Technology : DBT, SQL, Snowflake,data integration practices, and TableauPrimary Skills : Expertise in transaction refunds and a comprehensive understanding of tax and VAT rule engines will be considered a significant...

  • Intuitive Cloud

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Intuitive.cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • AWS Security Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations/Kolkata, IN Codersbrain technology pvt ltd Full time

    Role : AWS Security Engineer Responsibility :- Design and develop security architectures for cloud and cloud/hybrid-based systems within AWS.- Implement robust security measures and infrastructure to protect sensitive data and systems in the cloud, including encryption, access control, and network security configurations.- Perform vulnerability testing, risk...