AWS Data Engineer

3 weeks ago


Bangalore, Karnataka, India Changeleaders Full time

Job description :


Responsibilities :


- Provide consultation on appropriate use of AWS for Data Processing


- Lead the design and implementation of new big data systems which would meet or exceed customers business objectives


- Lead prototyping efforts to demonstrate the value of your proposed system


- Define solution / project scope, estimates and delivery team structure


- Design and assist in migration of systems / environments to Microsoft AWS


Qualifications :


Minimum qualifications :


- 6-8 years of hands-on experience on AWS technology: DataBricks, Data Warehouse, Data Lake, Storage.


- Experience in data modeling, ETL development, and Data warehousing


- Experience with Oracle, Redshift, etc.


- Experience with AWS services including S3, Redshift, EMR, and RDS


- Experience with AWS Kinesis, Firehose, SNS, and SQS


- Experience using Linux/UNIX to process large data sets


- Good to have experience in AWS Step Functions, Airflow/Luigi


- Hands-on experience in writing complex, highly-optimized SQL queries across large datasets


- Ability to develop reliable, secure, compliant data processing systems with AWS


- Experience leading data engineering teams (e.g. setting technical direction, mentoring junior engineers, etc.)


- Proficient in stakeholder management.


- Able to articulate the technical problem to a business person


- Bachelor degree in Computer Science.


Preferred Qualifications :


- AWS Certified


- Experience in leading customer workshop sessions to educate customer on best practices

(ref:hirist.tech)
  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Programming.com Full time

    Job Description :This is a full-time on-site role as an AWS Data Engineer located in Bengaluru. The AWS Data Engineer will be responsible for daily tasks including data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. Qualifications :- Data Engineering and Data Modeling skills- Experience with Extract Transform...

  • Aptus Data Labs

    4 weeks ago


    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    3 weeks ago


    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    2 days ago


    Bangalore, Karnataka, India Spectrum Consulting Full time

    Position : Data Infrastructure EngineerCore work that needs accomplished :Architect, design and build Data access solution using various tool sets on Client's AWS and other platforms like DBT, Airflow, Atlan to enable clients data governance goalsThe solution will enable managing access to enterprise data at various layers of clients data solutions and...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India Grizmo Labs Full time

    Responsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Grizmo Labs Full time

    Responsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Winning Edge Full time

    Job Description :- 5+ year's hands-on experience with AWS services, AWS Cloudformation(CFT), CI/CD, AWS CodePipeline, CodeBuild, databases and related technologies.- Understands business requirements and effectively translates business needs and process into technical terms, and vice versa. Coach and guides the junior engineers in code review, technical...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Winning Edge Full time

    Job Description :- 5+ year's hands-on experience with AWS services, AWS Cloudformation(CFT), CI/CD, AWS CodePipeline, CodeBuild, databases and related technologies.- Understands business requirements and effectively translates business needs and process into technical terms, and vice versa. Coach and guides the junior engineers in code review, technical...

  • AI Data Engineer

    2 months ago


    Bangalore, Karnataka, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • AI Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • AWS Data Engineer

    2 days ago


    Bangalore, Karnataka, India Programming.com Full time

    Role : AWS Data EngineerLocation : BengaluruWork Type : HybridJob Description :Key Responsibilities :- Design, build, and maintain scalable data pipelines and infrastructure on AWS.- Implement data solutions using AWS services such as S3, Glue, EMR, and Redshift.- Develop ETL processes using Python, SQL, and PySpark to ingest and process structured and...

  • AWS Data Engineer

    1 month ago


    Bangalore/Hyderabad, Karnataka, India Sureminds Solutions Pvt. Ltd. Full time

    Job Description :Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutionsStrong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWSProficient in Lambda or Kappa ArchitecturesShould be aware of Data Management concepts and Data...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India Sureminds Solutions Pvt. Ltd. Full time

    Job Description :Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutionsStrong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWSProficient in Lambda or Kappa ArchitecturesShould be aware of Data Management concepts and Data...

  • Cloud Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Winning Edge Full time

    Job Description :- 5-8 years hands-on experience with AWS services, AWS Cloudformation(CFT) Templates, CI/CD, AWS CodePipeline, CodeBuild, databases and related technologies.- Strong Hands-on experience in build/deploy of end-to-end project.- Advanced administration experience with AWS PaaS DB offerings such as RDS, Aurora, DynamoDB, and IaaS options i.e....

  • Cloud Data Engineer

    2 months ago


    Bangalore, Karnataka, India Winning Edge Full time

    Job Description :- 5-8 years hands-on experience with AWS services, AWS Cloudformation(CFT) Templates, CI/CD, AWS CodePipeline, CodeBuild, databases and related technologies.- Strong Hands-on experience in build/deploy of end-to-end project.- Advanced administration experience with AWS PaaS DB offerings such as RDS, Aurora, DynamoDB, and IaaS options i.e....

  • Cloud Data Engineer

    6 days ago


    Bangalore, Karnataka, India Winning Edge Full time

    Minimum Position Qualifications:- 5-8 years hands-on experience with AWS services, AWS Cloudformation(CFT) Templates, CI/CD, AWS CodePipeline, CodeBuild, databases and related technologies.- Strong Hands-on experience in build/deploy of end-to-end project.- Advanced administration experience with AWS PaaS DB offerings such as RDS, Aurora, DynamoDB, and IaaS...

  • AWS Data Engineer

    6 days ago


    Bangalore, Karnataka, India HNM Solutions Full time

    Note : Only Immediate : AWS Data EngineerLocation : Bangalore HybridExperience : 4+ :- Independently prototypes/develops data solutions of high complexity to meet the needs of the organization and business customers.- Designs proof-of-concept solutions utilizing an advanced understanding of multiple coding languages to meet technical and business...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Winning Edge Full time

    Job Description :- 4-year (bachelors) degree in computer science, software engineering, data science or similar field- Development experience in workflow platforms such as Airflow, Prefect, Temporal, etc- Experience in Java, Kotlin, Python, SQL, Postgres, Kafka- Experience working with Git, specifically working in a team which adopts modern Git practices-...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Winning Edge Full time

    Job Description :- 4-year (bachelors) degree in computer science, software engineering, data science or similar field- Development experience in workflow platforms such as Airflow, Prefect, Temporal, etc- Experience in Java, Kotlin, Python, SQL, Postgres, Kafka- Experience working with Git, specifically working in a team which adopts modern Git practices-...

  • Inno Protech

    2 months ago


    Bangalore, Karnataka, India Inno Protech Solutions Private Limited Full time

    AWS Data EngineerExperience: 3-6 YearsLocation: Designing, developing, and deploying highly scalable and efficient data pipelines using containerization technologies like Docker/Kubernetes- Leveraging AWS services such as MSK (Managed Streaming Kafka) and S3 (Simple Storage Service) to build real-time data pipelines- Implementing and managing access controls...