aws data engineer

5 days ago

Bengaluru, Karnataka, India AS Technology Corporation Full time

Job Description:

Data Engineer with experience in digital channel activities, data engineering, and cloud technologies, particularly in AWS . This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources, including Terradata , and Hadoop environments. The ideal candidate will possess strong knowledge of AWS , Python , and has work experience in handling data from various sources such as Hadoop , and Terradata , working on large-scale data engineering solutions for data, and knowledge of data processing architecture.

Key Responsibilities:

  • Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such as Hadoop and Terradata.
  • Work on AWS cloud infrastructure (including services like Pyspark , Glue , EMR ,lambda , Redshift , Athena, and other services like Iceberg ) and orchestration tools like Airflow to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  • Contribute to architecture decisions related to data lakes , data warehouses , and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.
  • Engage in continuous learning and adapting of new technologies and industry best practices to improve data processes.

Skills & Experience Required:

Experience with Data Engineering : Proven experience working as a Data Engineer in greenfield environments (i.e., starting projects from scratch).

  • AWS : Strong hands-on experience with AWS technologies such as Pyspark , Glue , EMR ,lambda , Redshift , Athena, EC2 and S3 .
  • Python : Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms : Experience with big data technologies like Hadoop and Terradata .
  • Strong Analytical Skills : Ability to analyse and interpret data from different digital channels.
  • Collaboration : Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
  • Problem Solving : Strong problem-solving skills and ability to handle complex data-related challenges.
  • Communication : Excellent communication skills, both written and verbal, for documentation and collaboration.

Desirable Qualifications:

  • A degree in Computer Science , Engineering , or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.
  • Experience in working on snowflake would be good to have.
  • Knowledge of ingesting real time data ( Apache Kafka ) would be advantage.

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Acme Services Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services We are hiring AWS Data Engineer Position: AWS Data Engineer Job Location: Bangalore Experience : 10-14 years Interested professionals kindly apply through the link. Must Have: Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...

  • AWS Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems...

  • AWS Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS Data Engineer- Location: Bangalore- Work Model: Hybrid- Experience: 5-7 years- Notice Period: Immediate- 15 days- Open roles: 22Data Engineer:Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data Analyst,...

  • AWS Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data...