aws data engineer

3 days ago

Davangere, Karnataka, India AS Technology Corporation Full time

Job Description:

Data Engineer with experience in digital channel activities, data engineering, and cloud technologies, particularly in AWS. This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources, including Terradata, and Hadoop environments. The ideal candidate will possess strong knowledge of AWS, Python, and has work experience in handling data from various sources such as Hadoop , and Terradata, working on large-scale data engineering solutions for data, and knowledge of data processing architecture.

Key Responsibilities:

  • Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such as Hadoop and Terradata.
  • Work on AWS cloud infrastructure (including services like Pyspark ,Glue ,EMR ,lambda, Redshift , Athena, and other services like Iceberg) and orchestration tools like Airflow to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  • Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.
  • Engage in continuous learning and adapting of new technologies and industry best practices to improve data processes.

Skills & Experience Required:

Experience with Data Engineering: Proven experience working as a Data Engineer in greenfield environments (i.e., starting projects from scratch).

  • AWS: Strong hands-on experience with AWS technologies such as Pyspark ,Glue ,EMR ,lambda, Redshift , Athena, EC2 and S3.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies like Hadoop and Terradata.
  • Strong Analytical Skills: Ability to analyse and interpret data from different digital channels.
  • Collaboration: Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
  • Problem Solving: Strong problem-solving skills and ability to handle complex data-related challenges.
  • Communication: Excellent communication skills, both written and verbal, for documentation and collaboration.

Desirable Qualifications:

  • A degree in Computer Science, Engineering, or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.
  • Experience in working on snowflake would be good to have.
  • Knowledge of ingesting real time data ( Apache Kafka ) would be advantage.

  • AWS Data Engineer – Oil

    7 days ago

    Davangere, Karnataka, India DigiHelic Solutions Pvt. Ltd. Full time

    Job Title: AWS Data Engineer – Oil & Gas DomainLocation: Offshore/ REMOTEExperience: 5+ years Experienced AWS Data Engineer with Oil & Gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering and knowledge of Oil & Gas upstream,...

  • Cloud Engineer

    6 days ago

    Davangere, Karnataka, India beBeeAws Full time ₹ 15,00,000 - ₹ 20,20,000

    AWS SRE Engineer PositionWe are seeking an experienced AWS SRE engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable and highly available systems on the AWS cloud platform. Key Responsibilities:Design and implement scalable and highly available systems on the AWS...

  • AWS, Data Architect

    7 hours ago

    Davangere, Karnataka, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS Data ArchitectLocation: BangaloreWork Model: HybridExperience: 5-7 yearsNotice Period: Immediate- 15 daysOpen roles: 24AWS, Data Architect, Java: Key Skills: AWS, Data Architecture, Java, SQL, Data Modeling, ETL/ELTJob...

  • AWS Cloud Data Architect Position

    15 hours ago

    Davangere, Karnataka, India beBeeData Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Job Title: AWS Cloud Data EngineerWe are seeking a skilled AWS cloud data engineer to join our team.AWS services including Glue, Pyspark, SQL, Databricks, PythonAny ETL Tool, Github, DevOPs(CI-CD)Mandatory Skill Set:Python, PySpark , SQL, AWS for designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on...

  • AWS Engineering Lead

    7 days ago

    Davangere, Karnataka, India beBeeCloud Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    AWS Solutions ArchitectJob Summary:The AWS Solutions Architect is responsible for designing, deploying, and maintaining scalable and secure cloud-based solutions using AWS services and GenAI technologies.Key Responsibilities:Design and implement AWS-based product demo environments integrating GenAI pipelines and engineering practices.Architect, provision,...

  • AWS Data Infrastructure Specialist

    3 days ago

    Davangere, Karnataka, India beBeeDataExpert Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a skilled AWS Data Architect to design and implement data architectures using AWS-native services. This is an exciting opportunity for someone who can lead the development of our data infrastructure, ensuring scalability, performance, and cost optimization.Main Responsibilities:Develop end-to-end data architectures utilizing...

  • Senior Big Data Engineer

    2 hours ago

    Davangere, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data Engineer">We are seeking a highly skilled and experienced Senior Big Data Engineer with expertise in designing, architecting, and implementing scalable data engineering solutions using AWS Cloud Services.">Key Responsibilities:">Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex...

  • Data Engineer Leader

    3 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,01,00,000

    Job Title: Data Engineer LeaderWe are seeking a seasoned Senior Data Engineer to join our team.The ideal candidate will have 5+ years of experience in data engineering, with a strong background in Azure and AWS Databricks. Expertise in Python, Scala, Spark, Pyspark, HIVE, HBase, Impala, and Parquet is required.Strong SQL and RDBMS skills, as well as...

  • AWS Data Engineer with Dynamo DB Experience

    47 minutes ago

    Davangere, Karnataka, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data Engineer with Database ExpertiseLocation: Bengaluru, KarnatakaAbout the Company:We are a global organisation targeting various international markets. Our focus is on lifecycle management of end-to-end net-zero transitions while leveraging an automation-first approach. We offer collaborative services and counsel our clients on transition...

  • Senior Data Engineering Expert

    3 days ago

    Davangere, Karnataka, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 2,00,000

    Job Overview:We are seeking a seasoned Senior Data Engineer with deep expertise in AWS Cloud Development to lead the development of new data products and modernization of existing platforms.This individual will design, build, and optimize large-scale data pipelines and architectures in both on-premises environments (e.g., Oracle) and cloud environments...