aws data engineer

3 weeks ago

Davangere, Karnataka, India AS Technology Corporation Full time

Job Description:

Data Engineer with experience in digital channel activities, data engineering, and cloud technologies, particularly in AWS. This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources, including Terradata, and Hadoop environments. The ideal candidate will possess strong knowledge of AWS, Python, and has work experience in handling data from various sources such as Hadoop , and Terradata, working on large-scale data engineering solutions for data, and knowledge of data processing architecture.

Key Responsibilities:

  • Design, build, and maintain robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such as Hadoop and Terradata.
  • Work on AWS cloud infrastructure (including services like Pyspark ,Glue ,EMR ,lambda, Redshift , Athena, and other services like Iceberg) and orchestration tools like Airflow to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed.
  • Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.
  • Engage in continuous learning and adapting of new technologies and industry best practices to improve data processes.

Skills & Experience Required:

Experience with Data Engineering: Proven experience working as a Data Engineer in greenfield environments (i.e., starting projects from scratch).

  • AWS: Strong hands-on experience with AWS technologies such as Pyspark ,Glue ,EMR ,lambda, Redshift , Athena, EC2 and S3.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies like Hadoop and Terradata.
  • Strong Analytical Skills: Ability to analyse and interpret data from different digital channels.
  • Collaboration: Ability to work closely with cross-functional teams, including business analysts, data scientists, and stakeholders.
  • Problem Solving: Strong problem-solving skills and ability to handle complex data-related challenges.
  • Communication: Excellent communication skills, both written and verbal, for documentation and collaboration.

Desirable Qualifications:

  • A degree in Computer Science, Engineering, or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.
  • Experience in working on snowflake would be good to have.
  • Knowledge of ingesting real time data ( Apache Kafka ) would be advantage.

  • AWS Data Engineer – Oil

    4 weeks ago

    Davangere, Karnataka, India DigiHelic Solutions Pvt. Ltd. Full time

    Job Title: AWS Data Engineer – Oil & Gas DomainLocation: Offshore/ REMOTEExperience: 5+ years Experienced AWS Data Engineer with Oil & Gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering and knowledge of Oil & Gas upstream,...

  • AWS, Data Architect

    3 weeks ago

    Davangere, Karnataka, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS Data ArchitectLocation: BangaloreWork Model: HybridExperience: 5-7 yearsNotice Period: Immediate- 15 daysOpen roles: 24AWS, Data Architect, Java: Key Skills: AWS, Data Architecture, Java, SQL, Data Modeling, ETL/ELTJob...

  • AWS App Support Engineer

    3 weeks ago

    Davangere, Karnataka, India Innova ESI Full time

    Role: AWS App Support Engineer Experience - 7+ years Location - Bangalore/Hyderabad/Gurgaon Notice: Immediate Joiners Only Role Overview: We are seeking a SRE skilled Application Support Engineer with hands-on experience in supporting cloud-hosted applications, particularly on AWS. The ideal candidate will have strong expertise in monitoring tools like...

  • React developer AWS

    3 weeks ago

    Davangere, Karnataka, India Falkondata Full time

    Company DescriptionIf you are a hands-on developer and leader with a strong sense of ambition, eager to make a meaningful impact and advance quickly into a leadership role, we encourage you to continue reading. We are looking for someone who is not only willing to take a proactive, hands-on approach but also capable of driving results rapidly, working...

  • Cloud Engineer

    3 weeks ago

    Davangere, Karnataka, India Coforge Full time

    Job Location:- Hyderabad & NoidaExperience Required: 5 to 8 YearsSkills (Hands on experience required)- Spark, Scala, Big Data (Hadoop), AWS/Azure (+Databricks mandatory/ GCP (+DBT Mandatory), SQLShift- UK ShiftStreaming data Technical skills requirements :-Experience- 5+ Years Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS...

  • Data Engineer

    3 weeks ago

    Davangere, Karnataka, India Impetus Career Consultants Full time

    HIRING FOR A USA BASED MNC -Location - Chennai Experience : 3-10years Data Engineer T3Bachelor's or master's degree with 3+ years of experience in Computer Science, Data Science, Engineering, or a related field.3+ years of experience in working with Python, SQL, PySpark and bash scripts. Proficient in software development lifecycle and software engineering...

  • Big Data Engineer

    4 weeks ago

    Davangere, Karnataka, India Idyllic Services Full time

    Job Title: Big Data Engineer – Scala Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai. Experience: 7–10 Years (Minimum 3+ years in Scala) Notice Period: Immediate to 30 Days Mode of Work: Hybrid Click the link below to learn more about the role and take the AI Interview to begin your application journey: Role Overview We are looking for a...

  • Azure Data Engineer

    3 weeks ago

    Davangere, Karnataka, India LTIMindtree Full time

    About the jobAre you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product experience through best-in-class PIM implementation and building rich, relevant, and trusted product information across channels and digital touchpoints...

  • Data Mining Analyst

    3 weeks ago

    Davangere, Karnataka, India NuvoRetail Full time

    Position: Data Mining Analyst Please Note: Only Candidates with 2-3 years of experience should apply. This is a Delhi-based position and work from office only Work Location: Sector 23 Dwarka, Delhi We are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be...

  • Sr. AI/ML Engineer

    4 weeks ago

    Davangere, Karnataka, India QuiqHire Full time

    A leading US-based AI Data Solutions provider is at the forefront of AI and ML innovation. They develop cutting-edge, cloud-native data solutions that tackle complex challenges and drive the future of intelligent technology. Their Hyderabad office is a core innovation hub, and we're looking for brilliant minds to join our mission.The Opportunity:We are...