AWS Data Engineer- Sagemaker

2 weeks ago

Bengaluru, Karnataka, India YASH Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Primary skillsets :
AWS services including Glue, Pyspark, SQL, Databricks, Python

Secondary skillset :
Any ETL Tool, Github, DevOPs(CI-CD)

Mandatory Skill Set:

  • Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applications
  • Strong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue, Redshift
  • Strong in developing and maintaining applications using Python and PySpark for data manipulation, transformation, and analysis
  • Design and implement robust ETL pipelines using PySpark, focusing on performance, scalability, and data quality
  • Lead and manage projects, including planning, execution, testing, and documentation and handling customer interacation as key point of contact
  • Translate business requirements into technical solutions using AWS cloud services and Python/PySpark
  • Deep understanding of Python and its data science libraries, along with PySpark for distributed data processing
  • Proficiency in PL/SQL, T-SQL for data querying, manipulation, and database interactions
  • Excellent written and verbal communication skills to collaborate with team members and stakeholders
  • Experience leading and mentoring teams in a technical environment and providing proposals on solutioning and designed based approach
  • 5+ years working experience in data integration and pipeline development.
  • 5+ years of Experience with AWS Cloud on data integration with a mix of Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems Databricks, Redshift experience is a major plus
  • 3+ years of experience using SQL in related development of data warehouse projects/applications (Oracle & amp; SQL Server)
  • Strong real-life experience in python development especially in PySpark in AWS Cloud environment
  • Strong SQL and NoSQL databases like MySQL, Postgres, DynamoDB, Elasticsearch Workflow management tools like Airflow

Good to Have : Snowflake, Palantir Foundry

  • Data & AI Engineer

    2 weeks ago

    Bengaluru, Karnataka, India deployd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Develop parsing and chunking strategies for various types of data sources (Files, APIs, Newsletters, Email Lists, Web pages) and embed documents into vector databases.Manage and maintain vector databases with additional custom metadata.Design and implement RAG, experiment with prompt engineering.Integrate AWS Bedrock and LLM APIs into the system.Monitor and...

  • Data Quality Engineer

    5 days ago

    Bengaluru, Karnataka, India Western Digital Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Role : Data Quality Engineer, Enterprise Data Platform EXP : 10 Years ( Data Quality & Data governance) , AWS , SQL & Python , Cloud, Power BI Location : Bengaluru, India Business Function : Data Analytics Work Location : Bangalore Hallmark Office (IBS)- LOC_WDT_IBSJob Description :About the Role : We are seeking a skilled and...

  • Data Scientist II

    5 days ago

    Bengaluru, Karnataka, India Amazon Web Services (AWS) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India HireWand Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The AWS Data Engineer will design, develop, and maintain scalable data pipelines and architectures using AWS Glue, Amazon Redshift, AWS Lambda, and Amazon S3. This role requires expertise in AWS Kinesis, AWS CloudFormation, Apache Spark, Python, and AWS IAM to ensure secure and efficient data processing. The candidate will leverage AWS Data Pipeline, AWS...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    6+ years of experience in Data Engineering or related role.Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks).Strong expertise in AWS Glue for ETL job development, orchestration, and optimization.Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions,...

  • AWS Architect

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role SummaryAs a AWS Architect, you will lead the design and implementation of scalable, secure, and high-performance data solutions using AWS Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals. Your role will focus on leveraging AWS capabilities to build...

  • AWS Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Note: Virtual Drive on 14th and 15th OctRole OverviewWe are looking for an experienced AWS Engineer with around 5-7 years of hands-on experience in designing, deploying, and managing applications on the AWS cloud platform. The ideal candidate should have strong expertise in AWS services, automation, and cloud security, along with the ability to collaborate...

  • AWS Data Engineer

    3 days ago

    Bengaluru, Karnataka, India eSkillport Management Services Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description Job Title: AWS Data Engineer (IoT/Streaming Data) Location: Chennai or Bangalore. Experience: 3 Years Employment Type: Full-time About the Role We are seeking a highly skilled AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong...

  • Data Engineer with AWS

    2 days ago

    Bengaluru, Karnataka, India Luxoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. - Responsibilities- ?Data Pipeline DevelopmentDesign,...