Data Engineer _ AWS + Python

7 days ago


Bengaluru, Karnataka, India Fractal Full time ₹ 12,00,000 - ₹ 36,00,000 per year

It's fun to work in a company where people truly BELIEVE in what they are doing

We're committed to bringing passion and customer focus to the business.
Data Analytics Engineer- AWS at
Fractal is one of the most prominent players in the Artificial Intelligence space. Fractal's mission is to power every human decision in the enterprise and brings AI, engineering, and design to help the world's most admired Fortune 500 companies.

Fractal has more than 3,000 employees across 16 global locations, including the United States, UK, Ukraine, India, Singapore, and Australia.

Fractal has consistently been rated as India's best companies to work for, by The Great Place to Work Institute, featured as a leader in Customer Analytics Service Providers Wave 2021, Computer Vision Consultancies Wave 2020 & Specialized Insights Service Providers Wave 2020 by Forrester Research, and recognized as an "Honorable Vendor" in 2021 Magic Quadrant for data & analytics by Gartner.

Experience:
3-5 years

Location:
Pan (India)

Responsibilities
As a Data Engineer, you will be responsible implementing complex data pipelines and analytics solutions to support key decision-making business processes in our client's domain.

You will gain exposure to a project that is leveraging cutting edge AWS technology that applies Big Data and Machine Learning to solve new and emerging problems for our clients. You will gain a added advantage of working very closely with AWS Professional Services teams directly executing within AWS Services and Technologies to solve complex and challenging business problems for Enterprises.

Key Responsibilities Include

  • Work closely with Product Owners and AWS Professional Service Architects to understand requirements, formulate solutions, and implement them.
  • Implement scalable data transformation pipelines as per design - Implement Data model and Data Architecture as per laid out design.
  • Evaluate new capabilities of AWS analytics services, develop prototypes, and assist in drawing POVs, participate in design discussions

Requirements

  • Minimum 3 years' experience implementing transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi structured using SQL, NoSQL and data pipelines for real-time, streaming, batch and on-demand workloads
  • At least 2 years implementing solutions using AWS services such as Lambda, AWS Athena and Glue AWS S3, Redshift, Kinesis, Lambda, Apache Spark,
  • Experience working with data warehousing data lakes or Lakehouse concepts on AWS
  • Experience implementing batch processing using AWS Glue/Lake formation, & Data Pipeline
  • Experience in EMR/MSK
  • Experience or Exposure to AWS Dynamo DB will be a plus
  • Develop object-oriented code using Python, besides PySpark, SQL and one other languages (Java or Scala would be preferred)
  • Experience on Streaming technologies both OnPrem/Cloud such as consuming and producing from Kafka, Kinesis
  • Experience building pipelines and orchestration of workflows in an enterprise environment using Apache Airflow/Control M
  • Experience implementing Redshift on AWS or any one of Databricks on AWS, or Snowflake on AWS
  • Good understanding of Dimensional Data Modelling will be a plus.
  • Ability to multi-task and prioritize deadlines as needed to deliver results
  • Ability to work independently or as part of a team
  • Excellent verbal and written communication skills with great attention to detail and accuracy
  • Experience working in an Agile/Scrum environment

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us

Not the right fit? Let us know you're interested in a future opportunity by clicking
Introduce Yourself
in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest


  • AWS Sr Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Data Engineer

    6 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....


  • Bengaluru, Karnataka, India Fractal Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    It's fun to work in a company where people truly BELIEVE in what they are doingWe're committed to bringing passion and customer focus to the business.Job Profile - Senior Engineer Python + AWS cloudExp - 4-7 yrsJob Location – BangaloreWe're looking for a top-notch Software Engineer who always sweats the small stuff and cares aboutimpeccable code. If you...

  • AWS Data Engineer

    1 week ago


    Bengaluru, Karnataka, India HireWand Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The AWS Data Engineer will design, develop, and maintain scalable data pipelines and architectures using AWS Glue, Amazon Redshift, AWS Lambda, and Amazon S3. This role requires expertise in AWS Kinesis, AWS CloudFormation, Apache Spark, Python, and AWS IAM to ensure secure and efficient data processing. The candidate will leverage AWS Data Pipeline, AWS...

  • Data Engineer- AWS

    1 week ago


    Bengaluru, Karnataka, India Rapsys Tech Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    *Min 5 years of experience in data engineering, specifically working with *Apache Airflow and AWS technologies.*AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.*Proficiency in Python, PySpark and SQL*Snowflake Data Lake is reqd.

  • AWS Data Engineer

    15 hours ago


    Bengaluru, Karnataka, India Ubique Systems Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ** NOTICE - Immediate to 10 days MaXX** Exp yrsAWS DATA ENGINEERResponsibility of / Expectations from the Role ::AWS data engineer to build ETL data pipelines (Glue, python based EKS ingestion pipelines) and with DevOps experience to build IaC terraform, CICD gitlab pipelines.Support FTP and ALM modules implementation.Provide hands-on support for the...

  • Aws Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Coforge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience in...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka JRD Systems Full time

    The Role: Sr. Data Engineer (AWS Cloud, Python)We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing...

  • AWS Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Dakrish Solutions Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: AWS Glue Data EngineerLocation: Chennai/Bangalore/HyderabadMode Of Hire: PermanentWork Mode: Work from office / HybridNotice Period: Immediate joiners preferred.No of positions: 3Required Skills:5–10 years of overall data engineering experienceMinimum 3+ years hands-on with AWS Glue and PySparkProficiency in SQL, Python, and AWS data toolsStrong...


  • Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    6+ years of experience in Data Engineering or related role.Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks).Strong expertise in AWS Glue for ETL job development, orchestration, and optimization.Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions,...