AWS Senior Data Specialist

2 days ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
AWS Senior Data Engineer

Job Overview:

We are seeking a highly skilled AWS Senior Data Engineer to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable data pipelines using AWS services.

Key Responsibilities:

  • Analyze existing technology landscapes to identify opportunities for improvement.
  • Develop efficient Spark jobs using Scala to meet new project requirements.
  • Enhance existing Spark jobs to support ongoing product enhancements.
  • Create data pipelines for developed/enhanced Spark jobs using AWS Lambda or Apache Airflow.
  • Lead database design processes, encompassing logical design, physical design, star schema, and snowflake schema.
  • Analyze data processing, integration, modeling, and reporting requirements to define data loading strategies.
  • Balance cost and performance to ensure optimal results.

Required Skills and Qualifications:

To be successful in this role, you must have:

  • 7-9 years of IT experience.
  • 5+ years of experience with AWS-related projects.
  • Associate Level and Professional Level AWS Certification is a plus.
  • In-depth knowledge of AWS Services, including S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
  • Cloud Databases: AWS Aurora, Singlestore, RedShift, Snowflake.
  • Big Data: Hadoop, Hive, Spark, YARN.
  • Programming Languages: Scala, Python, Shell Scripts, PySpark.
  • Operating Systems: Any flavor of Linux, Windows.
  • Strong SQL Skills.
  • Orchestration Tools: Apache Airflow.
  • Expertise in developing ETL workflows with complex transformations like SCD, deduplications, aggregations.

Preferred Qualifications:

We welcome applicants who possess:

  • Bachelor's degree in Computer Science, Engineering, or related field (Master's degree is a plus).
  • Demonstrated continued learning through technical certifications or related methods.
  • Minimum 5 years of experience with Cloud-related projects.

Essential Qualities:

To thrive in this environment, you should exhibit:

  • Strong technical knowledge and experience.
  • Able to deep dive and research in various technical fields.
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm.
  • Able to communicate persuasively through speaking, writing, and client presentations.
  • Able to work in a self-organized and cross-functional team.
  • Able to iterate based on new information, peer reviews, and feedback.

  • Systems Integration Senior Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Bachelor s degree Computer Science master s degree or Technical Diploma or equivalent At least 5 years of experience in a similar role At least 3 years of experience on AWS and or Azure At least 5 years of experience as Rstudio admin Posit At least 2 years of experience on multiples Azure and AWS PaaS solutions Azure Data Factory MSSQL Azure...

  • AWS Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India beBeeAWS Full time ₹ 12,00,000 - ₹ 15,00,000

    We are seeking a highly skilled Senior AWS Glue Developer to support the data ingestion and transformation process using serverless and AWS services.Data Ingestion and TransformationThis role requires an expert who can leverage AWS Glue to simplify our data pipeline and improve data quality by adopting ELT (Extract Load Transform) from ETL (Extract Transform...

  • Data Specialist

    4 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data SpecialistWe are seeking a highly skilled Senior Data Specialist to join our team. This role will be responsible for designing, developing and maintaining high-performance data pipelines using Apache Kafka and Apache Flink. You will build scalable and automated MLOps pipelines for training, validation and deployment of models using AWS SageMaker...

  • AWS Data

    3 days ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    P3-C3-TSTSAWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, Pyspark, SQL, Databricks, and...

  • Business Analyst I, AWS EMEA

    3 days ago

    Chennai, Tamil Nadu, India Amazon Web Services (AWS) Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    DescriptionAWS Marketing's vision is to inspire and empower our customers and partners to unlock their cloud potential. Our team shapes AWS's industry perception, drives customer growth, and fosters the adoption of AWS services across a global and diverse customer base. Our Marketing strategy continuously adapts to stay ahead of our digital-first world and...

  • AWS Data

    3 days ago

    Chennai, Tamil Nadu, India Virtusa Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Summary:We are looking for a skilled AWS Data Engineer with strong experience in building and managing cloud-based ETL pipelines using AWS Glue, Python/PySpark, and Athena, along with data warehousing expertise in Amazon Redshift. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions in a cloud-native...

  • AWS Data Solutions Specialist

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    AWS Data EngineerJob Summary:We are seeking a highly skilled AWS data engineer to join our team. The ideal candidate will have hands-on experience with AWS data services, a strong background in data engineering, and a passion for delivering high-quality data solutions.This role involves designing, developing, and maintaining scalable and secure data...

  • AWS Data Architecture Specialist

    5 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead AWS Data Engineer We are seeking a skilled professional to lead the design, development, and optimization of data pipelines using AWS Data Analytics services. Key Responsibilities:Design, develop, and optimize data pipelines using RDS, DMS, Glue, Lambda, Redshift, and Athena.Implement data migration and transformation processes using AWS DMS and...

  • AWS Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Coderz Vision Technology® Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data EngineerRequired Experience: 3+ yrsJob SummaryWe are seeking a highly skilled and experienced Data Engineer for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal candidate will have a deep understanding of data analytics technologies, AWS...

  • Senior Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...