AWS Senior Data Engineer

2 weeks ago

Pune, Maharashtra, India InfoCepts Full time

Key Result Areas and Activities:

  • Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.
  • Develop spark jobs using Scala for new project requirements.
  • Enhance existing spark jobs for any ongoing product enhancement.
  • Performance tuning of spark jobs, stress testing etc.
  • Create new data pipelines for developed/enhanced spark jobs using AWS Lambda or Apache Airflow
  • Responsible for database design process, logical design, physical design, star schema, snowflake schema etc.
  • Analyze data processing, integration, modelling and reporting requirements & Define data loading strategies considering volume, data types, frequency and analytics specifications.
  • Ensure optimal balance between cost and performance.
  • Project documentation, Adheres to Quality guidelines & Schedules.
  • Works hand in hand with PM for successful delivery of project and provide Estimation, scoping, scheduling assistance.
  • Manage build phase and quality assure code to ensure fulfilling requirements and adhering to Cloud architecture. Resolve difficult design and develop issues.

Work and Technical Experience:

Must-Have:

  • Overall, 7-9 years of IT Exp
  • 5+ years of AWS related project
  • Good to have Associate Level and Professional Level AWS Certification
  • In depth knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions
  • Cloud Databases (Must have) – AWS Aurora, Singlestore, RedShift, Snowflake
  • Big Data (Must have) - Hadoop, Hive, Spark, YARN
  • Programming Language (Must have) – Scala, Python, Shell Scripts, PySpark
  • Operating System (Must have) - Any flavor of Linux, Windows
  • Must have very strong SQL Skills
  • Orchestration Tools (Must have): Apache Airflow
  • Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations etc.
  • Should have thorough conceptual understanding of AWS VPC, Subnets, Security Groups, & Route Tables
  • Should be a quick and self-learner and be ready to adapt to new AWS Services or new Big Data Technologies as and when required

Qualifications:

  • Bachelor's degree in computer science, engineering, or related field (Master's degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods
  • Minimum 5 years of experience on Cloud related projects

Qualities:

  • Hold strong technical knowledge and experience
  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to consult, write, and present persuasively
  • Able to work in a self-organized and cross-functional team
  • Able to iterate based on new information, peer reviews, and feedback
  • Prior experience of working in a large media company would be added advantage

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Zorba AI Full time

    Job DescriptionSenior AWS Data Engineer (PySpark & Python) On-site, IndiaIndustry & Sector: Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real-time streaming, and analytics integrations for large enterprise customers...

  • AWS Data Engineer

    5 days ago

    Pune, Maharashtra, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Company: QAP Software SolutionsPosition: AWS Data EngineerLocation: Pune, India (Onsite)Experience: 5–7 YearsStart Date: Immediate / As early as possibleShift Timing: UK Shift (1 PM – 10 PM IST)Role OverviewWe are seeking an experienced AWS Data Engineer with 5–7 years of relevant experience to join our team on a contract basis. The ideal candidate...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Senor Developer – AWS Data Engineering

    3 weeks ago

    Pune, Maharashtra, India R Systems Full time

    We are looking for a Senior Developer (4–6 years) in AWS Data Engineering with expertise in AWS Glue, Spark, S3, Redshift, Python, and SQL.This role offers the opportunity to design, build, and optimize large-scale data pipelines on AWS, enabling high-performance analytics and AI-ready data platforms. What You'll Do:- Build & manage data pipelines using...

  • AWS Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Aligned Automation Full time

    About the job :A Better Together philosophy towards building a better worldAligned Automation is a strategic service provider that partners with Fortune 500 leaders to digitize enterprise operations and enable business strategies.We believe we can create positive, lasting change in the way our clients work while advancing the global impact of their business...

  • Senor Developer – AWS Data Engineering

    3 weeks ago

    Pune, Maharashtra, India R Systems Full time

    We are looking for a Senior Developer (4–6 years) in AWS Data Engineering with expertise in AWS Glue, Spark, S3, Redshift, Python, and SQL. This role offers the opportunity to design, build, and optimize large-scale data pipelines on AWS, enabling high-performance analytics and AI-ready data platforms. What You'll Do: Build & manage data pipelines using...

  • Senor Developer – AWS Data Engineering

    3 weeks ago

    Pune, Maharashtra, India R Systems Full time

    We are looking for a Senior Developer (4–6 years) in AWS Data Engineering with expertise in AWS Glue, Spark, S3, Redshift, Python, and SQL.This role offers the opportunity to design, build, and optimize large-scale data pipelines on AWS, enabling high-performance analytics and AI-ready data platforms. What You'll Do:Build & manage data pipelines using...

  • AWS Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Zimetrics Full time

    Build, maintain, and improve our data infrastructure which currently handles billions of advertising events every hour.Design and implement streaming and batch pipelines for data ingestion and delivery.Curate a data warehouse for business and technical stakeholders.Contribute to GumGum's proprietary machine-learning forecasting systems.Develop scripts and...

  • AWS Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Zimetrics Full time

    Build, maintain, and improve our data infrastructure which currently handles billions of advertising events every hour. Design and implement streaming and batch pipelines for data ingestion and delivery. Curate a data warehouse for business and technical stakeholders. Contribute to GumGum's proprietary machine-learning forecasting systems. Develop scripts...

  • AWS Data Engineer

    1 day ago

    Pune, Maharashtra, India Globant Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.The ideal candidate will have a strong background in designing, developing, and managing data pipelines, working with cloud technologies, and optimizing data workflows.Note:We have Face to Face interview process during weekdays in our Magarpatta/Hinjewadi Phase 1 office.Only...