Senior Data Engineer- AWS

7 days ago

Pune Maharashtra India, Maharashtra InfoCepts Full time

Key Result Areas and Activities:


  • Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.
  • Develop spark jobs using Scala for new project requirements.
  • Enhance existing spark jobs for any ongoing product enhancement.
  • Performance tuning of spark jobs, stress testing etc.
  • Create new data pipelines for developed/enhanced spark jobs using AWS Lambda or Apache Airflow
  • Responsible for database design process, logical design, physical design, star schema, snowflake schema etc.
  • Analyze data processing, integration, modelling and reporting requirements & Define data loading strategies considering volume, data types, frequency and analytics specifications.
  • Ensure optimal balance between cost and performance.
  • Project documentation, Adheres to Quality guidelines & Schedules.
  • Works hand in hand with PM for successful delivery of project and provide Estimation, scoping, scheduling assistance.
  • Manage build phase and quality assure code to ensure fulfilling requirements and adhering to Cloud architecture. Resolve difficult design and develop issues.



Work and Technical Experience:


Must-Have:

  • Overall, 7-9 years of IT Exp
  • 5+ years of AWS related project
  • Good to have Associate Level and Professional Level AWS Certification
  • In depth knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions
  • Cloud Databases (Must have) – AWS Aurora, Singlestore, RedShift, Snowflake
  • Big Data (Must have) - Hadoop, Hive, Spark, YARN
  • Programming Language (Must have) – Scala, Python, Shell Scripts, PySpark
  • Operating System (Must have) - Any flavor of Linux, Windows
  • Must have very strong SQL Skills
  • Orchestration Tools (Must have): Apache Airflow
  • Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations etc.
  • Should have thorough conceptual understanding of AWS VPC, Subnets, Security Groups, & Route Tables
  • Should be a quick and self-learner and be ready to adapt to new AWS Services or new Big Data Technologies as and when required



Qualifications:


  • Bachelor’s degree in computer science, engineering, or related field (Master’s degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods
  • Minimum 5 years of experience on Cloud related projects


Qualities:

  • Hold strong technical knowledge and experience
  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to consult, write, and present persuasively
  • Able to work in a self-organized and cross-functional team
  • Able to iterate based on new information, peer reviews, and feedback
  • Prior experience of working in a large media company would be added advantage

  • TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Pune

    7 days ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Job Title: AWS Senior Data Engineer with Pyspark, AWS, Glue_PuneLocation: PuneExperience: 6 to 10 YearsNotice Period: 30-45 daysJob Description:Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitKind Regards,Priyankha M

  • AWS Data Engineer

    2 days ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: AWS Data Engineer Company Name: NCSi Job Description: NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with...

  • Aws Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Viraaj HR Solutions Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Industry & Sector:IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients.Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and...

  • AWS Data Engineer Lead

    2 weeks ago

    Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are Hiring: AWS Data Engineer Lead at Coforge Ltd. Job Title:AWS Data Engineer Lead Company:Coforge Ltd. Job Location:Pune Only (Onsite) Experience Required:10 Years Employment Type:Full-Time.Interested candidates can share their updated CV at:WhatsApp: for any queries)Job Description:Coforge Ltd. is seeking a highly experienced and skilledAWS Data...

  • AWS Data Engineer

    2 days ago

    Pune, Maharashtra, India NCS Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: AWS Data EngineerCompany Name: NCSiJob Description:NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with data...

  • Aws Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Velotio Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About Velotio:Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India INTINERI INFOSOL PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: AWS Data Engineer Oil & Gas DomainLocation: Offshore/ REMOTEExperience: 4+ years Employment Type: Full time ContractExperienced AWS Data Engineer with Oil & Gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering and...

  • AWS Data Engineer

    2 days ago

    Pune, Maharashtra, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Company: QAP Software SolutionsPosition: AWS Data EngineerLocation: Pune, India (Onsite)Experience: 5–7 YearsStart Date: Immediate / As early as possibleShift Timing: UK Shift (1 PM – 10 PM IST)Role OverviewWe are seeking an experienced AWS Data Engineer with 5–7 years of relevant experience to join our team on a contract basis. The ideal candidate...

  • AWS Data Engineer

    6 days ago

    Pune, Maharashtra, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: AWS Data EngineerLocation: PuneMode: HybridType: PermanentJob Description:We are seeking a talented and motivated Data Engineer with requisite years of hands-on experience to join our growing data team. The ideal candidate will have experience working with large datasets, building data pipelines, and utilizing AWS public cloud services to support the...