Data Engineer AWS/PySpark/Hadoop 5 Years Bengaluru job in

4 days ago


Bengaluru, Karnataka, India crescendo global Full time ₹ 6,00,000 - ₹ 18,00,000 per year
Job Description

: Data Engineer AWS/PySpark/Hadoop 5 Years Bengaluru

Discipline: Data Engineering
Job type: Permanent
Contact name: Vandana Hatwal
Contact email:
Job ref: 70325
Published: about 11 hours ago

Join a high-growth Center of Excellence as a Data Engineer (AWS) to design, build, and scale data pipelines that power analytics and AI/ML use cases. Youll partner with product, engineering, and analytics teams to improve data accessibility, quality, and governance while supporting enterprise reporting and compliance needs across global clients.

Location: Bengaluru

Your Future Employer: A global leader in strategic data and insight solutions (founded in 2000; 1000 professionals; delivery centers in Mumbai, Kolkata, and Gurgaon) serving Fortune 500 enterprises and high-growth start-ups across technology, eCommerce, healthcare, financial services, media & information, and consulting.

Responsibilities
  • Design, build, and maintain scalable data pipelines and data models on AWS (S3, EMR) using Spark/PySpark, Hive/Hadoop, and SQL.
  • Collaborate with product, analytics, and engineering teams to improve models feeding BI tools and enable data-driven decision-making.
  • Implement data quality monitoring, reliability SLAs, and documentation (engineering wiki); write unit/integration tests.
  • Troubleshoot complex data issues via deep analysis; define & optimize Spark SQL/Hive SQL jobs to populate models.
  • Design robust data integrations and a data quality framework aligned to compliance and reporting needs.
Requirements
  • BS/MS in Computer Science or related field.
  • 5 years with Hive, Hadoop, Spark and data warehouse design; strong Python, SQL, PySpark.
  • Hands-on with AWS (S3, EMR) or Azure; familiarity with CI/CD, Docker, and automation.
  • Experience supporting enterprise reporting and data compliance use cases; strong documentation habits.
  • Excellent problem-solving, communication, and collaboration skills; thrive in agile, fast-paced environments.
What is in it for you
  • Build at scale for global clients across US, Europe, APAC & India.
  • Work in an automation-first culture with modern data stacks.
  • Cross-functional exposure (product, engineering, analytics).
Reach us

If you think this role is aligned with your career, kindly email your updated CV to for a confidential discussion on the role.

Disclaimer

Crescendo Global specializes in senior to leadership hiring and is committed to a fair, inclusive hiring experience for all applicants regardless of background or identity.

Note

We receive many applications daily. If you do not hear from us within 1 week, please consider that your profile has not been shortlisted at this time.

Profile Keywords

Crescendo Global, Data Engineer Jobs Bengaluru, AWS Data Engineer, PySpark Jobs, Spark Jobs, Hadoop Jobs, EMR Jobs, S3 Jobs, Big Data Engineer, Data Pipeline Jobs, Data Warehouse Jobs, SQL Python Jobs, CI/CD Data Engineering, Docker Data Engineer.



  • Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title: AWS Senior Data Engineer with Pyspark, AWS, GlueLocation: BangaloreExperience: 6 to 10 YearsNotice Period: 30-45 daysJob Description:Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitKind Regards,Priyankha M

  • Pyspark developer

    5 days ago


    Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...

  • Big Data Engineer

    5 days ago


    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...


  • Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...

  • Big Data Engineer

    3 days ago


    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Experience: 5-10 Yrs Location - Bangalore,Chennai,Hyderabad,Pune,Kochi,Bhubaneshawar,KolkataKey Skills AWS Lambda, Python, Boto3 ,Pyspark, GlueMust have Skills Strong experience in Python to package, deploy and monitor data science apps Knowledge in Python based automation Knowledge of Boto3 and related Python packages Working experience in AWS and AWS...

  • PySpark Developer

    2 weeks ago


    Bengaluru, Karnataka, India INFOBELL IT SOLUTIONS PVT LTD Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title : PySpark DeveloperLocation : Bangalore (Work from Office)Experience : 5+ YearsNotice Period : Immediate Joiners PreferredAbout Us : Infobell IT is a technology-driven organization specializing in product engineering, AI, cloud modernization, and data analytics. We collaborate with leading global enterprises to deliver scalable and...


  • Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Big data-Pyspark Developer-HadoopSkillset required: 1. Excellent knowledge of UNIX/LINUX OS. 2. Knowing of core java is a plus but not mandatory. 3. Good understanding of OS concepts, process management and resource scheduling. 4. Basics of networking, CPU, memory and storage. 5. Good hold of shell scripting. 1. Deploying a hadoop cluster, maintaining a...

  • AWS Data Engineer

    19 hours ago


    Bengaluru, Karnataka, India Acme Services Full time ₹ 10,00,000 - ₹ 18,00,000 per year

    We are urgently hiring for a Data Engineer for a leading MNC in Bangalore. Please find the details below:Job Title: Data EngineerLocation: Bangalore, IndiaExperience: 3–5 YearsEmployment Type: Full-TimeAbout the Role:We are looking for a skilled Data Engineer with 3–5 years of hands-on experience in building and maintaining scalable data pipelines and...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Ushatech solutions Full time

    We’re Hiring: Data Engineer (Core Python, PySpark, Hive, Hadoop) Location: Bangalore (Whitefield) Budget: Max Total CTC – ₹20 LPA Experience Level: 6 – 10 Years (SDE2) Work Mode: Hybrid – 3 Days/Week from Client LocationWe are looking for a skilled Data Engineer to join our team, working on end-to-end data processing, ETL, and big data...