
Data Engineer AWS/PySpark/Hadoop 5 Years Bengaluru job in
4 days ago
: Data Engineer AWS/PySpark/Hadoop 5 Years Bengaluru
Discipline: Data Engineering
Job type: Permanent
Contact name: Vandana Hatwal
Contact email:
Job ref: 70325
Published: about 11 hours ago
Join a high-growth Center of Excellence as a Data Engineer (AWS) to design, build, and scale data pipelines that power analytics and AI/ML use cases. Youll partner with product, engineering, and analytics teams to improve data accessibility, quality, and governance while supporting enterprise reporting and compliance needs across global clients.
Location: Bengaluru
Your Future Employer: A global leader in strategic data and insight solutions (founded in 2000; 1000 professionals; delivery centers in Mumbai, Kolkata, and Gurgaon) serving Fortune 500 enterprises and high-growth start-ups across technology, eCommerce, healthcare, financial services, media & information, and consulting.
Responsibilities- Design, build, and maintain scalable data pipelines and data models on AWS (S3, EMR) using Spark/PySpark, Hive/Hadoop, and SQL.
- Collaborate with product, analytics, and engineering teams to improve models feeding BI tools and enable data-driven decision-making.
- Implement data quality monitoring, reliability SLAs, and documentation (engineering wiki); write unit/integration tests.
- Troubleshoot complex data issues via deep analysis; define & optimize Spark SQL/Hive SQL jobs to populate models.
- Design robust data integrations and a data quality framework aligned to compliance and reporting needs.
- BS/MS in Computer Science or related field.
- 5 years with Hive, Hadoop, Spark and data warehouse design; strong Python, SQL, PySpark.
- Hands-on with AWS (S3, EMR) or Azure; familiarity with CI/CD, Docker, and automation.
- Experience supporting enterprise reporting and data compliance use cases; strong documentation habits.
- Excellent problem-solving, communication, and collaboration skills; thrive in agile, fast-paced environments.
- Build at scale for global clients across US, Europe, APAC & India.
- Work in an automation-first culture with modern data stacks.
- Cross-functional exposure (product, engineering, analytics).
If you think this role is aligned with your career, kindly email your updated CV to for a confidential discussion on the role.
DisclaimerCrescendo Global specializes in senior to leadership hiring and is committed to a fair, inclusive hiring experience for all applicants regardless of background or identity.
NoteWe receive many applications daily. If you do not hear from us within 1 week, please consider that your profile has not been shortlisted at this time.
Profile KeywordsCrescendo Global, Data Engineer Jobs Bengaluru, AWS Data Engineer, PySpark Jobs, Spark Jobs, Hadoop Jobs, EMR Jobs, S3 Jobs, Big Data Engineer, Data Pipeline Jobs, Data Warehouse Jobs, SQL Python Jobs, CI/CD Data Engineering, Docker Data Engineer.
-
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Title: AWS Senior Data Engineer with Pyspark, AWS, GlueLocation: BangaloreExperience: 6 to 10 YearsNotice Period: 30-45 daysJob Description:Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitKind Regards,Priyankha M
-
Pyspark developer
5 days ago
Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...
-
Big Data Engineer
5 days ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Data Engineer with SQL/ETL/Pyspark
6 days ago
Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...
-
Big Data Engineer
3 days ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
AWS Data Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeExperience: 5-10 Yrs Location - Bangalore,Chennai,Hyderabad,Pune,Kochi,Bhubaneshawar,KolkataKey Skills AWS Lambda, Python, Boto3 ,Pyspark, GlueMust have Skills Strong experience in Python to package, deploy and monitor data science apps Knowledge in Python based automation Knowledge of Boto3 and related Python packages Working experience in AWS and AWS...
-
PySpark Developer
2 weeks ago
Bengaluru, Karnataka, India INFOBELL IT SOLUTIONS PVT LTD Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title : PySpark DeveloperLocation : Bangalore (Work from Office)Experience : 5+ YearsNotice Period : Immediate Joiners PreferredAbout Us : Infobell IT is a technology-driven organization specializing in product engineering, AI, cloud modernization, and data analytics. We collaborate with leading global enterprises to deliver scalable and...
-
Big Data Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per yearBig data-Pyspark Developer-HadoopSkillset required: 1. Excellent knowledge of UNIX/LINUX OS. 2. Knowing of core java is a plus but not mandatory. 3. Good understanding of OS concepts, process management and resource scheduling. 4. Basics of networking, CPU, memory and storage. 5. Good hold of shell scripting. 1. Deploying a hadoop cluster, maintaining a...
-
AWS Data Engineer
19 hours ago
Bengaluru, Karnataka, India Acme Services Full time ₹ 10,00,000 - ₹ 18,00,000 per yearWe are urgently hiring for a Data Engineer for a leading MNC in Bangalore. Please find the details below:Job Title: Data EngineerLocation: Bangalore, IndiaExperience: 3–5 YearsEmployment Type: Full-TimeAbout the Role:We are looking for a skilled Data Engineer with 3–5 years of hands-on experience in building and maintaining scalable data pipelines and...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Ushatech solutions Full timeWe’re Hiring: Data Engineer (Core Python, PySpark, Hive, Hadoop) Location: Bangalore (Whitefield) Budget: Max Total CTC – ₹20 LPA Experience Level: 6 – 10 Years (SDE2) Work Mode: Hybrid – 3 Days/Week from Client LocationWe are looking for a skilled Data Engineer to join our team, working on end-to-end data processing, ETL, and big data...