Data Engineer AWS/PySpark/Hadoop 5 Years Bengaluru job in
3 days ago
: Data Engineer AWS/PySpark/Hadoop 5 Years Bengaluru
Discipline: Data Engineering
Job type: Permanent
Contact name: Vandana Hatwal
Contact email:
Job ref: 70325
Published: about 11 hours ago
Join a high-growth Center of Excellence as a Data Engineer (AWS) to design, build, and scale data pipelines that power analytics and AI/ML use cases. Youll partner with product, engineering, and analytics teams to improve data accessibility, quality, and governance while supporting enterprise reporting and compliance needs across global clients.
Location: Bengaluru
Your Future Employer: A global leader in strategic data and insight solutions (founded in 2000; 1000 professionals; delivery centers in Mumbai, Kolkata, and Gurgaon) serving Fortune 500 enterprises and high-growth start-ups across technology, eCommerce, healthcare, financial services, media & information, and consulting.
Responsibilities- Design, build, and maintain scalable data pipelines and data models on AWS (S3, EMR) using Spark/PySpark, Hive/Hadoop, and SQL.
- Collaborate with product, analytics, and engineering teams to improve models feeding BI tools and enable data-driven decision-making.
- Implement data quality monitoring, reliability SLAs, and documentation (engineering wiki); write unit/integration tests.
- Troubleshoot complex data issues via deep analysis; define & optimize Spark SQL/Hive SQL jobs to populate models.
- Design robust data integrations and a data quality framework aligned to compliance and reporting needs.
- BS/MS in Computer Science or related field.
- 5 years with Hive, Hadoop, Spark and data warehouse design; strong Python, SQL, PySpark.
- Hands-on with AWS (S3, EMR) or Azure; familiarity with CI/CD, Docker, and automation.
- Experience supporting enterprise reporting and data compliance use cases; strong documentation habits.
- Excellent problem-solving, communication, and collaboration skills; thrive in agile, fast-paced environments.
- Build at scale for global clients across US, Europe, APAC & India.
- Work in an automation-first culture with modern data stacks.
- Cross-functional exposure (product, engineering, analytics).
If you think this role is aligned with your career, kindly email your updated CV to for a confidential discussion on the role.
DisclaimerCrescendo Global specializes in senior to leadership hiring and is committed to a fair, inclusive hiring experience for all applicants regardless of background or identity.
NoteWe receive many applications daily. If you do not hear from us within 1 week, please consider that your profile has not been shortlisted at this time.
Profile KeywordsCrescendo Global, Data Engineer Jobs Bengaluru, AWS Data Engineer, PySpark Jobs, Spark Jobs, Hadoop Jobs, EMR Jobs, S3 Jobs, Big Data Engineer, Data Pipeline Jobs, Data Warehouse Jobs, SQL Python Jobs, CI/CD Data Engineering, Docker Data Engineer.
-
Data Engineer – Hadoop
1 week ago
Bengaluru, Karnataka, India NAZZTEC Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearWe are seeking an experiencedData Engineerwith strong expertise in theHadoop ecosystemandPySpark. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.Key ResponsibilitiesDesign, develop, and optimize data pipelines using Hadoop and PySpark.Work extensively on HDFS, Hive, and...
-
Data Engineer- 1
1 day ago
Bengaluru, Karnataka, India Databricks PySpark Full time ₹ 8,00,000 - ₹ 24,00,000 per yearPosition: Senior Data Engineer We are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems. In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions. You will also contribute to...
-
Pyspark developer
3 days ago
Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...
-
Pyspark Developer
2 weeks ago
Bengaluru, Karnataka, India Infosys Full time ₹ 8,00,000 - ₹ 24,00,000 per yearPyspark developer• Primary skills:Bigdata->Pyspark,Bigdata->Python,Bigdata->Spark,Technology->Functional Programming->Scala • Ability to work with clients to identify business challenges and contribute to client deliverables by refining, analyzing, and structuring relevant data • Awareness of latest technologies and trends • Logical thinking and...
-
Python Pyspark
1 day ago
Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per yearGreetings from Tata Consultancy Services (TCS)Location : Chennai, Bangalore, Pune, DelhiExperience : 5-10 YearsRole: Python Pyspark DeveloperRequired Skill set Python, Pyspark, Scala, SparkMust HaveStrong analytical skills in conducting sophisticated statistical analysis using bureau/vendor data, customer performances.Working experience in languages PySpark...
-
Big Data Engineer
3 days ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 20,00,000 per yearJob Description: Data Engineer (Azure Databricks & PySpark)Position: Data EngineerExperience: 6 to 8 years Primary Skills: Azure Databricks, PySpark, SQL (M)Secondary Skills: ADF (Azure Data Factory) (M)Project Exposure: Cloud migration (M)Location: Bengaluru/HyderabadMode of Work: HybridSalary : 13 lac to 17 lacNotice Period: 15 to 30 Days (M)Databricks...
-
Data Engineer with SQL/ETL/Pyspark
5 days ago
Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...
-
AWS Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Acenet consulting Full time ₹ 6,00,000 - ₹ 18,00,000 per yearExperience: 5 to 8 yearsLocation: Bengaluru, Gurgaon, PuneJob code: 101356Posted on: Oct 27, 2025About Us:AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients...
-
Big Data Engineer
3 weeks ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...