5+ YoE - Data Engineer - PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru
4 weeks ago
Candidates ready to join immediately can share their details via email for quick processing. CCTC | ECTC | Notice Period | Location fast for immediate attention ⏳5+ years if Experienc e.Roles and ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).Build data ingestion and transformation frameworks for structured and unstructured data sources.Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.Work with large volumes of data and ensure quality, integrity, and consistency.Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or GCP).Implement data quality checks and automation for ETL/ELT pipelines.Monitor and troubleshoot data issues in production and perform root cause analysis.Document technical processes, system designs, and operational procedures.Must-Have Skills3+ years of experience as a Data Engineer or similar role.Hands-on experience wit h PySpa rk o r Spark using Sca la.Strong knowledge o f S QL for data querying and transformation.Experience working wit h any cloud platfo rm (AWS, Azure, or GCP).Solid understanding of data warehousing concepts and big data architecture.Experience with version control systems like Git.Good-to-Have SkillsExperience with data orchestration tools lik e Apache Airfl ow , Databricks Workflo ws, or similar.Knowledge o f Delta La ke , HD FS, o r Kaf ka.Familiarity with containerization tools (Docker/Kubernetes).Exposure to CI/CD practices and DevOps principles.Understanding of data governance, security, and compliance standards.
-
Bengaluru, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing. CCTC | ECTC | Notice Period | Location Preference nitin.patil@ust.com Act fast for immediate attention! ⏳ 5+ years if Experienc e.Roles and Responsibiliti - esDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala - ).Build...
-
Bengaluru, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing.CCTC | ECTC | Notice Period | Location PreferenceAct fast for immediate attention! ⏳5+ years if Experience.Roles and Responsibiliti- esDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala- ).Build data ingestion and...
-
Big Data Engineer
3 weeks ago
Bengaluru, India Idyllic Services Pvt Ltd Full timeJob Title : Big Data Engineer - ScalaExperience : 7 to 10Years (Minimum 3+ years in Scala)Notice Period : Immediate to 30 DaysRole Overview : We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record...
-
Data Streaming
4 days ago
Bengaluru, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
4 days ago
Bengaluru, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Scala Big Data Lead Engineer
4 weeks ago
Bengaluru, India UST Full timeIf you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to nitin.patil@ust.com Key Responsibilities: - Design, develop, and optimize data pipelines and ETL workflows. - Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline...
-
Scala Big Data Lead Engineer
3 weeks ago
Bengaluru, India UST Full timeIf you are highly interested and available immediately , please submit your resume along with your total experience, current CTC, notice period, and current location details to Key Responsibilities: Design, develop, and optimize data pipelines and ETL workflows . Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data processing....
-
Cloud engineer
6 days ago
Bengaluru, India NAM Info Inc Full timeDearHope you are doing well.We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Send resumes to / Role : Data Engineer with AWS and Snowflake , Medallion ArchitectureLocation : Banashankari, Bengaluru ( All 5 Days...
-
Cloud engineer
5 days ago
Bengaluru, India NAM Info Inc Full timeDearHope you are doing well.We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Send resumes to / Role : Data Engineer with AWS and Snowflake , Medallion ArchitectureLocation : Banashankari, Bengaluru ( All 5 Days...
-
Pyspark Professional
2 weeks ago
Bengaluru, Karnataka, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per yearImmediate Openings onPyspark Experience : 5+ Skill:-Pyspark Location :- Bangalore Notice Period :- Immediate. PysparkExperience in Cloud platform, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, ScalaPerformance Turing Optimize SQL, PySpark for performanceAirflow workflow scheduling tool for...
