5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Kochi
1 week ago
CCTC | ECTC | Notice Period | Location Preference
Act fast for immediate attention ⏳
5+ years if Experience
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).
- Build data ingestion and transformation frameworks for structured and unstructured data sources.
- Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.
- Work with large volumes of data and ensure quality, integrity, and consistency.
- Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or GCP).
- Implement data quality checks and automation for ETL/ELT pipelines.
- Monitor and troubleshoot data issues in production and perform root cause analysis.
- Document technical processes, system designs, and operational procedures.
Must-Have Skills
- 3+ years of experience as a Data Engineer or similar role.
- Hands-on experience with PySpark or Spark using Scala.
- Strong knowledge of SQL for data querying and transformation.
- Experience working with any cloud platform (AWS, Azure, or GCP).
- Solid understanding of data warehousing concepts and big data architecture.
- Experience with version control systems like Git.
Good-to-Have Skills
- Experience with data orchestration tools like Apache Airflow, Databricks Workflows, or similar.
- Knowledge of Delta Lake, HDFS, or Kafka.
- Familiarity with containerization tools (Docker/Kubernetes).
- Exposure to CI/CD practices and DevOps principles.
- Understanding of data governance, security, and compliance standards.
.
-
Kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing.CCTC | ECTC | Notice Period | Location fast for immediate attention! ⏳5+ years if ExperienceRoles and ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).Build data ingestion and transformation...
-
Kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing. 📌 CCTC | ECTC | Notice Period | Location Preference nitin.patil@ust.com Act fast for immediate attention! ⏳📩 5+ years if Experience Roles and Responsibilities - Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with...
-
Kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing.📌 CCTC | ECTC | Notice Period | Location Preferencenitin.patil@ust.comAct fast for immediate attention! ⏳📩5+ years if ExperienceRoles and ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).Build data...
-
kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing.📌 CCTC | ECTC | Notice Period | Location Preferencenitin.patil@ust.comAct fast for immediate attention! ⏳📩5+ years if ExperienceRoles and ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).Build data...
-
Kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing.📌 CCTC | ECTC | Notice Period | Location Preferencenitin.patil@ust.comAct fast for immediate attention! ⏳📩5+ years if ExperienceRoles and ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).Build data...
-
kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing. 📌 CCTC | ECTC | Notice Period | Location Preference nitin.patil@ust.com Act fast for immediate attention! ⏳📩5+ years if Experience Roles and Responsibilities Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with...
-
Kochi, India UST Full timeCandidates ready to join immediately can share their details via email for quick processing. CCTC | ECTC | Notice Period | Location Preference Act fast for immediate attention! ⏳ 5+ years if Experience Roles and Responsibilities Design, develop, and maintain scalable data pipelines using Spark (Py Spark or Spark with Scala). Build data...
-
Data Streaming
14 hours ago
Kochi, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
14 hours ago
Kochi, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Azure Databricks
14 hours ago
Kochi, Kerala, India Cognizant Full time**Skill: - Azure Databricks** **Experience: 3 to 14 years** **Location: -**Kochi (Walkin on 1st Feb)** **Must Have Skills** - Hands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. - In-depth knowledge of relational database...
