BigData- Spark/Scala
2 days ago
Overview:
We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions.
Responsibilities:
Key Responsibilities: -
- Design, develop, and maintain scalable data pipelines using Apache Spark and Scala.
- Collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs.
- Optimize Spark jobs for performance and cost-efficiency in a distributed computing environment.
- Implement best practices for data modeling, ETL processes, and data governance.
- Monitor and troubleshoot data processing workflows to ensure data integrity and availability.
- Work with cloud platforms (AWS, Azure, or GCP) to implement big data solutions.
- Stay up to date with industry trends and emerging technologies in big data and analytics.
Requirements:
- 7-10 years of experience in Big Data technologies, with a strong focus on Apache Spark and Scala.
- Proficiency in data processing frameworks (Hadoop, Spark) and languages (Scala, Java).
- Experience with data warehousing solutions (Snowflake, Redshift, etc.) and SQL.
- Knowledge of data modeling, ETL processes, and data visualization tools (Tableau, Power BI).
- Familiarity with cloud services (AWS, Azure, Google Cloud) and containerization (Docker, Kubernetes).
- Strong analytical skills and the ability to work with large datasets.
- Excellent communication and teamwork skills.
-
BigData- Spark/Scala
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per yearOverview Big Data, Spark Scala strong Responsibilities Big Data, Spark Scala strong Requirements Big Data, Spark Scala strong
-
BigData- Spark/Scala
3 days ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 20,00,000 - ₹ 25,00,000 per yearOverview We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...
-
Spark Scala Python
2 weeks ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...
-
Prodapt - Big Data Engineer - Spark/Scala
4 days ago
Chennai, Tamil Nadu, India Prodapt Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per yearBig Data Engineer - Spark/Scala Exp : 7 to 10 years Location : Chennai Overview : We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with...
-
Pyspark - Machine Learning
2 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year7+ years of experience in Big Data with strong expertise in Spark and ScalaMandatory Skills: Big Data Primarily Spark and ScalaStrong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys,Good to Have : Agile Methodology and Banking ExpertiseStrong Communication SkillsNot limited to Spark batch, need Spark streaming experienceNo SQL DB...
-
Senior Spark/Scala Developer
2 weeks ago
Chennai, Tamil Nadu, India BNP Paribas Full time ₹ 6,00,000 - ₹ 18,00,000 per yearPosition Purpose The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand...
-
Bigdata Engineer
2 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 25,00,000 per yearWe have taken SQL & HIVE from secondary skillset to Primary requirement as per informed by client recently.Job description / Responsibilities -5-7 years of experience in Big Data stacks\: Spark/Scala/Hive/Impala/HadoopStrong Expertise in ScalaThe resource should have good hands-on experience in Scala programming language . Should be able to model the given...
-
BigData Developer
2 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 9,00,000 - ₹ 12,00,000 per yearMust Have :Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scriptingShould be comfortable with Unix File system as well as HDFS commandsShould have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DBShould be flexibleShould have good communication...
-
Scala Lead Engineer
1 week ago
Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...
-
BigData and Hadoop Ecosystems
2 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 20,00,000 - ₹ 25,00,000 per yearOverall Minimum 6+ years of post-college working experience as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing (Added Skill)Minimum 3+ Years of experience Hadoop, Hive SQL's, Spark, Bigdata Eco System Tools.Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.Strong conceptual and creative...