Prodapt - Big Data Engineer - Spark/Scala
2 days ago
Big Data Engineer - Spark/Scala
Exp : 7 to 10 years
Location : Chennai
Overview :
We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Apache Spark and Scala.
- Collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs.
- Optimize Spark jobs for performance and cost-efficiency in a distributed computing environment.
- Implement best practices for data modeling, ETL processes, and data governance.
- Monitor and troubleshoot data processing workflows to ensure data integrity and availability.
- Work with cloud platforms (AWS, Azure, or GCP) to implement big data solutions.
- Stay up to date with industry trends and emerging technologies in big data and analytics.
Requirements :
years of experience in Big Data technologies, with a strong focus on Apache Spark and Scala.
- Proficiency in data processing frameworks (Hadoop, Spark) and languages (Scala, Java).
- Experience with data warehousing solutions (Snowflake, Redshift, etc.) and SQL.
- Knowledge of data modeling, ETL processes, and data visualization tools (Tableau, Power BI).
- Familiarity with cloud services (AWS, Azure, Google Cloud) and containerization (Docker, Kubernetes).
- Strong analytical skills and the ability to work with large datasets.
- Excellent communication and teamwork skills.
-
BigData- Spark/Scala
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per yearOverview Big Data, Spark Scala strong Responsibilities Big Data, Spark Scala strong Requirements Big Data, Spark Scala strong
-
BigData- Spark/Scala
35 minutes ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 20,00,000 - ₹ 25,00,000 per yearOverview We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...
-
Scala Lead Engineer
7 days ago
Chennai, Tamil Nadu, India Techominds Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Summary:Skills: Lead Data Eng with Scala, Spark, Pyspark & DatabricksJob Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Location: ChennaiResponsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearResponsible for designing, developing, and optimizing data processing solutions using a combination of Big Data technologies. Focus on building scalable and efficient data pipelines for handling large datasets and enabling batch & real-time data streaming and processing. Responsibilities: Develop Spark applications using Scala or Python (Pyspark) for data...
-
Big Data Engineer
1 week ago
Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDiscover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewResponsible for designing, developing, and optimizing data...
-
Prodapt - Lead Engineer - Python/MLOps
1 day ago
Chennai, Tamil Nadu, India Prodapt Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per yearLead Engineer (Python +ML OPS)Exp : 10 to 15 yearsOverview : Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at...
-
Spark Scala Python
1 week ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India iXceed Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per yearResponsibilities : - Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. - Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. - Optimize Spark applications for performance and cost-efficiency within the...
-
Senior GCP Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 15,00,000 - ₹ 25,00,000 per yearOverviewProdapt is looking for senior data engineers having 3+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL.ResponsibilitiesUnderstanding the requirementsPerforming in-depth analysis on dataSetting up secure data pipelines from ingestion to deliveryIndividual contributorRequirements3- 5 years of experience in Data...
-
Lead Engineer
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 12,00,000 - ₹ 36,00,000 per yearOverviewAs a Lead Data Engineer, you will design, build, and maintain scalable backend and distributed systems that power real-time and data-intensive applications. You will have the autonomy to use your expertise in Java, Scala, or Python—crafting robust microservices, APIs, and integrating event-driven and streaming solutions. This role blends hands-on...