BigData- Spark/Scala

2 weeks ago

Chennai, India Jobted IN C2 Full time

Overview: We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions. Responsibilities: Key Responsibilities: - - Design, develop, and maintain scalable data pipelines using Apache Spark and Scala. - Collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs. - Optimize Spark jobs for performance and cost-efficiency in a distributed computing environment. - Implement best practices for data modeling, ETL processes, and data governance. - Monitor and troubleshoot data processing workflows to ensure data integrity and availability. - Work with cloud platforms (AWS, Azure, or GCP) to implement big data solutions. - Stay up to date with industry trends and emerging technologies in big data and analytics. Requirements: - 7-10 years of experience in Big Data technologies, with a strong focus on Apache Spark and Scala. - Proficiency in data processing frameworks (Hadoop, Spark) and languages (Scala, Java). - Experience with data warehousing solutions (Snowflake, Redshift, etc.) and SQL. - Knowledge of data modeling, ETL processes, and data visualization tools (Tableau, Power BI). - Familiarity with cloud services (AWS, Azure, Google Cloud) and containerization (Docker, Kubernetes). - Strong analytical skills and the ability to work with large datasets. - Excellent communication and teamwork skills.

  • Scala Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...

  • BigData- Spark/Scala

    7 days ago

    Chennai, Tamil Nadu, India Prodapt Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Overview Big Data, Spark Scala strong  Responsibilities Big Data, Spark Scala strong  Requirements Big Data, Spark Scala strong 

  • Spark, Scala Developer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India SRS Infoway Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesAt least 5+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 5+ years of experience in designing and developing large scale, distributed data processing...

  • BigData- Spark/Scala

    1 week ago

    Chennai, India Jobted IN C2 Full time

    Overview: Big Data, Spark Scala strong Responsibilities: Big Data, Spark Scala strong Requirements: Big Data, Spark Scala strong

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!!! TCS is looking for Spark Scala Developer Experience: 6-8 years Location: Chennai MUST HAVE SKILLS: - Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow. - Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:- Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.- Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!!! TCS is looking for Spark Scala Developer Experience: 6-8 years Location: Chennai MUST HAVE SKILLS: Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow. Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!!! TCS is looking for Spark Scala Developer Experience: 6-8 years Location: Chennai MUST HAVE SKILLS: Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow. Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and...

  • Bigdata and Hadoop Engineer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India Artech Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: Developer Experience: 4-6 Years Work Location: Chennai, TN || Bangalore, KA || Hyderabad, TSSkill Required: Digital : Bigdata and Hadoop Ecosystems Digital : PySparkJob Description:Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing ? Work on Hadoop, Hive SQL?s, Spark, Bigdata Eco System Tools.? Experience...