Spark

6 days ago

Chennai Tamil Nadu, India Cognizant Full time

**Job Summary**

We are seeking a highly skilled Sr. Developer with 5 to 9 years of experience to join our dynamic team. Exposure on ETl flow management (Spark Nifi or any equivalent).Automated deployment scripts creation production pipeline creation

**Responsibilities**
- Develop and optimize data solutions using Data Activator ensuring high performance and reliability.
- Implement and manage Spark Job Definitions to streamline data processing workflows.
- Utilize SQL to design query and manipulate databases effectively.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Ensure data integrity and security by implementing best practices and compliance standards.
- Provide technical support and troubleshooting for data-related issues ensuring mínimal downtime.
- Conduct code reviews and provide constructive feedback to team members to maintain code quality.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Participate in agile development processes including sprint planning daily stand-ups and retrospectives.
- Document data processes workflows and solutions to ensure knowledge sharing and continuity.
- Mentor junior developers providing guidance and support to help them grow their skills.
- Contribute to the overall data strategy of the company aligning with business goals and objectives.
- Communicate effectively with stakeholders presenting technical concepts in a clear and understandable manner.

**Qualifications**
- Possess strong technical expertise in Data Activator demonstrating the ability to develop and optimize data solutions.
- Have extensive experience with Spark Job Definition ensuring efficient data processing workflows.
- Be proficient in SQL with the ability to design query and manipulate databases effectively.
- Experience in Data Management is a plus showcasing the ability to handle and organize large datasets.
- Demonstrate excellent problem-solving skills with the ability to troubleshoot and resolve data-related issues.
- Exhibit strong collaboration skills working effectively with cross-functional teams.
- Show a commitment to continuous learning staying updated with the latest industry trends and technologies.
- Have experience in agile development processes contributing to efficient and effective project delivery.
- Possess strong communication skills with the ability to present technical concepts clearly to stakeholders.
- Be detail-oriented ensuring data integrity and security through best practices and compliance standards.
- Demonstrate leadership qualities mentoring junior developers and providing constructive feedback.
- Have a proactive approach contributing to the overall data strategy and aligning with business goals.
- Show a commitment to documentation ensuring knowledge sharing and continuity within the team.

**Certifications Required**
- Certified Data Management Professional (CDMP) Microsoft Certified: Azure Data Engineer Associate

  • Spark Scala Python

    6 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and...

  • Spark Capital

    3 days ago

    Chennai, India Spark Private Wealth Full time

    Specialist - Legal - Investment Banking - Chennai Drafting and finalization of agreements such as contribution agreement, placement memorandums, that the Fund Group would need to get into as part of their investments and divestments.- Oversee and ensure adherence of Spark Group and counterparties to agreements in Compliance: - Ensure regulatory compliance...

  • Ai Ml

    4 days ago

    Chennai, Tamil Nadu, India Prodapt Full time

    **Overview**: AI ML (GCP/BQ/spark/pyspark ) **Responsibilities**: AI ML (GCP/BQ/spark/pyspark ) **Requirements**: AI ML (GCP/BQ/spark/pyspark )

  • (Apply in 3 Minutes) Spark Developer

    20 hours ago

    Chennai, Tamil Nadu, India Citigroup Full time

    ETL Developer will be responsible for designing implementing and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System HDFS using Apache Spark and Python This role required deep understanding of data engineering principles proficiency in Python and hands-on experience with Spark and Hadoop ecosystems...

  • Spark / Scala Data Engineer

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Role - Spark / Scala Data EngineerExperience - 8 to 10 yrsLocation - Bangalore/Chennai/Hyderabad/Delhi/PuneMust Have- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL- Worked with Code Repositories as GIT, Maven, ...- DevOps Knowledge...

  • Databricks+Spark

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: - Databricks+SparkLocation: - KolkataMust Have SkillsMinimum 6 to 9 years of experienceHands on experience with Azure Databricks, Spark, Azure SQL DW/Synapse, and Azure functions.In-depth knowledge of relational database design, data warehousing and dimensional data modeling conceptsWorking experience with Python, Spark,.

  • spark developer

    5 days ago

    Chennai, India Tata Consultancy Services Full time

    TCS HIRING!!!ROLE: Spark DeveloperJOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, GurgaonEXPERIENCE : 6-8 yearsRequired Technical Skill : Spark , Scala, Pyspark, pythonJob Description:Strong Knowledge on Spark, Scala, Python, PySpark· Strong in SQL concepts· Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume.·...

  • spark developer

    4 days ago

    Chennai, India Tata Consultancy Services Full time

    TCS HIRING!!!ROLE: Spark DeveloperJOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, GurgaonEXPERIENCE : 6-8 yearsRequired Technical Skill : Spark , Scala, Pyspark, pythonJob Description:Strong Knowledge on Spark, Scala, Python, PySpark· Strong in SQL concepts· Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume.·...

  • spark developer

    5 days ago

    chennai, India Tata Consultancy Services Full time

    TCS HIRING!!!ROLE: Spark DeveloperJOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, GurgaonEXPERIENCE : 6-8 yearsRequired Technical Skill : Spark , Scala, Pyspark, pythonJob Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume. ·...

  • spark developer

    5 days ago

    Chennai, India Tata Consultancy Services Full time

    TCS HIRING!!!ROLE: Spark DeveloperJOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, GurgaonEXPERIENCE : 6-8 yearsRequired Technical Skill : Spark , Scala, Pyspark, pythonJob Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume. ·...