spark developer

2 days ago

Bengaluru, Karnataka, India Coders Brain Technology Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year
JD for Spark developer Experience:3 to 5 Years Work Location: Bangalore     Responsibilities   .   As a Spark developer you will manage the development of scalable distributed Architecture defined by the Architect or tech Lead in our team.   .   Analyse, assemble large data sets to designed for the functional and non-functional requirements.   .   You will develop ETL scripts for big data sources.   .   Identify, design & optimise data processing & automate for reports and dashboards.   .   You will be responsible for workflow optimizations, data optimizations and ETL optimization as per the requirements elucidated by the team.   .   Work with stakeholders such as Product managers, Technical Leads & Service Layer engineers to ensure end-to-end requirements are addressed.   .   Strong team player to adhere to Software Development Life cycle (SDLC) and documentations needed to represent every stage of SDLC.   General Qualifications:   .   BE/BTech/MCA/MTech/MSC with 3-5 years of experience with Apache Spark development or in alternative Data Engineering & analytics frameworks.   .   Overall experience in the field Java/Scala as a Backend developer could be between 3 years.   .   Working experience in Bigdata is important.   Technical Skills   .   Programming experience in Java/Scala is needed. Experience in Python also will have an advantage.   .   Writing ETL Stack in scalable & optimized fashion using Apache Spark/Hadoop/Kafka etc.   .   Should have working experience in writing distributed & optimized Apache Spark jobs for various Machine Learning Algorithms.   .   Experience building and optimizing data pipeline and data sets is essential.   .   Should have worked with Kafka, at least one of No SQL databases (e.g. Cassandra, MongoDB, elastic DB) and at least one of RDBMS (e.g. MySQL)   .   Working experience to use cache such as Redis, Apache Ignite, Hazelcast will advantage.   .   Working knowledge of Docker and Kubernetes will be a plus.  Kindly find the below inputs from customer to get quality profiles  Include the criteria apart from Spark à Experience in No sql databases (elastic search OR Cassandra OR MongoDB), Apache Kafka.  Look for Spark Streaming (people who have used Sqoop, likely doesn't know Spark Streaming).  Scala or Java based work experience using Spark is a MUST. Python usage with Spark is optional, not must.
Spark streaming ,Kafka experience is mandatory for this requirement. Kindly add more profiles with Spark Streaming, Kafka, Nosql experience

  • Spark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Spark Developer• Primary skills:Technology->Big Data - Data Processing->Spark • Knowledge of more than one technology • Basics of Architecture and Design fundamentals • Knowledge of Testing tools • Knowledge of agile methodologies • Understanding of Project life cycle activities on development and maintenance projects • Understanding of one or...

  • Spark-Scala Developer

    2 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Must have 5+ years of IT experienceMust have good experience in Spark and ScalaGood to have experience instreaming systems like Spark streaming and StormExpereicne with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, ScalabilityGood knowledge of Hive,Sqoop,Spark, data warehousing and information management best...

  • Java Spark Developer

    4 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Primary Skill: Spark, Java programmingStrong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streamingHands-on experience in any one of the programming languages (Java, Scala)Good understanding of distributed programming concepts.Experience in optimizing Spark DAG, and Hive queries on TezExperience using tools like Git, Autosys,...

  • Spark & Scala Developer

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    TCS is Hiring For Spark & Scala DeveloperJob Location : BangaloreExperience : 6 - 12 yearsMust have skills :Must have 6+ years of IT experienceMust have good experience in Spark and ScalaGood to have experience instreaming systems like Spark streaming and StormExperience with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance,...

  • Senior Scala/Spark Developer

    3 hours ago

    Bengaluru, Karnataka, India Cyanous Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities : - Design, develop, and maintain data processing applications using Scala and Apache Spark. - Collaborate with cross-functional teams to gather requirements and deliver scalable, efficient solutions. - Implement test-driven development practices to improve reliability and maintainability. - Manage deployment of artifacts from lower...

  • spark scala

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Hi,Greetings from TCS Team!Role Spark Scala DeveloperRequired Technical Skill Set Spark Scala - Coding knowledge expectedDesired Experience Range 6-9 YearsLocation of Requirement TCS - Chennai, Bangalore, Kochi, Pune, BhubaneswarIf you’re interested in the role if the experience, location and skillset match your profile then please share your updated...

  • SPARK/SCALA and Pythin

    2 days ago

    Bengaluru, Karnataka, India Nilasu Consulting Services Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Company Overview:Nilasu Consulting Services Pvt Ltd specializes in the human-resources industry. We partner with organizations to provide comprehensive HR solutions, including recruitment, talent management, and HR consulting. Role and Responsibilities:We are currently seeking a qualified candidate with expertise in Spark/Scala and Python. The successful...

  • Java Spark Lead

    1 week ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Java Spark LeadStrong understanding of distributed computing and big data concepts. Experience with Hadoop ecosystem, Kafka, Hive, and other data tools is a plus. Proficiency in writing optimized Spark jobs and handling large-scale data. Familiarity with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes). Excellent problem-solving,...

  • Spark Architect

    2 weeks ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Spark Architect• Primary skills:Technology->Big Data - Data Processing->Spark • Knowledge of architectural design patterns, performance tuning, database and functional designs • Hands-on experience in Service Oriented Architecture • Ability to lead solution development and delivery for the design solutions • Experience in designing high level and...

  • Spark-Scala Developer

    4 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest...