Spark Developer_Quest Global Pvt Ltd

2 weeks ago


Bengaluru, Karnataka, India Coders Brain Technology Full time
Experience:3 to 5    Responsibilities   .   As a Spark developer you will manage the development of scalable distributed Architecture defined by the Architect or tech Lead in our team.   .   Analyse, assemble large data sets to designed for the functional and non-functional requirements.   .   You will develop ETL scripts for big data sources.   .   Identify, design & optimise data processing & automate for reports and dashboards.   .   You will be responsible for workflow optimizations, data optimizations and ETL optimization as per the requirements elucidated by the team.   .   Work with stakeholders such as Product managers, Technical Leads & Service Layer engineers to ensure end-to-end requirements are addressed.   .   Strong team player to adhere to Software Development Life cycle (SDLC) and documentations needed to represent every stage of SDLC.   General Qualifications:   .   BE/BTech/MCA/MTech/MSC with 3-5 years of experience with Apache Spark development or in alternative Data Engineering & analytics frameworks.   .   Overall experience in the field Java/Scala as a Backend developer could be between 3 years.   .   Working experience in Bigdata is important.   Technical Skills   .   Programming experience in Java/Scala is needed. Experience in Python also will have an advantage.   .   Writing ETL Stack in scalable & optimized fashion using Apache Spark/Hadoop/Kafka etc.   .   Should have working experience in writing distributed & optimized Apache Spark jobs for various Machine Learning Algorithms.   .   Experience building and optimizing data pipeline and data sets is essential.   .   Should have worked with Kafka, at least one of No SQL databases (e.g. Cassandra, MongoDB, elastic DB) and at least one of RDBMS (e.g. MySQL)   .   Working experience to use cache such as Redis, Apache Ignite, Hazelcast will advantage.   .   Working knowledge of Docker and Kubernetes will be a plus.  Kindly find the below inputs from customer to get quality profiles  Include the criteria apart from Spark à Experience in No sql databases (elastic search OR Cassandra OR MongoDB), Apache Kafka.  Look for Spark Streaming (people who have used Sqoop, likely doesn't know Spark Streaming).  Scala or Java based work experience using Spark is a MUST. Python usage with Spark is optional, not must.
Spark streaming ,Kafka experience is mandatory for this requirement.
  • Pvt Ltd

    2 weeks ago


    Bengaluru, Karnataka, India Sykatiya Technologies Full time

    Job Title : Design Verification Engineer :Company : Sykatiya Technologies Pvt LtdLocation : Bangalore (Work from Office)Experience : 4 to 15 YearsNotice Period : Immediate to 30 DaysEmployment Type : Full-TimeAbout the Company :Sykatiya Technologies Pvt Ltd is a fast-growing VLSI design and semiconductor services company, delivering high-quality solutions...


  • Bengaluru, Karnataka, India Nilasu Consulting Services Full time

    Job Title: SPARK/SCALA and Python Consultant Company Overview: Nilasu Consulting Services Pvt Ltd is a leading human-resources company in India. We specialize in providing consulting services for industries across various sectors. Role and Responsibilities: 1. Develop and maintain Spark Scala applications with a focus on functional programming. 2. Work on...


  • Bengaluru, Karnataka, India Nilasu Consulting Services Full time

    Company Overview:Nilasu Consulting Services Pvt Ltd specializes in the human-resources industry. We partner with organizations to provide comprehensive HR solutions, including recruitment, talent management, and HR consulting. Role and Responsibilities:We are currently seeking a qualified candidate with expertise in Spark/Scala and Python. The successful...

  • BSOL SYSTEMS PVT LTD

    2 weeks ago


    Bengaluru, Karnataka, India Nexthire Full time

    EXP-2-4YearsLocation-BengaluruRoles and Responsibilites-• Hands-on experience working with Back End and some exposure tofront-end technologies.• Hands-on design and development experience in Java, Spring Boot, Micro services, NodeJS• Familiar with ORM frameworks like JPA, Hibernate, and Spring Data• Experience with building scalable and robust APIs...


  • Bengaluru, Karnataka, India Societe Generale Global Solution Centre Full time

    Societe Generale Global Solution Centre is looking for Software Engineer Spark/Scala to join our team Roles and Responsibility Design, develop, and test software applications using Spark/Scala.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and maintain large-scale data processing systems using...


  • Bengaluru, Karnataka, India Aarna HR Solutions Full time

    Company Description AARNA HR Solutions is Bangalore based Human Resource Recruitment Company providing services to Various MNC IT , ITES and Non- IT companies across India. Aarna HR Solutions strive towards hiring the best and the brightest talent in the industry. We hire individuals with a strong sense of pride in their performance, team spirit, and a...


  • Bengaluru, Karnataka, India Coders Brain Technology Full time

    Design and implement new PCB designs that meet the electrical, EMC, mechanical, thermal and DFA/DFM requirements of the system  Knowledge about library creation  Understanding of datasheet  To Select, specify, qualify and document components necessary to implement design  Cross-functional team player Layout software    Concept HDL  Cadence...


  • Bengaluru, Karnataka, India Coders Brain Technology Full time

    Areas of expertise:   o TR069/SOAP/XML   o OMCI   o Firewall, Device Security (Vulnerabilities) & Hardening, IDS/IPS, Snort   o VoIP/SIP Application Development   o UI/UX Backend management     WebUI/LUA/CGI/JSON/MQTT/HTTP/HTTPS/SSL/TLSIn-depth understanding and experience of working in Linux kernel/drivers, C/C++  Good understanding on...

  • Sales Manager

    1 week ago


    Bengaluru, Karnataka, India Moola Global Pvt Ltd Full time

    Sales Manager – Moola Global Pvt Ltd.Role: Sales ManagerLocation: Bangalore, Karnataka (requires travel to nearby placesChikamagular, Saklespur, Mysore, Hosur, Denikottai, Attibele)Working days: Weekends Working (weekdays off)Salary: 10l to 12l (per annum) + sales incentivesAbout Moola Global Pvt. Ltd.Moola Global Pvt. Ltd. is a multi-domain business group...


  • Bengaluru, Karnataka, India Amazon Full time

    ARIPL's (Amazon Retail India Pvt Ltd) vision is to be India's most trusted grocer and we want to get there by being best in class on attributes we believe customers care the most for- freshness, safety and transparency for produce and perishables; value, selection, and convenience for packaged food. As part of the vision, ARIPL is hiring for a Vendor...