Java Spark Lead

7 days ago


Bengaluru India Infosys Limited Full time

Job Description Responsibilities : Lead the design and development of scalable data processing solutions using Java and Apache Spark. Collaborate with data architects, analysts, and other stakeholders to understand data requirements. Optimize Spark jobs for performance and scalability in distributed environments. Ensure code quality through code reviews, unit testing, and best practices. Mentor and guide junior developers and contribute to team growth. Work closely with DevOps to deploy and monitor applications in production. Troubleshoot and resolve technical issues across the data pipeline. Stay updated with emerging technologies and propose improvements. Additional Responsibilities: Experience with CI/CD pipelines and version control systems (Git). Knowledge of Scala or Python is a plus. Certifications in Big Data or Cloud technologies. Technical and Professional Requirements: Strong understanding of distributed computing and big data concepts. Experience with Hadoop ecosystem, Kafka, Hive, and other data tools is a plus. Proficiency in writing optimized Spark jobs and handling large-scale data. Familiarity with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes). Excellent problem-solving, communication, and leadership skills.


  • Java Spark Lead

    6 days ago


    Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Java Spark LeadStrong understanding of distributed computing and big data concepts. Experience with Hadoop ecosystem, Kafka, Hive, and other data tools is a plus. Proficiency in writing optimized Spark jobs and handling large-scale data. Familiarity with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes). Excellent problem-solving,...

  • Java Spark Lead

    6 days ago


    Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Lead the design and development of scalable data processing solutions using Java and Apache SparkCollaborate with data architects analysts and other stakeholders to understand data requirementsOptimize Spark jobs for performance and scalability in distributed environmentsEnsure code quality through code reviews unit testing and best...


  • Bengaluru, Karnataka, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Primary Skill: Spark, Java programmingStrong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streamingHands-on experience in any one of the programming languages (Java, Scala)Good understanding of distributed programming concepts.Experience in optimizing Spark DAG, and Hive queries on TezExperience using tools like Git, Autosys,...


  • Bengaluru, India Anicalls (Pty) Ltd Full time

    • 10+ years experience in software development using Core Java and 5 + years experience in technologies (Hadoop, Spark, and Big Data platforms, RBDMS, NoSQL) • Advanced SQL capabilities are required. • Good Knowledge of database design techniques and experience working with huge data volumes is a plus. • Experience in Agile SDLC, JIRA,...

  • Big data engineer

    2 weeks ago


    India Sky Systems, Inc. Full time

    Role: Big Data Engineer Position Type: Full-Time Contract (40hrs/week) Contract Duration: Long Term Work Schedule : 8 hours/day (Mon-Fri) Location : Hybrid - Hyderabad, India (3x days onsite/week) We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize...


  • Bengaluru, Chennai, Pune, India Infosys Full time US$ 90,000 - US$ 1,20,000 per year

    Design, code, test, document and implement application release projects as part of development team.Preferably 4 years of proven project experience working on JAVA 8 and abovePreferably 3 yrs hands-on with Spark 2.0 and above,Should be good with Hadoop, Hive, Oracle/PLSQL and Unix Shell ScriptingShould have knowledge on Spring Boot and Rest APIGood to have...

  • Big Data

    1 week ago


    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...

  • Big Data Engineer

    1 week ago


    India Sky Systems, Inc. (SkySys) Full time

    Role: Big Data Engineer Position Type: Full-Time Contract (40hrs/week) Contract Duration: Long Term Work Schedule : 8 hours/day (Mon-Fri) Location : Hybrid - Hyderabad, India (3x days onsite/week) We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable...


  • Mumbai, India Chase Bank Full time

    Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking Team, youare an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a...

  • Spark Scala

    1 day ago


    Bengaluru, India Techys Digital Full time

    **Experience**:4-8 Years of Exp. **Location -** Bangalore / Pune **(Multiple Positions) | Immediate to 30 days notice joining need to apply** **Description**: - In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params. - Experience in Hadoop development,...