Spark Developer

1 week ago


Delhi, Delhi, India RapidBrains Full time

Job Title:
Spark Developer

Experience Level:
YearsLocation: Bangalore/Hyderabad

Position Type:
Full-timeNotice Period DaysEmployment type: Permanent

Job Summary:
We are seeking a highly skilled Spark Developer to join our dynamic team. The ideal candidate will have extensive experience in developing, deploying, and managing Spark jobs within Kubernetes environments.

You should possess a deep understanding of Spark on Kubernetes, as well as strong expertise in Kubernetes and Docker concepts.


Key Responsibilities:
Develop, deploy, and manage Spark jobs in Kubernetes environments.
Optimize Spark jobs for performance and scalability in Kubernetes clusters.
Implement best practices for Spark on Kubernetes for efficient job execution.
Collaborate with cross-functional teams to integrate Spark jobs with other data processing systems.
Monitor and troubleshoot Spark job performance issues within Kubernetes clusters.
Automate the deployment and scaling of Spark jobs using Kubernetes and Docker.
Maintain and improve existing Spark applications for better efficiency and reliability.
Document processes, configurations, and best practices for Spark jobs in Kubernetes.

Skills & Requirements:
Proficient in developing, deploying, and managing Spark jobs in Kubernetes.
In-depth knowledge of Spark on Kubernetes for job execution.
Strong understanding of Kubernetes architecture and components.
Expertise in Docker, including creating and managing Docker containers.
Familiarity with CI/CD pipelines and tools (e.g., Jenkins, GitLab CI/CD) for automating Spark job deployments.

  • Delhi, Delhi, India Radioactive Technologies Full time

    Spark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesSkills-Scala...


  • Delhi, Delhi, India Radioactive Technologies Full time

    Spark & Scala DeveloperExp- 7-13 yrsShiftMalaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc style documentation with all codeDesign data processing pipelinesSkills Scala (with a focus on the...


  • Delhi, Delhi, India Tavant Full time

    Scala Spark DeveloperFull TimeJob Code: TI-82594 | Tavant Technologies India Private LimitedIndia15 positionsRequired Experience- 15 YearsSkillsscala,spark,Spark streaming+ 3 moreJob Description3+ years of strong development experience in Scala and SparkDesign, develop, test and deploy technical solutionsImplement automated acceptance testsRoles &...


  • Delhi, Delhi, India TD Newton & Associates Full time

    Job Description :Main duties and responsibilities : Delivering on critical business priorities while evolving platform towards its strategic vision Working closely with product managers, end users, and business analysts to understand business objectives and key success measures Partnering with technology teams to design and architect solutions that align to...


  • Delhi, Delhi, India Spark Studio Full time

    Spark Studio is looking for teachers to join us on the journey of nurturing talents and building creativity and confidence in children through courses in Communication Skills, Music and Visual ArtsWe're looking for passionate and committed music facilitators for our Keyboard and Western Vocals courses.About us:Spark Studiois an online learning platform that...


  • Delhi, Delhi, India Tavant Full time

    SQL Python Spark – Data Engineers DeveloperFull TimeJob Code: T-69310 |India12 positionsRequired Experience- 10 YearsSkillsPython,SQL,Spark+ 1 moreJob DescriptionLooking for an expert in SQL, Python, Spark Snowflake is good to haveRoles & ResponsibilitiesLooking for an expert in SQL, Python, Spark Snowflake is good to haveExcellent communication skills...


  • Delhi, Delhi, India Spark Cloud Studio Full time

    Company: Spark Cloud StudioLocation:Remote, IndiaDuration:4-6 monthsHours:Primarily IST hours with occasional Pacific morning hours to sync with the US Engineering team.We are seeking a Software Test Engineering Intern to join our team and contribute to the testing and final integration of our software products. As an intern, you will gain hands-on...

  • Web Developer

    1 week ago


    Delhi, Delhi, India Spark Cloud Full time

    Company DescriptionSparkCloud is a leading provider of Website Development, Digital Marketing, and Web-based business management suite software tools. Our suite includes CRM, e-commerce, billing, accounting, manufacturing, warehouse, project management, and inventory management solutions. We specialize in automating business processes using innovative...

  • Data Architect

    2 months ago


    New Delhi, Delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated experienced Data Architect to join our dynamic team with expertise in Scala, Kafka, Spark, Big Data, and Batch Processing. As a Data Architect, you will play a crucial role in designing, implementing, and maintaining the data architecture that supports our organization's data-driven...


  • Delhi, Delhi, India UBS Full time

    Your roleDo you want to design and build next generation business applications using the latest technologies? Are you self-assured at iteratively refining user requirements and removing any ambiguity? Do you have a curious nature, always interested in how to innovate?We're looking for software engineers to: Design and implement technology solutions that will...


  • Delhi, Delhi, India UBS Full time

    Your roleAre you a multi-tasking programmer and passionate about technology? Do you like to be challenged and encouraged to learn and grow professionally? Do you want to build big data solutions to solve some of the organization's toughest problems and deliver significant business value?We are Looking for a Software Engineer to: engineer reliable data...

  • PySpark Developer

    1 week ago


    Delhi, Delhi, India Corporate Resources Full time

    Job DescriptionHands on experience in MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.2. In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.3. Hands on experience in Scripting languages...

  • Big Data Developer

    1 week ago


    Delhi, Delhi, India krtrimaIQ Cognitive Solutions Full time

    Job SummaryThe primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying integrated business and/or enterprise infrastructure or application solutions...


  • Delhi, Delhi, India Spark Eighteen Lifestyle Private Limited Full time

    Spark Eighteen is a brainchild of innovative minds that strive to build great products. We're a lean team of designers and developers passionate about problem-solving using engineering and design thinking concepts.Over the years, we've extensively worked on B2B SaaS platforms and exciting start-up solutions across the globe. We take pride in our learning and...


  • Delhi, Delhi, India Stealth Full time

    Job Overview:We are seeking a talented Backend Engineer to join our team. As a Backend Engineer, you will contribute to the design, development, and maintenance of robust backend systems that power our applications. The ideal candidate will have a strong educational background in computer science from one of the Tier 1 IITs and 3-5 years of experience in...

  • Big Data Developer

    1 week ago


    Delhi, Delhi, India Truelancer Full time

    About Truelancer Enterprise:Truelancer Enterprise is a premier Gig Talent platform that connects large enterprise clients with highly skilled and vetted software developers. Our network ensures top-tier professionals, providing unmatched expertise to tackle any project. With Truelancer Enterprise, businesses gain access to a pool of exceptional talents,...

  • Big Data Developer

    1 week ago


    Delhi, Delhi, India Truelancer Full time

    About Truelancer Enterprise:Truelancer Enterprise is a premier Gig Talent platform that connects large enterprise clients with highly skilled and vetted software developers. Our network ensures top-tier professionals, providing unmatched expertise to tackle any project. With Truelancer Enterprise, businesses gain access to a pool of exceptional talents,...


  • Delhi, Delhi, India Nurture Spark Digital LLC Full time

    Job DescriptionWe are looking for a competitive and trustworthy Sales Executive to help us enhance our business activities. The ideal candidate will be responsible for discovering and pursuing new sales prospects while maintaining high customer satisfaction. The goal is to meet and surpass the company's expectations to drive rapid and sustainable growth.Key...

  • Streaming Developer

    1 week ago


    Delhi, Delhi, India Consultz Full time

    Job DescriptionThis role is for DataHonDo, based in Singapore.We're seeking a skilled Streaming Developer to join our team and contribute to the development of real-time data processing solutions. If you have a passion for building scalable and efficient streaming applications, we want to hear from youResponsibilities:Design, develop, and maintain real-time...


  • Delhi, Delhi, India ADEREN Full time

    Job DescriptionBUSCAMOS :Scala Senior DeveloperProfesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.Conocimientos & Experiencia Conocimientos sólidos de bash script, spark, scala. Conocimientos Hive. Experiencia en desarrollo de aplicaciones batch/etl en spark, scala. Capacidad para desarrollar...