Spark Developer
1 week ago
Job Title:
Spark Developer
Experience Level:
YearsLocation: Bangalore/Hyderabad
Position Type:
Full-timeNotice Period DaysEmployment type: Permanent
Job Summary:
We are seeking a highly skilled Spark Developer to join our dynamic team. The ideal candidate will have extensive experience in developing, deploying, and managing Spark jobs within Kubernetes environments.
You should possess a deep understanding of Spark on Kubernetes, as well as strong expertise in Kubernetes and Docker concepts.
Key Responsibilities:
Develop, deploy, and manage Spark jobs in Kubernetes environments.
Optimize Spark jobs for performance and scalability in Kubernetes clusters.
Implement best practices for Spark on Kubernetes for efficient job execution.
Collaborate with cross-functional teams to integrate Spark jobs with other data processing systems.
Monitor and troubleshoot Spark job performance issues within Kubernetes clusters.
Automate the deployment and scaling of Spark jobs using Kubernetes and Docker.
Maintain and improve existing Spark applications for better efficiency and reliability.
Document processes, configurations, and best practices for Spark jobs in Kubernetes.
Skills & Requirements:
Proficient in developing, deploying, and managing Spark jobs in Kubernetes.
In-depth knowledge of Spark on Kubernetes for job execution.
Strong understanding of Kubernetes architecture and components.
Expertise in Docker, including creating and managing Docker containers.
Familiarity with CI/CD pipelines and tools (e.g., Jenkins, GitLab CI/CD) for automating Spark job deployments.
-
Spark & Scala Developer
1 week ago
Delhi, Delhi, India Radioactive Technologies Full timeSpark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesSkills-Scala...
-
Spark & Scala Developer
1 week ago
Delhi, Delhi, India Radioactive Technologies Full timeSpark & Scala DeveloperExp- 7-13 yrsShiftMalaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc style documentation with all codeDesign data processing pipelinesSkills Scala (with a focus on the...
-
Scala Spark Developer
1 week ago
Delhi, Delhi, India Tavant Full timeScala Spark DeveloperFull TimeJob Code: TI-82594 | Tavant Technologies India Private LimitedIndia15 positionsRequired Experience- 15 YearsSkillsscala,spark,Spark streaming+ 3 moreJob Description3+ years of strong development experience in Scala and SparkDesign, develop, test and deploy technical solutionsImplement automated acceptance testsRoles &...
-
Developer - Spark/Scala
1 week ago
Delhi, Delhi, India TD Newton & Associates Full timeJob Description :Main duties and responsibilities : Delivering on critical business priorities while evolving platform towards its strategic vision Working closely with product managers, end users, and business analysts to understand business objectives and key success measures Partnering with technology teams to design and architect solutions that align to...
-
Freelance Music Teacher
1 week ago
Delhi, Delhi, India Spark Studio Full timeSpark Studio is looking for teachers to join us on the journey of nurturing talents and building creativity and confidence in children through courses in Communication Skills, Music and Visual ArtsWe're looking for passionate and committed music facilitators for our Keyboard and Western Vocals courses.About us:Spark Studiois an online learning platform that...
-
SQL Python Spark – Data Engineers Developer
1 week ago
Delhi, Delhi, India Tavant Full timeSQL Python Spark – Data Engineers DeveloperFull TimeJob Code: T-69310 |India12 positionsRequired Experience- 10 YearsSkillsPython,SQL,Spark+ 1 moreJob DescriptionLooking for an expert in SQL, Python, Spark Snowflake is good to haveRoles & ResponsibilitiesLooking for an expert in SQL, Python, Spark Snowflake is good to haveExcellent communication skills...
-
Software Test Engineer Intern
1 week ago
Delhi, Delhi, India Spark Cloud Studio Full timeCompany: Spark Cloud StudioLocation:Remote, IndiaDuration:4-6 monthsHours:Primarily IST hours with occasional Pacific morning hours to sync with the US Engineering team.We are seeking a Software Test Engineering Intern to join our team and contribute to the testing and final integration of our software products. As an intern, you will gain hands-on...
-
Web Developer
1 week ago
Delhi, Delhi, India Spark Cloud Full timeCompany DescriptionSparkCloud is a leading provider of Website Development, Digital Marketing, and Web-based business management suite software tools. Our suite includes CRM, e-commerce, billing, accounting, manufacturing, warehouse, project management, and inventory management solutions. We specialize in automating business processes using innovative...
-
Data Architect
2 months ago
New Delhi, Delhi, India Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated experienced Data Architect to join our dynamic team with expertise in Scala, Kafka, Spark, Big Data, and Batch Processing. As a Data Architect, you will play a crucial role in designing, implementing, and maintaining the data architecture that supports our organization's data-driven...
-
Senior Azure Spark Scala Developer
1 week ago
Delhi, Delhi, India UBS Full timeYour roleDo you want to design and build next generation business applications using the latest technologies? Are you self-assured at iteratively refining user requirements and removing any ambiguity? Do you have a curious nature, always interested in how to innovate?We're looking for software engineers to: Design and implement technology solutions that will...
-
Data Engineer- Scala/Spark
1 week ago
Delhi, Delhi, India UBS Full timeYour roleAre you a multi-tasking programmer and passionate about technology? Do you like to be challenged and encouraged to learn and grow professionally? Do you want to build big data solutions to solve some of the organization's toughest problems and deliver significant business value?We are Looking for a Software Engineer to: engineer reliable data...
-
PySpark Developer
1 week ago
Delhi, Delhi, India Corporate Resources Full timeJob DescriptionHands on experience in MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.2. In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.3. Hands on experience in Scripting languages...
-
Big Data Developer
1 week ago
Delhi, Delhi, India krtrimaIQ Cognitive Solutions Full timeJob SummaryThe primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying integrated business and/or enterprise infrastructure or application solutions...
-
Talent Acquisition Intern
1 week ago
Delhi, Delhi, India Spark Eighteen Lifestyle Private Limited Full timeSpark Eighteen is a brainchild of innovative minds that strive to build great products. We're a lean team of designers and developers passionate about problem-solving using engineering and design thinking concepts.Over the years, we've extensively worked on B2B SaaS platforms and exciting start-up solutions across the globe. We take pride in our learning and...
-
Back End Developer 28161
1 week ago
Delhi, Delhi, India Stealth Full timeJob Overview:We are seeking a talented Backend Engineer to join our team. As a Backend Engineer, you will contribute to the design, development, and maintenance of robust backend systems that power our applications. The ideal candidate will have a strong educational background in computer science from one of the Tier 1 IITs and 3-5 years of experience in...
-
Big Data Developer
1 week ago
Delhi, Delhi, India Truelancer Full timeAbout Truelancer Enterprise:Truelancer Enterprise is a premier Gig Talent platform that connects large enterprise clients with highly skilled and vetted software developers. Our network ensures top-tier professionals, providing unmatched expertise to tackle any project. With Truelancer Enterprise, businesses gain access to a pool of exceptional talents,...
-
Big Data Developer
1 week ago
Delhi, Delhi, India Truelancer Full timeAbout Truelancer Enterprise:Truelancer Enterprise is a premier Gig Talent platform that connects large enterprise clients with highly skilled and vetted software developers. Our network ensures top-tier professionals, providing unmatched expertise to tackle any project. With Truelancer Enterprise, businesses gain access to a pool of exceptional talents,...
-
Business Development Executive
1 week ago
Delhi, Delhi, India Nurture Spark Digital LLC Full timeJob DescriptionWe are looking for a competitive and trustworthy Sales Executive to help us enhance our business activities. The ideal candidate will be responsible for discovering and pursuing new sales prospects while maintaining high customer satisfaction. The goal is to meet and surpass the company's expectations to drive rapid and sustainable growth.Key...
-
Streaming Developer
1 week ago
Delhi, Delhi, India Consultz Full timeJob DescriptionThis role is for DataHonDo, based in Singapore.We're seeking a skilled Streaming Developer to join our team and contribute to the development of real-time data processing solutions. If you have a passion for building scalable and efficient streaming applications, we want to hear from youResponsibilities:Design, develop, and maintain real-time...
-
Scala Senior Developer
1 week ago
Delhi, Delhi, India ADEREN Full timeJob DescriptionBUSCAMOS :Scala Senior DeveloperProfesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.Conocimientos & Experiencia Conocimientos sólidos de bash script, spark, scala. Conocimientos Hive. Experiencia en desarrollo de aplicaciones batch/etl en spark, scala. Capacidad para desarrollar...