Senior Spark Developer

Found in: Adzuna IN C2 - 2 weeks ago


BangaloreAnywhere in IndiaMultiple Locations, IN CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

About the job :

Job Description / Duties & Responsibilities :

- Develop, program, and maintain applications using the Apache Spark open-source framework.

- Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.

- Spark Developer must have strong programming skills in Java, Scala, or Python.

- Familiar with big data processing tools and techniques.

- Adhere to the ISMS policies and procedures.

Job Specification/Skills and Competencies :

- Proven experience as a Spark Developer or a related role.

- Strong programming skills in Scala/PySpark/Python.

- Familiarity with big data processing tools and techniques.

- Understanding in :

1. Apache Spark 2. x, Spark 3. x

2. Apache Spark RDD API

3. Apache Spark SQL Data Frame API

4. Apache Spark Streaming API

5. Spark query tuning and performance optimization

6. Database integration - Cassandra, Elasticsearch

- Experience working with HDFS.

- Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus).

- Experience with the Hadoop ecosystem.

- Good understanding of distributed systems.

- Experience with streaming data platforms.

- Excellent analytical and problem-solving skills.

(ref:hirist.tech)
  • Senior Python Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN Varite Full time

    Salary : 12-20 LPA Responsibilities :Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark, and...

  • Application Developer

    Found in: Adzuna IN C2 - 5 days ago


    Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python and Apache Spark. Your typical day will involve working with PySpark, performing data analysis and munging to extract insights and patterns from large data sets.Roles &...

  • Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • Big Data Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN Risk Resources LLP Full time

    Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

  • Senior Data Engineer- Spark/Python

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Azure/Data Architect

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN Careerpathsindia Full time

    Job Description :- 15-18 years of experience in designing, architecting and implementing large scale data processing/data storage/data distribution systems- Extensive experience working with large data sets with hands-on technology skills to design and build robust Data solutions using Spark framework, AWS/Azure/GCP data services and knowledge of Databricks,...

  • Big Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full time

    Key Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...

  • Big Data Architect

    Found in: Adzuna IN C2 - 1 week ago


    Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Data Scientist

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations/Bangalore, IN Codersbrain technology pvt ltd Full time

    Data Scientist Position Name : Data ScientistExperience Required : 6 - 9 yearsLocation : Pan IndiaNotice Period : Immediate - 15 daysSalary : 15-26 LPA JD's : You will be responsible for developing and implementing data science projects, analyzing large and complex data sets, and driving data-driven decision-making across the organization. The ideal...

  • Spark Engineer

    Found in: Adzuna IN C2 - 1 week ago


    Bangalore/Onsite In Bangalore, IN Cyber Sphere LLC Full time

    Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

  • GCP Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...

  • Senior Backend Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN Vidurta Full time

    Job Description :In this role, you will play a crucial role in the development and ongoing optimization of our platform, relying on our current technical stack (Vuejs, GraphQL, Apollo, Prisma, Google Cloud Platform, Firebase, and PostgreSQL).Main responsibilities :- Develop and maintain robust and scalable backend systems.- Optimize existing backend features...

  • Senior Database Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN TIGI HR Solution Pvt. Ltd. Full time

    We are hiring for Senior Database Developer for our esteemed client an US based company who can join us Immediately.Position : Senior Database Developer. Experience : 7 Years - 10 Years. CTC : Open to discuss. Notice Period : Immediate to 15 Days. Job Location : Remote. Job Time : 2:00 PM - 11:00 PM IST (Client base is Canada). Requirements and Skills :-...

  • Senior Business Intelligence Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    We are looking for a highly skilled and experienced Senior Business Intelligence (BI) Developer to join our growing team. You will play a critical role in transforming raw data into actionable insights by designing, developing, and deploying robust BI solutions that empower data-driven decision making across the Bachelor's degree in Computer Science,...

  • Senior Data Engineer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior SFCC Frontend Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations/Bangalore, IN Marktine Technology Solutions Full time

    Company Description :- Marktine Technology Solutions Pvt Ltd is a decision science organization that helps clients leverage their under-utilized data in making complex business decisions successfully.- Our team comprises Data Enthusiasts (engineers, scientists, visualizers), Business Consultants, and Sales Managers, with a core focus on addressing business...

  • Senior Data Architect

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    About the Role :We are seeking a highly experienced and visionary Senior Data Architect to join our growing data team. You will be responsible for leading the design, development, and implementation of our enterprise data architecture. You will play a critical role in defining and implementing strategies to ensure our data infrastructure is scalable, secure,...

  • Senior Python Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    About the job :Company Description :Geektrust is addressing issues in the tech recruitment space by providing a more efficient and transparent process for both candidates and employers.They offer equal opportunity regardless of educational background or entrance exam performance, and strive to make the job search process easier for developers.Role...

  • Senior Delphi Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN Wovv Technology Full time

    Senior DELPHI Developer Experience : Seven years financial or business software development experience including : - Exposure to the project life cycle with good understanding of software development processes; - Strong programming skills in Embardaco DELPHI and Object-oriented Design inclusive of Intraweb - Strong SQL and Stored Procedure Programming...

  • System Developer

    Found in: Adzuna IN C2 - 2 weeks ago


    Anywhere in India/Multiple Locations, IN IMPLIFY TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Job Python Development- Machine Learning Experience - (Notebooks, Frameworks like Tensorflow/pytorch and libraries like pandas, numpy, etc.)- Jenkins - used to continually create and test software projects, making it easier for developers and DevOps engineers to integrate changes to the project and for consumers to get a new build.- Docker experience for...