Senior Spark Developer
Found in: Adzuna IN C2 - 2 weeks ago
About the job :
Job Description / Duties & Responsibilities :
- Develop, program, and maintain applications using the Apache Spark open-source framework.
- Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.
- Spark Developer must have strong programming skills in Java, Scala, or Python.
- Familiar with big data processing tools and techniques.
- Adhere to the ISMS policies and procedures.
Job Specification/Skills and Competencies :
- Proven experience as a Spark Developer or a related role.
- Strong programming skills in Scala/PySpark/Python.
- Familiarity with big data processing tools and techniques.
- Understanding in :
1. Apache Spark 2. x, Spark 3. x
2. Apache Spark RDD API
3. Apache Spark SQL Data Frame API
4. Apache Spark Streaming API
5. Spark query tuning and performance optimization
6. Database integration - Cassandra, Elasticsearch
- Experience working with HDFS.
- Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus).
- Experience with the Hadoop ecosystem.
- Good understanding of distributed systems.
- Experience with streaming data platforms.
- Excellent analytical and problem-solving skills.
-
Senior Python Developer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Varite Full timeSalary : 12-20 LPA Responsibilities :Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark, and...
-
Application Developer
Found in: Adzuna IN C2 - 5 days ago
Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full timeSummary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python and Apache Spark. Your typical day will involve working with PySpark, performing data analysis and munging to extract insights and patterns from large data sets.Roles &...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Paralleldots Full timeJob Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...
-
Big Data Developer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Risk Resources LLP Full timeResponsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...
-
Senior Data Engineer- Spark/Python
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full timeWe are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...
-
Azure/Data Architect
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Careerpathsindia Full timeJob Description :- 15-18 years of experience in designing, architecting and implementing large scale data processing/data storage/data distribution systems- Extensive experience working with large data sets with hands-on technology skills to design and build robust Data solutions using Spark framework, AWS/Azure/GCP data services and knowledge of Databricks,...
-
Big Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full timeKey Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...
-
Big Data Architect
Found in: Adzuna IN C2 - 1 week ago
Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full timeAbout the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...
-
Data Scientist
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations/Bangalore, IN Codersbrain technology pvt ltd Full timeData Scientist Position Name : Data ScientistExperience Required : 6 - 9 yearsLocation : Pan IndiaNotice Period : Immediate - 15 daysSalary : 15-26 LPA JD's : You will be responsible for developing and implementing data science projects, analyzing large and complex data sets, and driving data-driven decision-making across the organization. The ideal...
-
Spark Engineer
Found in: Adzuna IN C2 - 1 week ago
Bangalore/Onsite In Bangalore, IN Cyber Sphere LLC Full timeJob Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...
-
GCP Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full timeJob Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...
-
Senior Backend Developer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Vidurta Full timeJob Description :In this role, you will play a crucial role in the development and ongoing optimization of our platform, relying on our current technical stack (Vuejs, GraphQL, Apollo, Prisma, Google Cloud Platform, Firebase, and PostgreSQL).Main responsibilities :- Develop and maintain robust and scalable backend systems.- Optimize existing backend features...
-
Senior Database Developer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN TIGI HR Solution Pvt. Ltd. Full timeWe are hiring for Senior Database Developer for our esteemed client an US based company who can join us Immediately.Position : Senior Database Developer. Experience : 7 Years - 10 Years. CTC : Open to discuss. Notice Period : Immediate to 15 Days. Job Location : Remote. Job Time : 2:00 PM - 11:00 PM IST (Client base is Canada). Requirements and Skills :-...
-
Senior Business Intelligence Developer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full timeWe are looking for a highly skilled and experienced Senior Business Intelligence (BI) Developer to join our growing team. You will play a critical role in transforming raw data into actionable insights by designing, developing, and deploying robust BI solutions that empower data-driven decision making across the Bachelor's degree in Computer Science,...
-
Senior Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Kolkata/Pune, IN Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Senior SFCC Frontend Developer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations/Bangalore, IN Marktine Technology Solutions Full timeCompany Description :- Marktine Technology Solutions Pvt Ltd is a decision science organization that helps clients leverage their under-utilized data in making complex business decisions successfully.- Our team comprises Data Enthusiasts (engineers, scientists, visualizers), Business Consultants, and Sales Managers, with a core focus on addressing business...
-
Senior Data Architect
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full timeAbout the Role :We are seeking a highly experienced and visionary Senior Data Architect to join our growing data team. You will be responsible for leading the design, development, and implementation of our enterprise data architecture. You will play a critical role in defining and implementing strategies to ensure our data infrastructure is scalable, secure,...
-
Senior Python Developer
Found in: Adzuna IN C2 - 2 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full timeAbout the job :Company Description :Geektrust is addressing issues in the tech recruitment space by providing a more efficient and transparent process for both candidates and employers.They offer equal opportunity regardless of educational background or entrance exam performance, and strive to make the job search process easier for developers.Role...
-
Senior Delphi Developer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Wovv Technology Full timeSenior DELPHI Developer Experience : Seven years financial or business software development experience including : - Exposure to the project life cycle with good understanding of software development processes; - Strong programming skills in Embardaco DELPHI and Object-oriented Design inclusive of Intraweb - Strong SQL and Stored Procedure Programming...
-
System Developer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN IMPLIFY TECHNOLOGIES INDIA PRIVATE LIMITED Full timeJob Python Development- Machine Learning Experience - (Notebooks, Frameworks like Tensorflow/pytorch and libraries like pandas, numpy, etc.)- Jenkins - used to continually create and test software projects, making it easier for developers and DevOps engineers to integrate changes to the project and for consumers to get a new build.- Docker experience for...