
15h Left: Apache Spark Professional
4 weeks ago
Roles and Responsibilities:
Skillset :Apache Spark Designer
Education- BE, MCA, MSc or equivalent( valid degree)
- 8 or more years of professional IT experience, including the majority of the following (specific experiences can be concurrent)
- BFSI domain experience is preferred
- AApache Spark Designer to create and manage large scale data processing solutions
- In this role, Candidate should have a background in data and business analysis
- Should have hands on Apache Spark where you have worked on design, development and deployment on cluster of servers
- Also have data related processing problem-solving aptitude
Responsibilities
- Translate business needs to technical specifications
- Architecting, Design, build and deploy data processing solutions
- Hands on tools to process, stage, store data Conduct recon of data
- Collaborate with teams to integrate systems Develop and execute Spark Queries, database queries and conduct analyses
- Create dataset, RDD, Data Frame for requested projects Develop and update technical documentation
- Sound knowledge about effort estimation methods for data processing solutions requirements
- Proven experience as Apache Spark Designer.
- Hands-on coding experience for Apache Spark designing
- Background in data processing design (e.g. large scale data processing with API based status) and data curation
- In-depth understanding of database management systems, Spark clustering, Spark executor, Driver, real time data processing platform, Java 1.8, and ETL (Extract, transform, load) framework
- Knowledge of SQL queries, Spark Engine and Spark Services, Experience of Spark query tuning and performance optimization
Soft skills
- Proven abilities to take initiative and be innovative
- Analytical mind with a problem-solving aptitude
-
Senior Spark Developer
3 days ago
Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per yearThe Senior Spark Tech Lead will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data....
-
dot net core + Apache solar Professional
3 weeks ago
Mumbai, Maharashtra, India Coders Brain Full timeJob Description- Solid understanding and application knowledge of object-oriented programming and design patterns.- Experience in Apache Solr - installation, configuration, administration, patching, up-gradation and migration.- Prior work experience with Search technologies such as Endeca, Lucidworks, or Solar.
-
Only 24h Left: Data Engineer
3 weeks ago
Mumbai, Maharashtra, India Aryan Solutions Pte Ltd Full timeJob DescriptionMust-Have Skills :- Strong Experience in PySpark- Hands-on expertise in building scalable data pipelines using PySpark.- Proficiency in using Spark SQL, DataFrame, and RDD APIs to implement complex business logic.- Proficient Programming Skills- Solid coding skills in Python (preferred), with strong fundamentals in data structures, algorithms,...
-
Lead Software Engineer 15h Left
3 weeks ago
Mumbai, Maharashtra, India HERE Technologies Full timeJob DescriptionWhat's the roleAs a Lead Engineer (Backend) in the Foundation Engineering team, you will work self-sustained in an agile team. Your responsibilities will cover developing, extending, and maintaining tools and services that process data for HERE's global databases.- Be responsible for providing design and development leadership in delivering...
-
Senior Full Stack Developer
3 weeks ago
Mumbai, Maharashtra, India Burns Mcdonnell Full timeJob DescriptionWe are seeking a Senior Full Stack Developer with 6-9 years of experience and strong cybersecurity expertise. The ideal candidate will be a hands-on expert in building, testing, and securing large-scale web applications, distributed systems, and microservices. This role is for a passionate professional who can leverage big data frameworks,...
-
Data Architecture Specialist
2 weeks ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000Job Title: Data Architecture SpecialistDescriptionWe are seeking a skilled Data Architecture Specialist to join our team. In this role, you will be responsible for designing and developing scalable data pipelines using Apache Spark and Scala.Key ResponsibilitiesDesign and develop efficient data pipelines using Apache Spark and Scala.Optimize and troubleshoot...
-
Cloud Data Engineer
2 weeks ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Cloud Data Solutions ArchitectThe role of Cloud Data Solutions Architect involves overseeing the technical direction of projects, mentoring team members, and delivering scalable and efficient systems using cloud and big data technologies.Lead the design, development, and deployment of cloud-based data processing systems using Java and Apache Spark.Architect...
-
Cloud Computing Data Developer
2 weeks ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Data Engineering RoleAre you a seasoned professional in data engineering looking for a challenging opportunity? Do you have experience in designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark, AWS Glue, and Azure Data Factory?As a data engineer at our company, you will be responsible for working with structured and unstructured data...
-
Data Engineer
2 days ago
Mumbai, Maharashtra, India AXIS DIRECT Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Summary:We are looking for an experienced Data Engineer who is proficient in designing and building data pipelines, data platforms, and data analysis solutions on the AWS ecosystem. The successful candidate will be the single point of contact for all data-related queries and pipeline delivery for the application products.Key Responsibilities:Design,...
-
Chief Big Data Architect
1 week ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 70,000 - US$ 1,20,000Job Description">This role involves designing, executing and managing large distributed data systems. The ideal candidate will have experience in big data technologies (Apache Hadoop) and relational databases (MS SQL Server/Oracle/MySQL/PostgreSQL). Proficiency in at least one of the following programming languages - Java, Python or Scala is required.">Key...