Big Data Consultant
3 weeks ago
Summary :
We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team.
You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles.
Additionally, your experience in Python and microservices architecture will be valuable in building scalable and robust big data solutions.
Responsibilities :
- Design, develop, and maintain Spark Scala applications for big data processing tasks, emphasizing functional programming paradigms.
- Develop and implement Scala microservices and APIs for efficient data access and integration.
- Leverage your expertise in big data technologies like Hadoop, Spark, and Hive to build and manage data pipelines.
- Collaborate with data engineers, scientists, and analysts to understand data requirements and translate them into effective big data solutions.
- Participate in code reviews and ensure adherence to coding best practices and maintainability standards.
- Stay up-to-date with the latest advancements in big data technologies and frameworks.
Qualifications :
- Bachelor's degree in Computer Science or a related field.
- Minimum of 4 years of experience in Spark Scala programming.
- Proficiency in Python programming with experience in data analysis libraries (e.g., NumPy, Pandas).
- Strong understanding of big data concepts, data processing paradigms, and distributed computing frameworks.
- Familiarity with Apache Hadoop ecosystem tools like YARN, HDFS, and MapReduce (preferred).
- Experience with Apache Hive for data warehousing and querying (preferred).
- Experience with microservices architecture and API development (preferred).
- Solid understanding of functional programming principles.
- Excellent problem-solving and analytical skills.
- Effective communication and collaboration skills.
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Indium Software Full timeJob Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Indium Software Full timeJob Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...
-
Technical Lead
4 days ago
Bangalore, Karnataka, India Strategic HR Solutions Full timeJob DescriptionAs a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to the Engineering manager. Responsibilities: - Align our client with key Client initiatives -...
-
Unison Consulting
2 months ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeAbout the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....
-
Unison Consulting
3 weeks ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeAbout the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....
-
Technical Lead
4 days ago
Bangalore, Karnataka, India Suitable.AI Full timeJob Description :As a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to the Engineering manager. Responsibilities : Align Sigmoid with key Client initiatives ...
-
Technical Lead
4 days ago
Bangalore, Karnataka, India Suitable.AI Full timeJob DescriptionAs a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to the Engineering manager. Responsibilities : Align with key Client initiatives :- Interface...
-
Data Engineer
4 days ago
Bangalore/Hyderabad, Karnataka, India Pan Asia Man power Consultants Recruiting agency Full timeData EngineerExperience Range : 6 to 14 YearsLocation : Bangalore (Hybrid: Work From Office - 3 Days in a Week)Full Time Skill Sets :- Experience designing and implementing data pipelines- Experience with SQL, RDBMS, or other data management, reporting and query tools.- Big Data Technologies - Hadoop, Hive, Spark, KafkaSecondary Skill Sets :- Added advantage...
-
Unison Consulting
2 months ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeWe are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...
-
Unison Consulting
3 weeks ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeWe are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...
-
Big Data Engineer
4 days ago
Bangalore, Karnataka, India WEN Full timeRole : Big Data Engineer (Scala)Responsibilities :- Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem- Utilize Scala programming language to implement efficient data processing solutions- Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions- Implement best practices...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Big Data Engineer
2 months ago
Bangalore, Karnataka, India randstad Full timePrimary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...
-
Big Data Engineer
3 weeks ago
Bangalore, Karnataka, India Randstad Full timePrimary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...
-
Data Warehousing Engineer
2 weeks ago
Bangalore, Karnataka, India Marktine Technology Solutions Full timeMust Have Skills :- Solid Knowledge on DWH, ETL and Big Data Concepts- Excellent SQL Skills (With knowledge of SQL Analytics Functions)- Working Experience on any ETL tool i.e. SSIS / Informatica- Working Experience on any Azure or AWS Big Data Tools.- Experience on Implementing Data Jobs (Batch / Real time Streaming)- Excellent written and verbal...
-
Databricks Architect
2 months ago
Bangalore, Karnataka, India TecHHire Global Full timeJob Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...
-
Databricks Architect
3 weeks ago
Bangalore, Karnataka, India TecHHire Global Full timeJob Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...
-
Big Data Developer
2 months ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeSalary : 12 - 20 LPARequirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...
-
Lead Data Engineer
4 days ago
Bangalore, Karnataka, India NINETY1 GLOBAL CONSULTING PRIVATE LIMITED Full timeJob Description:Experience: 8-12 yearsLocation: Bangalore (WFO)- 8 years' experience in developing scalable Big Data applications or solutions on distributed platforms. - Able to partner with others in solving complex problems by taking a broad perspective to identify innovative solutions.- Strong skills building positive relationships across Product and...