Big Data Consultant

3 weeks ago


Bangalore, Karnataka, India Nilasu consulting Full time

Summary :

We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team.

You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles.

Additionally, your experience in Python and microservices architecture will be valuable in building scalable and robust big data solutions.

Responsibilities :

- Design, develop, and maintain Spark Scala applications for big data processing tasks, emphasizing functional programming paradigms.

- Develop and implement Scala microservices and APIs for efficient data access and integration.

- Leverage your expertise in big data technologies like Hadoop, Spark, and Hive to build and manage data pipelines.

- Collaborate with data engineers, scientists, and analysts to understand data requirements and translate them into effective big data solutions.

- Participate in code reviews and ensure adherence to coding best practices and maintainability standards.

- Stay up-to-date with the latest advancements in big data technologies and frameworks.

Qualifications :

- Bachelor's degree in Computer Science or a related field.

- Minimum of 4 years of experience in Spark Scala programming.

- Proficiency in Python programming with experience in data analysis libraries (e.g., NumPy, Pandas).

- Strong understanding of big data concepts, data processing paradigms, and distributed computing frameworks.

- Familiarity with Apache Hadoop ecosystem tools like YARN, HDFS, and MapReduce (preferred).

- Experience with Apache Hive for data warehousing and querying (preferred).

- Experience with microservices architecture and API development (preferred).

- Solid understanding of functional programming principles.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)
  • Big Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Big Data Architect

    3 weeks ago


    Bangalore, Karnataka, India White Hawk Consultant Full time

    Job Description :- 10+ years of experience in end-to-end software development and system architecture, preferably in a product development organisation.- Hands-on experience in Java/Scala and Big Data tech stack - Apache Pinot/Druid/Hudi, HDFS, Hive, Presto, Flume, Storm, Kafka, Spark, NO-SQL databases is a must.- Hands-on experience in working on...

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Big Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India randstad Full time

    Primary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...


  • Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Data Analyst

    3 weeks ago


    Bangalore, Karnataka, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full time

    Data Analyst About the job:- At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital era.- With dedicated Centres of Excellence across the globe, we are enabled to deliver...


  • Bangalore, Karnataka, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data DeveloperManagement Level : G130Years of Experience : 2 to 5 yearsJob Location : Bangalore (Hybrid)Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark.Educational Qualification : BE/BTech/ MTech/ MCARole & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good understanding of...

  • Big Data Developer

    4 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPARequirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...


  • Bangalore, Karnataka, India Huquo Full time

    Job Description :Role/Responsibilities of an Architect/Cloud Engineer :- Architect on our Cloud Platforms and Infrastructure team has close to 5 - 8 years of experience in DevOps, SecOps, or SysOps in a large enterprise environment and would take a lead role in the design and analysis of a Cloud - based Big Data and Analytics solution in a variety of...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India LOGIC PLANET IT SERVICES Full time

    About the job :We are hiring for a global technology company, home to more than 224,000 people across 60 countries.Role : Data EngineerExp : 5+ years Mode of Work : HybridMode of Hire : FTEAvailability : Immediate joinee or serving maximum of 30 days notice period.Job Description :- 5+ years of experience operating and deploying solutions using AWS Service...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Job Description : We are looking for a highly skilled Senior Data Engineer with extensive experience in data integration, processing, and application development for handling large-scale data sets measured in Terabytes from multiple sources.- The ideal candidate will have a strong background in AWS services, particularly Lambda, EMR, and Glue, along with...


  • Bangalore, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Snowflake Developer

    4 weeks ago


    Bangalore, Karnataka, India High Peak Software Full time

    Job Description :- Minimum 7+ years of experience in developing software applications including: analysis, design, coding, testing, deploying and supporting of applications- Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, Big Data model techniques using Python / Java.- Extensive experience in developing complex stored Procedures/BTEQ...


  • Bangalore, Karnataka, India Career Stone Consultant Private Limited Full time

    Role Responsibilities business processes by working across teams and functions to generate insights.Proficient in designing Business Intelligence solutions with a strong command of Tableau, Domo, Looker, etc.Design BI solutions based on guided analytics approach and best in class story telling delivery model.Consult and partner with leadership to develop...

  • Sigmoid Analytics

    2 weeks ago


    Bangalore, Karnataka, India Sigmoid Analytics Full time

    As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to Engineering Manager.Responsibilities : - Align Sigmoid with key Client initiatives- Interface daily with...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...

  • Big Data Engineer

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:- This position will be part of a growing team working towards building world class large scale Big Data architectures.- This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location - Bangalore and...