Big Data Specialist

17 hours ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

Job Title: Senior Data Engineer

As a senior data engineer, you will be responsible for designing and implementing efficient data pipelines that meet the business requirements.

Key Responsibilities:
  • Developing data pipelines using AWS services such as S3, IAM, Glue, EMR, and Redshift;
  • Performing integration testing of different created pipelines in an AWS environment;
  • Providing estimates for development, testing, and deployment on different environments;
  • Participating in code peer reviews to ensure applications comply with best practices;
  • Creating cost-effective AWS pipelines with required AWS services.
Requirements:

We are looking for someone with strong analytical, problem-solving, data analysis, and research skills. You should have good hands-on experience with Big Data technologies such as pySpark, Hadoop, and Hive.

  • 4-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive;
  • Good hands-on experience of python and Bash Scripts;
  • Good understanding of SQL and data warehouse concepts;
  • Demonstrable ability to think outside of the box and not be dependent on readily available tools;
  • Excellent communication, presentation, and interpersonal skills are a must.
Desirable Skills:

The following skills would be desirable but not essential:

  • Hands-on experience with using Cloud Platform provided Big Data technologies;
  • Orchestration with Airflow and Any job scheduler experience;
  • Experience in migrating workload from on-premises to cloud and cloud to cloud migrations.

  • Big Data Specialist

    4 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...

  • Big Data Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Big Data SpecialistGreetings from our team!We are seeking an experienced Big Data Specialist to join our team. As a key member, you will play a critical role in driving business growth through data-driven insights.This is an exceptional opportunity for a motivated and talented individual who thrives in a fast-paced environment. Our ideal candidate will have...

  • Big Data Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeInfrastructure Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title:Big Data Infrastructure SpecialistJob Overview:We are seeking a skilled Big Data Infrastructure Specialist to design and implement scalable data infrastructure solutions.Key Responsibilities:Deploy and manage Hadoop clusters on Apache and CDHConfigure and secure Hadoop environments using Yarn and HiveDesign and implement data pipelines using Spark,...

  • Big Data Engineer Position

    18 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data SpecialistWe are seeking a highly skilled big data specialist to design, develop, and maintain large-scale data systems. This individual will be responsible for architecting and implementing data pipelines using various distributed data processing frameworks.",

  • Big Basket

    3 days ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data Specialist

    13 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionJob Summary:We are seeking a skilled Big Data Specialist to join our team of experts. The ideal candidate will be responsible for designing, developing, and maintaining scalable data platforms and architectures to support our analytics and business intelligence needs.About Us:We believe in harnessing the power of technology to drive...

  • Big Basket

    3 days ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Big Data SpecialistAbout the Role:We are seeking a skilled data professional to design and develop high-quality applications using Google BigQuery.Main Responsibilities:Independently perform tasks and become an SME in your area of expertise.Participate actively in team discussions and contribute solutions to work-related problems.Collaborate...

  • Big Data Technical Support Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Support SpecialistJob Description:We are seeking a highly skilled Support Specialist to join our team. The successful candidate will have experience in big data environments and be proficient in Apache Spark, Druid, and Trino.Key Responsibilities:Monitor Spark jobs and supervise data ingestion pipelines in Druid.Provide Level 1 production support...

  • Big Data Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeedata Full time ₹ 60,00,000 - ₹ 1,20,00,000

    **Big Data Expertise**The ideal candidate will possess strong expertise in Hadoop, Hive and Spark (Scala) with solid experience in RDBMS and at least one SQL database. This individual should be skilled in writing unit and integration tests using Scalatest. We are seeking an experienced professional who can collaborate with cross-functional teams to design,...