Senior Big Data Specialist

4 days ago


Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

As a seasoned Data Engineer, you will play a pivotal role in designing, developing, and maintaining scalable data pipelines that drive business growth.

Key Responsibilities:
  • Design and implement efficient data pipelines using PySpark, ensuring seamless data transformation and quality
  • Maintain expertise in Spark SQL, DataFrame, and RDD APIs for complex business logic implementation
  • Develop proficient programming skills in Python with solid fundamentals in data structures, algorithms, and software engineering principles
  • Develop and maintain batch and streaming data pipelines with proven experience in ETL/ELT processes and best practices for data transformation, quality, and performance optimization
Requirements:
  • Strong experience in PySpark with hands-on expertise in building scalable data pipelines
  • Familiarity with modern data engineering ecosystems, including distributed data processing, storage systems, and workflow orchestration tools
  • Cloud data platform experience, preferably AWS, with expertise in cloud services such as S3, Glue/EMR, Lambda, Step Functions, and Redshift
  • Ability to choose and apply the right Spark APIs for performance-efficient implementation of business logic at scale

In this role, you will be responsible for leveraging your technical expertise to develop innovative solutions that drive business growth. If you are passionate about working with large datasets and have a knack for problem-solving, we encourage you to apply.


  • Big Data Specialist

    3 days ago


    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled professional to join our team as a Big Data Specialist.This is an exciting opportunity for someone who wants to work with large data sets and contribute to the growth of our organization.The ideal candidate will have experience working with PySpark, Hive, and other big data tools, and be familiar with data ingestion from disparate...


  • Erode, Tamil Nadu, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerThe Role:We are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data processing systems using big data technologies.Key Responsibilities:Design and develop scalable and efficient data processing systems using big...


  • Erode, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Key Role Summary:We are seeking a highly skilled Senior Data Specialist to join our team.Job DescriptionThe ideal candidate will have a strong background in data engineering and a proven track record of designing, developing, and maintaining large-scale data pipelines. Key responsibilities include working with big data ecosystems, developing efficient ETL...

  • Big Data Engineer

    4 days ago


    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using PySpark, Hive, and other big data tools.Analyze and optimize system performance to...

  • Key Architect

    6 days ago


    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:A seasoned Senior Data Engineer is required to lead a team of big data engineers, working closely with clients and team members to understand their requirements and develop architectures that meet their needs.


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:A Senior Data Engineer will lead a team of big data engineers, collaborating with clients and team members to design architectures that meet client needs.Key Responsibilities• Develop efficient data pipelines for new sources, including data transformations within the Data Lake.• Collaborate with cross-functional teams to source data and make...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Data Engineering expert to design, build and maintain high-performance data pipelines that process large volumes of data.This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.Key Responsibilities include:Designing and implementing scalable...


  • Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering Technical LeadThe Data Engineering Technical Lead will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This role requires a strong background in computer science, software...


  • Erode, Tamil Nadu, India beBeePerformance Full time ₹ 12,00,000 - ₹ 20,00,000

    Big Data Cloudera AdministratorWe are seeking a highly skilled Big Data Cloudera Administrator to join our team.Job Responsibilities:Design, deploy and manage large-scale Cloudera clusters for big data processing and analytics.Migrate data between different systems and perform performance tuning to ensure optimal system efficiency.Provide pre- and...


  • Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerAt our organization, we are seeking a seasoned Senior Data Engineer with expertise in Python and Pyspark. This individual will play a pivotal role in designing, developing, and implementing an application for a large retailer.Required Skills & QualificationsWe are looking for a candidate with 5+ years of experience as a Data Engineer,...