Big Data Specialist

7 days ago

Bengaluru, Karnataka, India beBeePySpark Full time ₹ 1,04,000 - ₹ 1,30,878

We are currently seeking a skilled professional to fill the role of PySpark Data Engineer.

Job Description

The successful candidate will be responsible for designing, implementing and maintaining PySpark-based applications to handle complex data processing tasks. This includes ensuring data quality, integrating with diverse data sources, and developing robust error handling mechanisms. Additionally, they will be expected to optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.

Required Skills and Qualifications
  • Bachelors degree in Computer Science, Information Technology or a related field.
  • 5+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.
  • Strong understanding of data processing principles, techniques and best practices in a big data environment.
  • Proficiency in PySpark, Apache Spark and related big data technologies for data processing, analysis and integration.
  • Experience with ETL development and data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
  • Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
  • Excellent communication and collaboration skills to work effectively with data analysts, data architects and other team members.
Benefits

This is an excellent opportunity to join a dynamic team and contribute to the development of cutting-edge data processing solutions. The ideal candidate will have a strong passion for big data technologies and a desire to continuously learn and grow.

How to Apply

Interested candidates should submit their resume and cover letter outlining their relevant experience and qualifications.

  • Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...

  • Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to develop and maintain large-scale data systems.Key Responsibilities:Design, implement, and deploy data processing pipelines.Develop and maintain ETL processes for big data technologies.Collaborate with cross-functional teams to ensure data quality and integrity.Ensure data security and...

  • Big Data Operations Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeCloud Full time US$ 90,000 - US$ 1,20,000

    Job Title: Big Data Operations SpecialistKey Responsibilities:Design and implement large-scale data pipelines to process and analyze big data.Collaborate with cross-functional teams to develop and maintain data infrastructure, ensuring high availability and performance.Required Skills and Qualifications:Good experience in working with NoSQL systems, such as...

  • Big Data Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Big Data SpecialistOur organization seeks an experienced and skilled data engineer to develop, implement, and maintain scalable big data solutions utilizing cutting-edge technologies.Key Responsibilities:Design, create, and optimize data pipelines using cloud-based platforms and distributed computing systems.Collect, transform, and load large...

  • Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 2,02,50,000

    Job Opportunity: Big Data SpecialistAbout the Role:The ideal candidate will have experience working with large-scale data systems, designing and implementing efficient data pipelines, and ensuring seamless integration of data sources.Responsibilities:Design, develop, and maintain scalable big data processing systems using Python and PySparkCollaborate with...

  • Cloud Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India beBeeBigdataengineer Full time US$ 90,000 - US$ 1,20,000

    Cloud Big Data Engineering SpecialistWe are seeking a Cloud Big Data Engineering Specialist to join our team.

  • Big Data Engineer Position

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data SpecialistWe are seeking a highly skilled big data specialist to design, develop, and maintain large-scale data systems. This individual will be responsible for architecting and implementing data pipelines using various distributed data processing frameworks.",

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeHadoop Full time ₹ 1,04,000 - ₹ 1,30,878

    **Data Engineer - Big Data & Hadoop SpecialistWe are seeking a highly skilled Data Engineer to join our team and take on the role of Big Data & Hadoop Specialist. The ideal candidate will have experience in designing, developing, and maintaining large-scale data processing systems using Hadoop and other related technologies.Key Responsibilities:Design,...

  • Big Data Architect

    3 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 18,00,000 - ₹ 28,00,000

    Senior Big Data SpecialistWe are seeking a highly skilled Senior Big Data Specialist to join our organization in Bengaluru, India. The successful candidate will be responsible for designing and implementing large-scale data systems using Apache Spark, Python, and Azure Databricks.The ideal candidate will have 5-12 years of experience in Big Data & Data...

  • Big Data Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionJob Summary:We are seeking a skilled Big Data Specialist to join our team of experts. The ideal candidate will be responsible for designing, developing, and maintaining scalable data platforms and architectures to support our analytics and business intelligence needs.About Us:We believe in harnessing the power of technology to drive...