Big Data Processing Specialist

3 days ago


Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

Job Title: Data Engineer

We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.

  • Key Responsibilities:
  • - Design and implement data pipelines using AWS services such as Amazon EMR, Amazon Athena, and AWS Glue.
  • - Develop and maintain PySpark applications using Spark Dataframes in Python.
  • - Optimize spark jobs that process huge volumes of data.
  • - Work with version control tools like Git.
  • - Collaborate with cross-functional teams to identify business opportunities and drive data-driven decision making.

Required Skills and Qualifications:

  • Skill Requirements:
  • - Strong experience with AWS services including Amazon S3, Amazon Lambda, and Amazon EC2.
  • - Proficiency in Python and PySpark.
  • - Experience with datawarehousing concepts and columnar storage formats.
  • - Knowledge of compression techniques and data encryption methods.
  • Education and Certifications:
  • - Bachelor's degree in Computer Science or related field.
  • - AWS certifications a plus.

What We Offer:

  • Competitive Salary:
  • - We offer a competitive salary based on industry standards.
  • Benefits Package:
  • - Comprehensive health insurance package.
  • - Retirement plan with company match.
  • - Paid time off and holidays.

About Us:

  • Company Overview:
  • - Our company is a leader in the data engineering space, providing innovative solutions to top Fortune 500 companies.
  • - We value collaboration, innovation, and continuous learning.

  • Big Data Specialist

    15 hours ago


    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time US$ 5,00,000 - US$ 10,00,000

    As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems. This role requires expertise in handling complex data pipelines and ensuring high-performance data analytics.Key Responsibilities:


  • Thiruvananthapuram, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ProfessionalWe are seeking an experienced Big Data Professional to join our team. The ideal candidate will have a strong background in big data analytics, including data ingestion, processing, and visualization.Key Responsibilities:Design and implement data ingestion pipelines from disparate sources onto a big data platform.Develop and...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionAt our organization, we are seeking an accomplished Data Engineer to spearhead the design and implementation of large-scale data processing systems using Apache Ray.


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data ExpertWe're seeking a seasoned Big Data Expert to drive the design, development, and optimization of large-scale data pipelines and distributed systems.Develop scalable big data architectures using cloud-based solutions.Collaborate with cross-functional teams to deliver high-quality code through code reviews, performance tuning, and best...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 22,50,000

    Seeking a visionary leader to spearhead the development of scalable data pipelines and analytics platforms on Microsoft Azure and Databricks.The ideal candidate will have in-depth expertise in Big Data platforms, drive the design and delivery of end-to-end data solutions, collaborate with cross-functional teams, and promote best practices in data...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Data Engineer RoleWe are seeking a skilled Data Engineer to join our dynamic data team. As a key member of our data infrastructure team, you will design, develop and maintain robust data pipelines, data warehouses and analytics platforms that serve as the backbone of our digital marketing product development.The ideal candidate will have experience...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Data Solutions SpecialistThis position involves developing and maintaining scalable data pipelines to support growing data volumes and complexity.Data solutions specialists will collaborate with analytics and business teams to improve data models for business intelligence tools, enhancing data accessibility and driving data-driven decision...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    **Job Description:**We are seeking a skilled Data Engineer to join our team and contribute to the development of data-driven solutions using Azure Databricks.The ideal candidate will have experience working with big data technologies, including Apache Spark and Python. They should be able to design, develop, and deploy scalable data pipelines, as well as...


  • Thiruvananthapuram, Kerala, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a skilled Data Integration Specialist to join our team. As a Data Integration Specialist, you will play a key role in designing and developing scalable ETL workflows using Informatica BDM/DEI.The ideal candidate will have experience working with big data platforms, applying strong data warehousing concepts to ensure efficient...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Real-Time Data Engineering ExpertThis is a full-time hybrid role that involves building and maintaining large-scale data infrastructures with real-time capabilities.Key Responsibilities:Developing scalable data models to ensure data quality and efficiency in complex systems.Designing, implementing, and optimizing Extract Transform Load (ETL) processes and...