Scaling Big Data with Apache Spark

2 weeks ago


Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Senior Data Engineer Role

This position involves designing, developing and maintaining large-scale data pipelines using Apache Spark and AWS services.

Responsibilities:
  1. Data Pipeline Design: Develop robust ETL/ELT pipelines on AWS using Spark and PySpark.
  2. Performance Optimization: Optimize large-scale data processing workflows for performance and reliability.
  3. AWS Services Integration: Work with AWS services such as Glue, EMR, S3, Lambda, and Redshift.
  4. Data Quality Assurance: Ensure data quality, governance, and security across all pipelines.
Requirements:
  1. Experience: 6+ years of experience in data engineering.
  2. Technical Skills: Strong proficiency in Spark, PySpark, SQL, and Python.
  3. AWS Knowledge: Hands-on experience with AWS data services.
  4. Distributed Computing: Solid understanding of distributed computing and data architecture.
  5. Problem-Solving: Excellent problem-solving and communication skills.
  6. CICD: Experience with CI/CD for data pipelines.
  7. Data Architecture: Familiarity with data lake and data warehouse architectures.

We offer competitive compensation and opportunities for professional growth. If you are passionate about working with cutting-edge technology and driving innovation, please submit your application.



  • Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer JobWe are looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing and executing large-scale distributed data systems.The ideal candidate should have experience in big data technologies such as Apache Hadoop and relational databases like MS SQL Server or Oracle.You should also...

  • Big Data Architect

    2 weeks ago


    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityLocation: Hyderabad & NoidaWe are seeking a seasoned Data Engineer with 5-8 years of experience to join our team. The ideal candidate will have hands-on experience in Spark, Scala, Big Data (Hadoop), and cloud platforms like AWS/Azure/GCP.Key ResponsibilitiesDesign and develop scalable data processing pipelines using Apache Spark, Kafka, and...

  • Big Data Specialist

    2 weeks ago


    Kannur, Kerala, India beBeeData Full time ₹ 14,61,120 - ₹ 20,98,960

    Big Data SpecialistWe are seeking a skilled professional to join our team. In this role, you will be responsible for designing and developing scalable data processing systems using big data technologies.Main Responsibilities:Develop software applications using Java, Scala, and other programming languages.Design and implement data pipelines using Apache Spark...

  • Lead Data Architect

    2 weeks ago


    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a skilled Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaining large-scale data systems.This role requires strong technical skills in programming languages such as Python, experience with big data technologies like Apache Spark or Pyspark, and UNIX system...


  • Kannur, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in data analytics and experience working with big data platforms.As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with...


  • Kannur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled professional to lead our data engineering efforts in big data processing, cloud-based analytics, and advanced visualization technologies.The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, Azure data services, Python programming, and emerging technologies like IoT and AR/VR/MR.Key...


  • Kannur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Role: Big Data EngineerWe are seeking a skilled professional to develop and implement big data solutions. A successful candidate will have experience in designing, building, and optimizing large-scale data pipelines using distributed data systems and cloud-based technologies.Design and create high-performance data processing systems.Develop expertise in...


  • Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to lead the development of big data engineering solutions. The successful candidate will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.The role involves developing data pipelines for new sources, data transformations within the...

  • Senior Data Engineer

    2 weeks ago


    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Data Scientist and EngineerKey Responsibilities:Design, develop and deploy scalable data pipelines using Apache Spark.Craft high-quality data processing workflows using PySpark and Python.Work closely with cross-functional teams to understand data requirements and deliver robust solutions.Architect and implement data ingestion, transformation and...


  • Kannur, Kerala, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Engineer Position">We are seeking a highly skilled professional with expertise in designing, architecting, and implementing scalable data engineering solutions.">Key Responsibilities:">">Design and develop Big Data architectures leveraging cloud services for large-scale data processing.">Build and maintain data pipelines using Spark (Scala) for both...