Big Data Specialist

1 day ago


Kollam, Kerala, India beBeeData Full time ₹ 16,00,000 - ₹ 20,10,000

Job Summary:

We are seeking an accomplished Big Data Specialist to spearhead our data platform implementation team. As a key member of this team, you will play a vital role in designing and developing robust ETL processes using Databricks PySpark to efficiently extract, transform, and load data from diverse sources into the data lake and data warehouse.

Key Responsibilities:

  • Develop scalable ETL workflows using Databricks PySpark to optimize performance and data quality.
  • Implement comprehensive error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Design and implement data solutions following best practices, organizing data into structured layers for efficient analytics and reporting.

Requirements:

  • Bachelor's degree in Computer Science or related field.
  • Minimum 3 years of experience as an ETL developer with expertise in Databricks PySpark development.
  • Proficiency in Python programming with extensive experience in developing and debugging complex applications.
  • Strong understanding of Spark architecture and hands-on experience with Spark RDDs, DataFrames, and Spark SQL.

Preferred Qualifications:

  • Experience with cloud platforms, preferably AWS.
  • Knowledge of data governance and quality principles.


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000

    Job OverviewOur organization is seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team.The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines and hands-on experience in distributed data systems and cloud-based solutions.Key...


  • Kollam, Kerala, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineering ManagerAs a seasoned leader, you will oversee the design and delivery of scalable data pipelines and analytics platforms in the cloud. Your expertise in Big Data platforms, Microsoft Azure, and Databricks will ensure high performance, reliability, and security in a cloud-native environment.Lead and grow a team of data engineers working...


  • Kollam, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data OpportunityWe are seeking a highly skilled Big Data Specialist to drive scalable data solutions using advanced technologies.Must-Have Skills:Proficiency in PySpark and HiveExperience with big data platforms and data ingestion from disparate sourcesGood-to-Have Skills:Knowledge of Spark and HBaseAgile Scrum experienceData Quality (DQ) tool...


  • Kollam, Kerala, India beBeeCloudDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Solutions ArchitectAbout the Role:We are seeking a self-driven technical expert to design and develop scalable data architectures using cloud-based technologies.Collaborate with cross-functional teams to craft innovative data solutions that drive business growth.Develop robust data pipelines using Azure Databricks, PySpark, and Delta...


  • Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer Job DescriptionAs a Big Data Engineer, you will be responsible for designing and implementing scalable batch processing systems that process terabytes of data. Your expertise in big data technologies such as Spark and Hadoop will enable us to optimize our existing systems, identify and resolve performance bottlenecks, and implement...


  • Kollam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewTechBirds provides specialized advisory services, leveraging a global network of technology and business experts.We cater to companies worldwide, offering strategic partnerships in digital transformation, automation, AI, and data analytics.Job ResponsibilitiesThis is a full-time on-site role for an ETL Developer based in India. The position...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our mission-critical banking project. This is an excellent opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures.Key Responsibilities:Designing and implementing ETL pipelines for large-scale data ingestion and transformation.Building...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Software Engineer/Technical SpecialistJob DescriptionWe are seeking a skilled software engineer to join our team. As a senior software engineer, you will be responsible for designing and implementing scalable data architectures using Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will work with large datasets, developing...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have experience working with large datasets, designing and implementing data pipelines, and developing predictive models.The successful candidate will collaborate with our data science team to develop complex algorithms that provide valuable insights into...