Senior Big Data Developer

16 hours ago

Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

Job Title: Senior Big Data Developer

Overview:

We are seeking an experienced Senior Big Data Developer to join our team. The ideal candidate will have a strong background in data engineering and a proven track record of designing, developing, and optimizing large-scale data processing solutions.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in cloud services (e.g., Data Lake, Synapse).
  • Debug, troubleshoot, and optimize code for performance and scalability.

Required Skills & Qualifications:

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.

Nice-to-Have Skills:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Senior Big Data Engineer

    16 hours ago

    Davangere, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data Engineer">We are seeking a highly skilled and experienced Senior Big Data Engineer with expertise in designing, architecting, and implementing scalable data engineering solutions using AWS Cloud Services.">Key Responsibilities:">Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex...

  • Big Data Developer

    4 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    We are seeking a skilled Data Engineer to support the growth of our organization's data management capabilities.Key ResponsibilitiesOur ideal candidate will design, develop, and maintain large-scale data processing systems using Big Data technologies such as Hadoop, Scala, and Spark. They will also be responsible for developing and optimizing complex SQL...

  • Senior Big Data Engineer

    4 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have experience in designing, executing, and managing large and complex distributed data systems.The successful candidate will have expertise in big data technologies (Apache Hadoop) and relational databases (MS SQL...

  • Senior Big Data Engineer

    1 day ago

    Davangere, Karnataka, India beBeeBigDataDeveloper Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Big Data Development OpportunityWe are seeking an experienced professional to design and implement big data solutions utilizing Java, Scala, and Apache Spark Frameworks.Develop and deploy scalable data processing systems using HDFS commands.Utilize query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase DB to extract valuable insights from...

  • Big Data Developer

    15 hours ago

    Davangere, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleThis is an exciting opportunity to join our Data Science team as a Big Data Developer.We are looking for a highly skilled and experienced professional with 5-12 years of experience in big data technologies such as Spark, SQL, Hive, and Scala.The successful candidate will be responsible for designing, developing, and deploying large-scale data...

  • Big Data Expert

    2 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 17,50,000 - ₹ 22,50,000

    Senior Big Data EngineerThe ideal candidate will possess a strong background in Python and PySpark programming languages, along with a solid understanding of HDFS, Hive, and Spark architecture. This expertise will enable them to design, develop, and maintain large-scale data processing systems.">Strong knowledge of Python and PySpark programming...

  • Unlock Big Data Potential

    7 days ago

    Davangere, Karnataka, India beBeeData Full time US$ 70,000 - US$ 1,50,000

    Big Data Engineer OpportunityWe are seeking a highly skilled professional to leverage big data and drive business growth.About the Role:Design, develop, and implement large-scale data processing systems using big data technologies such as PySpark, Hive, Spark, HBase, and DQ tools.Expertise in data ingestion from diverse sources onto big data platforms and...

  • Advanced Big Data Engineer

    1 day ago

    Davangere, Karnataka, India beBeeBigDataDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a skilled Big Data Developer to join our team. The ideal candidate will have a strong background in big data technologies and be able to design, develop, and implement scalable solutions.",

  • Senior Big Data Engineer

    1 day ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Position\We are seeking a skilled Data Engineer to lead our data systems team. The ideal candidate will have 3-5 years of experience in data modeling, ETL, and Snowflake.\The successful candidate will be responsible for:\Designing and developing complex data pipelines using Snowflake DBImplementing machine learning methods using linear...

  • Big Data Engineer

    7 days ago

    Davangere, Karnataka, India Idyllic Services Full time

    Job Title: Big Data Engineer – Scala Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai. Experience: 7–10 Years (Minimum 3+ years in Scala) Notice Period: Immediate to 30 Days Mode of Work: Hybrid Click the link below to learn more about the role and take the AI Interview to begin your application journey: Role Overview We are looking for a...