Big Data Specialist

2 days ago

Mangalore, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 20,10,000

Job Title:

Azure Data Engineer

Description:

We are seeking an expert Data Engineer with proficient knowledge in Spark and SQL to join our dynamic team.

The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our Data platform. You will work closely with data architects and other stakeholders to ensure data accessibility, reliability, and performance.

Main Responsibilities:
  • Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).
  • Integrate data from various sources, ensuring data quality and consistency.
  • Optimize data processing workflows for performance and cost-efficiency.
  • Work with data architects, analysts, and product owners to understand data requirements and deliver solutions.
  • Monitor data pipelines and troubleshoot issues to ensure data integrity.
  • Document data workflows, processes, and best practices.
Requirements:
  • Proficiency in Azure Synapse/Databricks and Apache Spark.
  • Strong PySpark and SQL skills for data manipulation and querying.
  • Familiarity with Delta Live Tables and Databricks workflows.
  • Experience with ETL tools and processes.
  • Knowledge of cloud platforms.
  • Minimum 2 years of work experience with Azure Synapse.
  • 5 years of experience in data engineering.
Soft Skills:
  • Excellent problem-solving abilities.
  • Strong communication and collaboration skills.
  • Ability to work in a fast-paced environment and manage multiple priorities.

This role requires a strong understanding of data engineering principles and the ability to design, implement, and optimize data pipelines on our Data platform. If you have a passion for working with big data, we encourage you to apply.

  • Senior Big Data Specialist

    3 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Data EngineerAs a Senior Big Data Specialist, you will design, build, and maintain scalable data pipelines using Snowflake. This role is ideal for an experienced professional looking to leverage their skills in big data engineering to drive business growth.Responsibilities:Develop ETL/ELT pipelines using Snowflake Tasks, Streams, and Stored Procedures,...

  • Data Engineer

    4 days ago

    Mangalore, Karnataka, India beBeeBigDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Role OverviewWe are seeking a skilled professional to fill the position of Big Data Developer.The ideal candidate should have a strong background in data analysis and experience with big data technologies.This is an excellent opportunity for those looking to advance their careers in the field of big data engineering.Key responsibilities include working...

  • Big Data Integration Specialist

    1 day ago

    Mangalore, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 30,00,000

    We are seeking a seasoned Big Data Integration Specialist to design and implement automated migration pipelines for moving enterprise data systems to cloud-native clusters.This involves scripting and provisioning migration steps, automating validation, rollback, and monitoring tasks. The ideal candidate will develop and integrate custom plugins for data...

  • Big Data Professional

    1 day ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Big Data DeveloperSeeking a skilled data professional to drive strategic growth through innovative big data solutions.Key Responsibilities:Proven expertise in developing and implementing big data applications using Java, Scala, and Apache Spark Frameworks.Proficient in Unix File system and HDFS commands, with experience working with query...

  • Data Engineer for Big Data Ecosystem

    3 days ago

    Mangalore, Karnataka, India beBeeEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data ProfessionalWe are seeking a highly skilled professional to design and develop big data solutions.The ideal candidate will have hands-on experience with Scala, Spark, Hive, and Hadoop. Strong SQL skills are essential, as the candidate should be able to develop, tweak queries, and work on performance enhancement.A solid understanding of...

  • Big Data Solutions Specialist

    10 hours ago

    Mangalore, Karnataka, India beBeeDataScientist Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About our organization:We are a professional software services provider offering high-quality, cost-effective solutions to businesses.Utilizing best-of-breed technologies and flexible engagement models, we have helped meet the IT requirements of companies ranging from those among the Fortune 100 to medium-sized firms.We employ highly talented professionals...

  • Expert Big Data Architect

    16 hours ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are looking for a skilled data engineer to design, develop, and maintain large-scale data systems. The ideal candidate will have hands-on experience with big data tools, data pipelines, and cloud services.ResponsibilitiesCreate and maintain optimal data pipeline architectureCreate and maintain events/streaming based...

  • Chief Big Data Architect

    1 week ago

    Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Big Data Engineering Leadership OpportunityWe are seeking an experienced and strategic leader with deep expertise in Big Data platforms and cloud-native environments to lead a team of data engineers.Job Summary:About the Role:This role involves leading a team of data engineers working on large-scale distributed data systems, architecting and overseeing the...

  • Big Data Cluster Architect

    7 days ago

    Mangalore, Karnataka, India beBeeCluster Full time ₹ 18,00,000 - ₹ 25,20,000

    As a Big Data Cluster Architect, you will be responsible for designing and implementing high-performance computing systems to support large-scale data processing and analysis.Key Responsibilities:Develop and maintain complex data pipelinesMigrate data between systems while ensuring minimal downtimePerform regular performance tuning and optimization...

  • Mastering Big Data Infrastructure

    4 days ago

    Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Engineering Professional to design, build, and maintain robust data pipelines for processing channel activity data from multiple sources.Key Responsibilities:Develop scalable data engineering solutions using cloud infrastructure and orchestration tools.Leverage Python for building automated data transformations and pipeline...