Big Data Developer

4 days ago

Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

Job Title: Data Engineer

Job Description:

  • Develop data solutions by working with scrum teams to ensure timely delivery of quality database programming requirements.
  • Utilize expertise in Azure cloud platforms, including Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS.
  • Design and deploy scalable ETL/ELT pipelines using PySpark and SQL on Azure Databricks.
  • Implement Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing.
  • Apply Unity Catalog for centralized data governance, access control, and data lineage tracking.
  • Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end.
  • Write unit tests to automate testing.
  • Adhere to SOLID development principles to maintain data integrity and cohesiveness.
  • Interact with product owner and business representatives to determine and satisfy needs.
  • Demonstrate a sense of ownership and pride in your performance and its impact on company success.
  • Exercise critical thinking and problem-solving skills.
  • Function as a team player.
  • Manage time effectively.
  • Employ great interpersonal and communication skills.

Mandatory Qualifications:

  • 4-7 years of experience as a Data Engineer.
  • Self-driven with minimal supervision.
  • Proven experience with T-SQL programming, Azure Databricks, Spark (PySpark/Scala), Delta Lake, Unity Catalog, ADLS Gen2.
  • Microsoft TFS, Visual Studio, Devops exposure.
  • Experience with cloud platforms such as Azure or any.
  • Analytical, problem-solving mindset.

Preferred Qualifications:

  • Healthcare domain knowledge.

At our organization, we are transforming the insurance industry by developing innovative benefits management solutions. We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for clients. As part of our strategic growth, we are focused on platform modernization — transitioning legacy systems to modern, cloud-native architectures that support the scalability, reliability, and high performance of core back-office functions in the insurance domain.

The role involves building and optimizing scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The position requires strong problem-solving skills, T-SQL expertise, and hands-on experience with Azure cloud tools. Healthcare domain knowledge is a plus.

  • Big Data Engineer

    3 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineering RoleWe are looking for a skilled Big Data Engineer to lead our team in delivering scalable and efficient data infrastructure. The ideal candidate will have expertise in Cloudera and Linux commands, as well as strong knowledge of data migration, performance tuning, and application deployment.Key Responsibilities:Design and manage...

  • Big Data Architect

    2 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistJob Description: We are seeking a highly skilled engineer to design, build, and maintain robust data pipelines that handle high-volume financial data. This individual will be responsible for developing scalable and efficient data architectures to meet the needs of our business.Key Responsibilities:Design and Develop...

  • Big Data Engineer

    1 day ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    As a seasoned professional, you will have the opportunity to design and build large-scale data pipelines that handle massive amounts of structured and unstructured data.Key Responsibilities:Develop, implement, and maintain complex data pipelines that ensure high availability, scalability, and reliability.Own end-to-end ETL/ELT processes, focusing on...

  • Senior Big Data Technology Specialist

    5 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 22,35,200 - ₹ 26,16,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining high-performance data pipelines that process terabytes of data.Your primary focus will be on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing...

  • Data Engineer

    3 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ProfessionalAs a senior data engineer at a leading technology firm, you will be responsible for working with large-scale data sets to uncover valuable insights and inform business decisions.Key Responsibilities:Develop and maintain scalable big data architectures using distributed processing frameworks and data warehousing solutions.Collaborate with...

  • Big Data Solutions Engineer

    5 days ago

    Vellore, Tamil Nadu, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled Data Architect to design, develop and maintain scalable data solutions on Databricks. The successful candidate will be responsible for leading the architecture and implementation of high-performance data solutions that meet our business needs.Design and develop data pipelines and ETL processes on Databricks.Lead...

  • Software Professional: Data Pipeline Engineer

    4 days ago

    Vellore, Tamil Nadu, India beBeeBigDataDeveloper Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Senior Big Data DeveloperWe are looking for a seasoned Senior Big Data Developer to design and implement robust data pipelines using Python and SQL.Develop, test, and maintain large-scale data processing systems in Databricks.Configure and manage GitHub branch protection rules and workflows to ensure smooth code integration and deployment.Implement unit...

  • Chief Data Architect

    5 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,30,00,000

    We are seeking a Senior Data Engineer to join our team of experts in designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have 5+ years of experience in data engineering or related fields, with a focus on big data technologies and cloud platforms. In this role, you will be responsible for architecting and...

  • Big Data Architectural Specialist

    2 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About this RoleWe are seeking a highly skilled Data Engineering Leader with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and lakehouse architectures.You will work closely with cross-functional teams to provide thought leadership and deliver robust, secure, and high-performance data solutions that empower analytics...

  • Leading Data Architect

    3 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced data engineer with strong expertise in AWS cloud services and Databricks to design scalable, high-performance data pipelines that meet business needs.Key Responsibilities:Design, develop, and maintain data pipelines using AWS (S3, Redshift, Glue, EMR) and Databricks for large-scale datasets.Build and optimize ETL...