Senior Data Engineering Specialist

2 weeks ago

Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Senior ETL Developer

Job Description:

  • Collaborate with stakeholders to translate data requirements into technical solutions, driving seamless communication and efficient project delivery.
  • Design, develop, and deploy scalable data pipelines and ETL processes using Databricks, fostering a culture of innovation and excellence.
  • Optimize Spark jobs and ensure efficient data processing and storage, leveraging expertise in big data technologies.
  • Develop and maintain Databricks notebooks, workflows, and dashboards, streamlining business operations and enhancing decision-making capabilities.
  • Proficient in building and optimizing data pipelines and workflows in Databricks, with a strong focus on scalability and reliability.
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks, providing expert solutions and ensuring high availability.
  • Monitor and manage data processing jobs to ensure high availability and reliability, guaranteeing optimal system performance.
  • Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services, driving digital transformation and growth.
  • Knowledge of programming languages such as Python and Scala, with a strong emphasis on staying current with industry trends and advancements.
  • Stay current with the latest Databricks and big data technologies and trends, applying expertise to drive business success.
  • Experience working in cloud platforms (Azure/AWS platforms) and familiar with cloud tools and technologies, with a strong focus on collaboration and teamwork.

Required Skills and Qualifications:

  • 6+ years of experience in development and maintenance in a data engineering project.
  • Good communication skills, with excellent written and verbal communication abilities.

Key Skills:

  • SQL
  • Databricks
  • Cloud

Benefits:

  • Opportunity to work with cutting-edge technologies and innovative projects.
  • Collaborative and dynamic work environment.

Others:

  • Continuous learning and professional development opportunities.

  • Senior Data Transformation Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 22,50,000

    Senior Data Transformation SpecialistWe are seeking an expert in data transformation to help us build scalable, high-performance pipelines.Data Ingestion and Pipelining: Design and implement efficient data ingestion pipelines using Snowflake and dbt.Data Modelling and Transformation: Implement data modelling and transformation logic to support a layered...

  • Senior Data Infrastructure Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Infrastructure SpecialistOverviewAs a key member of our team, you will play a vital role in designing and implementing cutting-edge data infrastructure solutions. Your primary responsibility will be to architect and deploy scalable data systems that meet the needs of our organization.Key ResponsibilitiesDesign and implement robust data...

  • Senior Data Integration Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    As a senior data integration specialist, you will be responsible for designing and developing data pipelines to integrate multiple sources into Databricks. This role requires a strong understanding of data ingestion processes focusing on scalability and efficiency.

  • Senior Data Engineering Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Chief Data Engineering ProfessionalWe seek an accomplished Chief Data Engineering Professional to contribute to our dynamic Data Warehouse team.The ideal candidate will possess extensive experience in data engineering, with a proven track record of leading high-performing teams.You will play a pivotal role in shaping the architecture, mentoring senior...

  • Data Engineering Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Data Engineering Specialist **Job Description:We are seeking a skilled and experienced data engineer to join our team. The ideal candidate will have a strong background in designing and developing complex data pipelines using various tools and technologies.Responsibilities include building, maintaining, and optimizing data pipelines using...

  • Data Engineering Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 15,75,000 - ₹ 20,25,000

    Job Opportunity">We are seeking a highly skilled and motivated Data Engineering Specialist to join our team. The ideal candidate will have a strong background in data engineering, with experience working with Big Data technologies such as Spark and Databricks.">The successful candidate will be responsible for designing and implementing complex data...

  • Transformative Senior Data Engineer Lead

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 35,00,000

    **Job Title:** Data Engineering LeadOverview:Our organization is seeking an experienced Senior Data Engineer Lead to lead our data engineering team in the design, development, and implementation of scalable data infrastructure.Key Responsibilities:Lead a team of senior data engineers to design, develop, and implement data architecture, including data...

  • Data Engineering Specialist

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data Engineering Specialist- We are seeking a seasoned Kafka engineer to join our team and lead the development of automated migration pipelines for moving enterprise workloads to open-source or cloud-native clusters.- The ideal candidate will script and provision migration steps, automate validation, rollback, and monitoring tasks for large-scale...

  • Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Transformative Career Opportunity in Data EngineeringTalent500 presents an exceptional opportunity for a skilled Senior Engineer to join its esteemed client's team.Snowflake Data Engineering: Develop and optimize data warehouse solutions in Snowflake, ensuring performance and scalability for finance and accounting workloads.dbt Development: Build and...

  • Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Betterbeans Consultants Pvt Ltd Full time

    Role : Senior Data EngineerExperience : 8-10 years' experienceSkill Set Required : Azure Data FactoryAzure DatabricksPythonSQL, PL/SQLSSISJob Role/Job Description : Senior Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)Collaborate with...