Senior Data Engineering Specialist

11 hours ago

Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,40,00,000
Job Opportunity

We are seeking a Data Engineer with strong expertise in implementing CI/CD pipelines, Databricks (Spark), Python, and SQL. This role involves building, optimizing, and debugging Spark jobs in Databricks for large-scale data processing.

  • Key Responsibilities:
  • Design and implement CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.

Requirements:

  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

Benefits

This role offers the opportunity to work with cutting-edge technologies, collaborate with cross-functional teams, and contribute to the development of reliable and scalable data solutions.

About Us

We are a forward-thinking organization that values innovation, collaboration, and continuous learning.

  • Senior Technical Specialist

    8 hours ago

    Thrissur, Kerala, India beBeeTechnical Full time ₹ 7,00,000 - ₹ 12,10,000

    Senior Technical Specialist Job DescriptionAs a Senior Technical Specialist, you will play a vital role in the development and maintenance of component specifications that meet customer and regulatory requirements.Key Responsibilities:Develop detailed technical specifications for mechanical and electrical components to ensure compliance with industry...

  • Data Engineer Specialist

    4 days ago

    Thrissur, Kerala, India beBeeData Full time

    Senior Data Solutions ArchitectKey Responsibilities:Design, develop, and maintain scalable, secure, and high-performance data pipelines on Databricks.Lead the architecture and implementation of data solutions that integrate multiple structured and unstructured sources into Delta Lake and cloud data warehouses.Collaborate with stakeholders to deliver...

  • Senior Data Engineering Professional

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a skilled professional to fill the role of Senior Data Engineer.Key Responsibilities:Develop and maintain efficient data pipelines using FiveTran, DBT Cloud, and custom frameworks.Implement client-specific data transformations for HighTouch integration.Support data ingestion and quality checks during client onboarding.Optimize...

  • Senior Data Engineering Specialist

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:Data Engineering ExpertJob Description:We are seeking a skilled Data Engineer with expertise in Telemetry, Big Data and backend engineering to help implement an application for a leading retailer.Key Responsibilities:Developing and maintaining large-scale data processing systemsDesigning and implementing data pipelines and workflowsCollaborating...

  • Chief Data Engineering Specialist

    11 hours ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity:Senior Data Engineer RoleWe are seeking an experienced Data Engineer to contribute to our data engineering team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable real-time and batch processing workflows using cloud-based...

  • Senior GIS Data Migration Specialist

    23 hours ago

    Thrissur, Kerala, India Gnapi Technologies Full time

    Job Title: Senior GIS Data Migration Specialist (FME & Utility Network Expert)Location: HyderabadDepartment: UtilityEmployment Type: Full-timeEducation: Bachelor's or Master's degree in Geoinformatics, Computer Science, Geography, or related field.Experience: 7+ yearsCompany: Gnapi Technologies., is an Information Technology Company with registered offices...

  • Senior Software Engineer

    2 days ago

    Thrissur, Kerala, India beBeeTechnical Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Architect in Blockchain EngineeringClients seeking high-caliber engineers trust you to excel. You are here to build a platform for financial data.You will work with skilled colleagues, relishing the pressure and privilege of solving problems that make an impact.The Role:Lead architecture and development of financial data platforms.Collaborate closely...

  • Senior Web Scraping Specialist

    1 day ago

    Thrissur, Kerala, India beBeeWebScraper Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Web Scraping Specialist">We are seeking a highly skilled and experienced Senior Web Scraping Specialist to drive our team's success.The ideal candidate will have a minimum of 4 years of hands-on experience in web scraping, with at least 2 years leading a team of 5+ developers.Key Responsibilities:">Design and develop scalable data scraping solutions...

  • Senior Azure Data Engineer

    2 days ago

    Thrissur, Kerala, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Position Overview">We are seeking a senior technical professional with extensive experience in Azure and Databricks data engineering to join our team.The ideal candidate should have a proven track record of delivering high-quality solutions with speed and precision while mentoring junior colleagues to improve their technical skills.">

  • Senior Data Engineering Specialist

    3 days ago

    Thrissur, Kerala, India beBeeDataArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About Our TeamA boutique AI and data engineering firm empowers Fortune 1000 companies through AI-powered decision intelligence.Key Responsibilities:You will be a key member of the consulting team helping clients to re-invent their corporate finance function by leveraging advanced analytics.You will design and implement data strategy in finance space which...