Senior Data Engineering Professional

1 week ago

Anand, Gujarat, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,60,000

Job Title: Data Engineer

We are seeking an experienced professional to lead our data engineering initiatives. The ideal candidate will have a strong background in data practices and a proven track record of building and automating large-scale data pipelines.

About the Role:

  • Main responsibilities include designing, implementing, and managing CI/CD pipelines using GitHub Actions or equivalent tools.
  • The ideal candidate will also configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • This role involves building, optimizing, and debugging Spark jobs in Databricks for large-scale data processing.
  • Automating Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks is a key part of this role.
  • The successful candidate will develop, test, and maintain robust data pipelines using Python and SQL.
  • This position requires implementing unit testing, validation, and quality checks for data workflows.
  • The professional will manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Writing and maintaining configuration files (YAML, JSON) for workflows, pipelines, and automation is also required.
  • Troubleshooting and resolving configuration or syntax issues in YAML and related files is an essential part of this role.
  • This position involves keeping critical Databricks notebooks running reliably to ensure business continuity.
  • Migrating legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI) is another key responsibility.
  • The ideal candidate will partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • This role requires putting guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

Requirements:

  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

Benefits:

  • Opportunity to work on complex data engineering projects.
  • Collaborative and dynamic work environment.
  • Possibility of career growth and professional development.

About Us:

  • We are a leading company in the field of data engineering.
  • We offer competitive compensation and benefits packages.
  • Flexible working hours and remote work options.

  • Senior Data Engineering Professional

    1 week ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering ProfessionalWe are seeking a highly skilled data engineering professional to join our organization.The ideal candidate will have a strong background in designing and developing large-scale data pipelines using technologies such as SQL, Python, and PySpark. They should also possess hands-on experience with distributed...

  • Senior Data Engineer

    2 weeks ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Design, develop, and maintain large-scale data pipelines using PySparkCollaborate with cross-functional teams to integrate data into cloud-based data platformsDevelop and implement data processing solutions using Spark SQL, DataFrame, and RDD...

  • Senior Data Engineering Leader

    2 weeks ago

    Anand, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned data engineering professional to lead our team of senior engineers in delivering high-quality features and maintaining Spark applications.The ideal candidate will have extensive experience in software development, focusing on backend and data engineering, with a strong background in Python, JVM, and Shell Scripting.A...

  • Senior Data Engineering Specialist

    6 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    About the RoleAs a Senior Data Engineer, you will be responsible for resolving complex data quality issues and implementing robust data migration strategies. This role is ideal for professionals with advanced SQL development skills, who thrive on problem-solving and collaboration.We are seeking an experienced professional to join our fast-paced, data-driven...

  • Senior Data Engineering Expert

    7 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,30,00,000

    Job Opportunity: Senior Data EngineerAbout the PositionWe seek an accomplished data professional to spearhead our data team.Main ResponsibilitiesDesign and implement scalable, modular ELT pipelines using dbt on Snowflake.Create layered data models (e.g., staging, intermediate, mart layers / medallion architecture) aligned with dbt best practices.Lead...

  • Senior Cloud Data Engineer

    6 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to design and develop robust data pipelines using scalable technologies. The ideal candidate will have deep expertise in building ETL/ELT pipelines, optimizing large-scale data processing workflows, and ensuring data quality, governance, and security.Key Responsibilities:Design, develop, and...

  • Senior Data Management Professional

    2 weeks ago

    Anand, Gujarat, India beBeeDataManagement Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Senior Data Management ProfessionalWe are seeking a highly skilled Senior Data Management professional to join our team. The ideal candidate will have expertise in data management, database design, and analytics.Key Responsibilities:Design and implement database solutions that improve efficiency and accuracy.Develop and maintain data warehouses and master...

  • Senior Data Engineer

    1 week ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 19,00,000

    Senior data engineer is responsible for designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have experience with Airflow, Python, and Snowflake, as well as strong problem-solving skills and the ability to work in a fast-paced environment.Our team is based in Pune, Bengaluru, and Chennai, and we offer a...

  • Senior Data Engineering Lead

    5 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned professional to fill the role of Senior Data Engineer with GCP, ETL.The ideal candidate will possess extensive experience in data engineering, with a strong background in Google Cloud Platform (GCP), Extract Transform Load (ETL) processes, and related technologies.Key responsibilities include designing, building, and maintaining...

  • Senior data engineer – gcp

    3 weeks ago

    Anand, Gujarat, India Xebia Full time

    ???? We're Hiring: Senior Data Engineer – GCP | Big Data | Databricks???? Locations: Chennai | Bangalore | Hyderabad | Gurugram | Jaipur | Pune | Bhopal???? Shift Timing: 2:00 PM – 10:00 PM IST???? Experience: 8+ Years???? Immediate Joiners Only (0–15 Days Notice)Are you an expert Data Engineer ready to build large-scale data platforms on Google Cloud...