Senior Big Data Specialist

1 week ago

Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

**Data Engineering Opportunity**

We are seeking an experienced Data Engineer to join our team.

  • Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

**Requirements**

  • Strong skills in SQL, Databricks (Spark), and Python/R.
  • Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • Familiarity with YAML configuration management, debugging, and error resolution.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Senior Big Data Analyst

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Developer RoleDesign, build and maintain large-scale data processing systems with our team. You'll work on developing scalable big data solutions using Apache Spark, Hadoop and related technologies.Key Responsibilities:Design and develop high-quality code for big data processing solutions.Collaborate with cross-functional teams to deliver projects...

  • Big Data Transformation Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataExpert Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Lead ETL/Big Data TesterWe are seeking a skilled and experienced professional to join our team as a Lead ETL/Big Data Tester. The ideal candidate will have expertise in writing and executing User Acceptance tests in QA/Production labs with multiple machines/VMs.

  • GCP Big Data Engineer

    2 weeks ago

    Jamnagar, Gujarat, India People Prime Worldwide Full time

    About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful...

  • Chief Big Data Architect

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Engineer PositionWe are seeking a highly skilled data engineer to design, develop and optimize large-scale big data pipelines and distributed data processing systems. The ideal candidate will have hands-on experience with Scala, Spark (PySpark), and Python for data processing and transformation.Design and develop efficient queries using Jupyter...

  • Senior Data Infrastructure Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000

    Job TitleAs a senior data engineer, you will play a crucial role in designing and implementing scalable, reliable, and secure data infrastructure for large organizations.Design and implement data platforms that meet the needs of business stakeholders.Develop and maintain data pipelines to ensure timely and accurate data delivery.Collaborate with...

  • Big Data Solutions Architect

    2 weeks ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    About our organization: We prioritize execution, creativity and curiosity to build innovative solutions.We combine logic and expertise to help clients navigate new technology paradigms, creating impactful results.Key Skills:PySparkAirflowSQLGCPData Pipeline Engineer Roles and Responsibilities:Design, develop and optimize data pipelines using GCP services...

  • Experienced Big Data Developer Wanted

    2 weeks ago

    Jamnagar, Gujarat, India beBeeBigData Full time ₹ 20,00,000 - ₹ 35,00,000

    Big Data Developer PositionWe are seeking an experienced Big Data Developer to join our team. This is a challenging and rewarding role that will involve working with large datasets, designing and implementing solutions using Hadoop, Spark, Hive, HDFS, and Kafka.This is a leadership role in which you will have the opportunity to shape and mentor the next...

  • Senior Data Transformation Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataTransformation Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Transformation SpecialistThis is a full-time position for an experienced data transformation specialist with a renowned organization. The ideal candidate will have expertise in designing, deploying, and managing ETL processes to integrate data from various sources.Daily tasks include using ETL tools, performing data modeling, ensuring data...

  • Senior Data Migration Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeInformatician Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data Migration SpecialistWe are seeking an accomplished professional with expertise in Informatica to SSIS migration.Key Responsibilities:Leverage technical acumen to execute data migration projects, ensuring accuracy, scalability, and performance.Develop and maintain robust ETL processes for data integration and transformation.Collaborate...

  • Data Pipeline Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerDeveloping and Maintaining Scalable Data Pipelines:The ideal candidate will be responsible for developing and maintaining scalable data pipelines to support increasing data volume and complexity.Key Responsibilities:Design efficient ETL pipelines following business requirements and development standards.Perform integration...