Senior Big Data Specialist

4 days ago

Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000
Job Title: Data Engineer

We are seeking a seasoned data professional to design, build, and maintain large-scale data pipelines.

Key Responsibilities:
  • CID/CD Pipeline Management: Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools, ensuring seamless code integration and deployment.
  • Github Branch Protection: Configure and maintain Github branch protection rules and workflows to ensure reliability and consistency.
  • Databricks Optimization: Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Automated Deployments: Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Data Pipelines Development: Develop, test, and maintain robust data pipelines using Python and SQL.
  • Unit Testing and Validation: Implement unit testing, validation, and quality checks for data workflows.
  • Multi-Environment Deployments: Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Configuration File Management: Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshooting: Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Business Continuity: Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Data Migrations: Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Collaboration: Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Data Governance: Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

  • Senior Big Data Specialist

    6 days ago

    Shimoga, Karnataka, India beBeeBigDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistSkill Set:AWS - Amazon Web ServicesPythonPysparkAbout the Role:We are seeking a skilled big data specialist to join our team. The ideal candidate will have hands-on experience with AWS, Python, and Pyspark.Responsibilities:Built pySpark applications using Spark Dataframes in PythonOptimized spark jobs that process huge...

  • Big Data Expert

    3 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    **Unlocking Big Data Opportunities:**We are seeking a highly skilled data expert to design and develop innovative solutions that drive business growth.Essential Skills:PySparkHiveDesirable Skills:SparkHBaseData Quality ToolsAgile Methodologies ExperienceExposure in Data Ingestion from Various Sources onto Big Data PlatformsRequirements:A minimum of 6-12...

  • Data Development Specialist

    3 days ago

    Shimoga, Karnataka, India beBeeDataDevelopment Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Development SpecialistJob Description:We are seeking an accomplished data development specialist to take on the key challenge of developing and maintaining high-performance data pipelines, collaborating with analytics and business teams, and implementing best practices to monitor data quality.Develops and maintains scalable data pipelines to...

  • Big Data Architectural Specialist

    6 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Transform Your Career as a Senior Data EngineerWe seek a highly skilled data professional to join our team of consultants.This role involves designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.About the Role:You will collaborate closely with data scientists, analysts, and other...

  • Big Data Engineering Solution Specialist

    4 days ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Solution Architect for Big Data EngineeringWe are seeking an experienced Solution Architect to lead the design and implementation of large-scale data engineering solutions. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Data Factory, Synapse, Fabric, and Databricks. Additionally, they should have...

  • Chief Architect: Big Data Solutions

    3 days ago

    Shimoga, Karnataka, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data LeaderLead a team of data engineers, working closely with clients and team members to understand their requirements and develop architectures that meet their needs.Key responsibilities include:Building pipelines to bring in various data from multiple sources within the organization and external sources.Collaborating with cross-functional teams to...

  • Senior Data Management Specialist

    3 days ago

    Shimoga, Karnataka, India beBeeDataManagement Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Job Title:Senior Data Management Specialist">Job Description:We are seeking an experienced Senior Data Management Specialist to support data management activities across multiple business divisions. This role involves ensuring compliance with data management policies and procedures.The ideal candidate will have 3-5 years of experience in data management,...

  • Lead Cloud Data Specialist

    1 hour ago

    Shimoga, Karnataka, India beBeeSoftwareEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Senior Software Engineer/Technical SpecialistKey Responsibilities:Develop and Optimize Data Pipelines:Design Scalable Data Architectures:Perform Data Ingestion, Transformation, and Orchestration:Write and Optimize SQL Queries:Implement CI/CD Pipelines:Collaborate with Stakeholders:Ensure Data Governance, Security, and Compliance:Monitor and...

  • Cloud Data Specialist

    3 days ago

    Shimoga, Karnataka, India beBeeCloudData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data SpecialistAbout the Role:We are seeking a highly skilled Cloud Data Specialist to collaborate with data science teams and implement complex algorithms and analytical solutions.Collaborate with cross-functional teams to design and develop scalable data pipelines.Develop predictive models to drive actionable insights for business...

  • Big Data Administrator

    3 days ago

    Shimoga, Karnataka, India beBeeCloudera Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Infrastructure SpecialistRole Overview: We are seeking an experienced professional to manage and optimize our data infrastructure.Key Responsibilities:Configure and administer distributed data storage systemsMigrate data between platforms with minimal downtimePerform in-depth analysis and optimization of system performanceProvide pre- and...