Data Pipeline Expert

6 days ago


Hubli, Karnataka, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Senior Databricks Engineer Opportunity

We are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.

Key Responsibilities:

  • Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.
  • Implement and manage data solutions on AWS, including services like S3, Glue, Lambda, EMR, and Redshift.
  • Use CI/CD tools for automated deployment and testing of data workflows.
  • Develop infrastructure as code using Terraform to provision and manage cloud resources.
  • Collaborate with data scientists, analysts, and other engineering teams to support end-to-end data solutions.
  • Monitor, troubleshoot, and optimize performance of data pipelines and cloud infrastructure.

Required Skills and Qualifications:

  • Strong hands-on experience with Databricks (Mandatory)
  • Solid experience with AWS cloud services (Mandatory)
  • Proficiency in PySpark and distributed data processing
  • Experience in CI/CD implementation for data workflows
  • Hands-on with Terraform for infrastructure management


  • Hubli, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Azure Databricks EngineerWe are seeking an expert Senior Azure Databricks Engineer to spearhead the design, development, and optimization of data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop scalable data ingestion pipelines for integrating multiple sources into Databricks.Implement and...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job OpportunityThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.A key requirement for this role is designing, developing, and optimizing data...


  • Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Freelance Data Engineer PositionWe are seeking a seasoned Freelance Data Engineer with exceptional skills in designing, building, and optimizing large-scale data pipelines. As part of our team, you will collaborate closely with internal teams and clients to deliver robust, scalable, and high-performance data solutions.Key Responsibilities:Develop ETL/ELT...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    As a Data Engineer, you will play a pivotal role in crafting and implementing scalable data pipelines to support our growing data needs. Your expertise in Bigdata, Pyspark, Python, Hadoop/HDFS, Spark, and GCP/any cloud will enable you to collaborate with analytics and business teams to refine data models and foster data-driven decision making across the...


  • Hubli, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to design, develop, and maintain robust ETL/ELT data pipelines for our organization.Key Responsibilities:Design and develop efficient ETL/ELT data pipelines using AWS services such as Lambda, DMS, and Glue.Develop and optimize Snowflake stored procedures to implement complex business logic and...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.ResponsibilitiesDesign and implement ETL/ELT pipelines using Azure Databricks and PySpark.Develop high-quality database programming...


  • Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Our organization is seeking a highly skilled and experienced Data Engineering expert to assume key responsibilities.The ideal candidate will have:4+ years of hands-on experience with Big Data technologies – including Spark, Hadoop, and Hive;Strong analytical and problem-solving skills, with the ability to think critically;Excellent communication and...


  • Hubli, Karnataka, India beBeeBlockchain Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Backend Data EngineerA key role awaits in our organization for a highly skilled Backend Data Engineer.This is an exciting opportunity to play a pivotal part in transforming raw on-chain data into actionable insights.Develop event decoders for major DeFi protocols, such as Uniswap and Curve.Build and maintain data extractors that convert on-chain events into...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a highly skilled and experienced data engineer to play a critical role in designing, developing, and maintaining complex data pipelines.Key Responsibilities:Data Pipeline Development and MaintenanceUtilize various tools and technologies to design and implement efficient ETL pipelines.Data...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 45,00,000

    We're seeking a seasoned professional to lead the development of complex data pipelines.**Key Responsibilities:**- Design and deploy sophisticated ETL processes using Talend Open Studio.- Utilize BigQuery for advanced SQL, partitioning, clustering, federated queries.- Leverage Python for ETL scripting, automation, and integration with cloud data pipelines.-...