Data Pipelines Engineer

4 days ago


Hubli, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000
Big Data Specialist

We are seeking a highly skilled professional to design, develop, and maintain robust ETL/ELT data pipelines for our organization.

Key Responsibilities:

  • Design and develop efficient ETL/ELT data pipelines using AWS services such as Lambda, DMS, and Glue.
  • Develop and optimize Snowflake stored procedures to implement complex business logic and data transformations.
  • Manage and monitor scheduled data workflows using Apache Airflow.
  • Work closely with stakeholders to understand project requirements and translate them into technical solutions.
  • Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.

Requirements:

  • Proven experience as a Big Data Specialist or in a similar role.
  • Strong proficiency in SQL scripting.
  • Proficiency in Python for data manipulation and automation.
  • Experience with Apache Airflow for workflow orchestration.
  • Hands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.
  • Solid understanding of data warehousing concepts, with practical experience using Snowflake.

Benefits:

  • Competitive salary range and a collaborative work environment.


  • Hubli, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Azure Databricks EngineerWe are seeking an expert Senior Azure Databricks Engineer to spearhead the design, development, and optimization of data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop scalable data ingestion pipelines for integrating multiple sources into Databricks.Implement and...


  • Hubli, Karnataka, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Databricks Engineer OpportunityWe are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    As a Data Engineer, you will play a pivotal role in crafting and implementing scalable data pipelines to support our growing data needs. Your expertise in Bigdata, Pyspark, Python, Hadoop/HDFS, Spark, and GCP/any cloud will enable you to collaborate with analytics and business teams to refine data models and foster data-driven decision making across the...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.ResponsibilitiesDesign and implement ETL/ELT pipelines using Azure Databricks and PySpark.Develop high-quality database programming...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job OpportunityThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.A key requirement for this role is designing, developing, and optimizing data...


  • Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Freelance Data Engineer PositionWe are seeking a seasoned Freelance Data Engineer with exceptional skills in designing, building, and optimizing large-scale data pipelines. As part of our team, you will collaborate closely with internal teams and clients to deliver robust, scalable, and high-performance data solutions.Key Responsibilities:Develop ETL/ELT...


  • Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    ThreatXIntel is a startup dedicated to protecting businesses and organizations from cyber threats. Our proactive approach involves continuously monitoring and testing digital environments to identify vulnerabilities.Job DescriptionAs a data engineer, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a highly skilled and experienced data engineer to play a critical role in designing, developing, and maintaining complex data pipelines.Key Responsibilities:Data Pipeline Development and MaintenanceUtilize various tools and technologies to design and implement efficient ETL pipelines.Data...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data Engineering Specialist Job Description:We are seeking a skilled Data Engineer to join our team in designing, building, and maintaining robust data pipelines. The ideal candidate will have expertise in cloud-based data processing technologies using GCP, AWS, or Azure. This role involves working on cutting-edge data infrastructure with a...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    Data Engineer Job SummaryWe are seeking a highly skilled Data Engineer to design and implement data pipelines using GCP services. The successful candidate will have 3-7 years of experience in data engineering and possess strong skills in GCP, Python, PLSQL, and ETL.