Data Pipeline Specialist

1 day ago


Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Developing and Implementing Data Pipelines

We are seeking a skilled professional with proficient knowledge in Spark and SQL to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.

Key responsibilities include designing, developing, and maintaining scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark). Additionally, the candidate will integrate data from various sources, ensuring data quality and consistency.

The role also involves monitoring data pipelines and troubleshooting issues to ensure data integrity. Strong communication and collaboration skills are essential for success in this position.

Requirements
  • Minimum 2 years of work experience with Azure Synapse
  • 5 years of experience in data engineering
Benefits
  • Opportunity to work with cutting-edge technologies
  • Collaborative and dynamic work environment
Skills Required
  • Proficient in Azure Synapse/Databricks and Apache Spark
  • Strong PySpark and SQL skills for data manipulation and querying
  • Familiarity with Delta Live Tables and Databricks workflows
  • Experience with ETL tools and processes
  • Knowledge of cloud platforms


  • Gulbarga, Karnataka, India beBeeAzure Full time ₹ 75,00,000 - ₹ 1,00,00,000

    Job Title: Azure Integration SpecialistOverview:We are seeking a highly skilled Azure Integration Specialist to support our client in Dubai. The ideal candidate will have expertise in designing, developing, and deploying data pipelines using Azure Data Factory.Key Responsibilities:Troubleshoot and resolve issues with Azure Synapse Analytics, Power BI, SQL...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 60,00,000 - ₹ 1,00,00,000

    About this RoleWe're seeking a Data Transformation Specialist to build robust pipelines that transform large, messy data into high-quality structured data.


  • Gulbarga, Karnataka, India beBeeValidator Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewA Data Pipeline Validator is responsible for ensuring the integrity and quality of data pipelines. This role requires a strong understanding of data warehouse testing methodologies and ETL concepts.Responsibilities:Develop and execute test plans to validate data quality and integrityCollaborate with cross-functional teams to identify and...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Data Engineer for Financial and Crypto DomainsDescription:We are seeking a skilled data engineer to design, build, and maintain robust data pipelines for high-volume financial data. This role involves collaborating with cross-functional teams to provide clean, structured, and scalable datasets.Design end-to-end data pipelines for stocks, crypto,...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Integration SpecialistWe are seeking an experienced professional to support our data integration and ETL needs.The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations.Design and Build Pipelines: Create efficient Azure Data Factory...

  • Data Engineer

    9 hours ago


    Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a highly skilled professional to join our team in designing, building, and maintaining robust data pipelines. This role requires the ability to curate and ingest data efficiently using Azure cloud services.Key Responsibilities:Design and implement scalable data solutions that meet business requirements.Work with cross-functional...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,60,00,000

    Key Roles and Responsibilities:Data Engineers are required to design, develop, and maintain ETL/ELT data pipelines. They must be able to ingest data from various sources into our data warehouse.This includes databases and flat files. The ideal candidate will have experience with AWS Cloud services, including Lambda, DMS, and Glue.A solid understanding of...


  • Gulbarga, Karnataka, India beBeeDataPipeline Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Pipeline TesterData Pipeline Tester Job DescriptionWe are seeking a skilled data pipeline tester to fill this position. As a data pipeline tester, you will be responsible for ensuring the accuracy, consistency, and high throughput of event-driven systems.Key Responsibilities:Test ETL processes and perform data reconciliation across...

  • Data Engineer

    6 days ago


    Gulbarga, Karnataka, India beBeeDatastage Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: ETL Lead with IBM DataStageAbout the RoleWe are seeking a motivated and talented ETL developer to join our data engineering team. As an ETL lead, you will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using...


  • Gulbarga, Karnataka, India beBeeDataGovernance Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Role: Azure Data Engineer - Data Pipelines & GovernanceAbout the PositionWe are seeking a skilled Azure Data Engineer to develop, optimize, and maintain automated data pipelines in support of our data governance and analytics initiatives.Main Responsibilities:Pipeline Development - Design, build, and deploy robust ETL/ELT pipelines in Databricks...