Data Pipeline Specialist

2 weeks ago

Hyderabad, Telangana, India beBeeReliability Full time ₹ 15,00,000 - ₹ 19,99,900
Job Title: Data Reliability Engineer

We are seeking a highly skilled and experienced Data Reliability Engineer to join our team.

  • Key Responsibilities:
  • Design and implement reliable data pipelines using Databricks
  • Develop and maintain scalable data infrastructure using Python and SQL
  • Collaborate with cross-functional teams to ensure data quality and integrity
  • Identify and troubleshoot data reliability issues using data observability platforms

Requirements:

  • 5+ years of experience in Data Engineering
  • Strong proficiency in Python, SQL, and APIs
  • Expertise in Databricks is critical, and hands-on experience with MLOps tools such as MLflow and SageMaker is also required
  • Working knowledge of Spark and Jenkins is necessary, and exposure to Observability tools like Grafana and ELK is a plus
  • Preferred skills include basic experience with AWS, familiarity with Airflow, knowledge of Containerization, and experience with Terraform

What We Offer:

  • A competitive salary package
  • Opportunities for professional growth and development

How to Apply:

  • Submit your application with the following details:
  • Total Experience
  • Relevant Experience
  • Current CTC
  • Expected CTC
  • Notice Period
  • Current Location
  • Preferred Location
  • Are you comfortable working in a Hybrid model?

This is an immediate opportunity for a contract of 6 months, likely to extend.

  • Data Pipeline Specialist

    1 week ago

    Hyderabad, Telangana, India beBeeProfessional Full time ₹ 18,00,000 - ₹ 24,00,000

    Job OverviewThe Software Professional will design, build, and maintain complex data pipelines, datasets, dataflows, integration runtimes, and monitor pipeline executions using Azure Data Factory and Azure Synapse.Key ResponsibilitiesExtract, transform, and load (ETL) data from source systems and process large datasets using Azure Databricks.Develop advanced...

  • Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Data Engineer PositionWe are seeking a skilled data engineer to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate...

  • Data Pipeline Quality Engineer

    1 week ago

    Hyderabad, Telangana, India beBeePerformance Full time US$ 6,00,000 - US$ 10,80,000

    Job Overview:We seek a highly skilled Quality Assurance Specialist with 5-10 years of professional experience to ensure the integrity, reliability, and performance of data pipelines and AI/ML solutions within our SmartFM platform.Key Responsibilities:

  • Principal Data Pipelines Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Description">Robust Data Pipelines Engineer">We are seeking an experienced engineer to design, build, and optimize robust data pipelines for our SmartFM platform.">Key Responsibilities:">">Design, develop, and maintain scalable and efficient data ingestion pipelines from diverse sources using technologies like StreamSets, Azure Data Factory, Apache...

  • Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, as well as experience with big data tools such as HDFS/S3, Spark/Flink, Hive, HBase, Kafka/Kinesis, etc.A strong understanding of relational SQL and NoSQL databases, including...

  • Cloud Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleData Engineer Position OverviewWe are seeking an experienced data engineer to lead the development of scalable data pipelines using Apache Spark and PySpark. The ideal candidate will have a deep understanding of cloud-based data processing and hands-on experience with AWS services.Develop and maintain robust ETL/ELT pipelines on AWS using Spark and...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    We are seeking an AWS Data Engineer to design, develop and maintain data pipelines and applications using Python and PySpark.Key Responsibilities:Design and implement robust ETL pipelines using PySpark focusing on performance, scalability and data qualityCreate technical solutions for business requirements using AWS cloud services and Python/PySparkDevelop...

  • Lead Data Pipeline Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a skilled Data Engineer with a strong background in data pipeline architecture, integration, and transformation techniques.Key Responsibilities:Design, develop, test, and maintain scalable ETL data pipelines using Python.Work extensively on Google Cloud Platform (GCP) services such as:Dataflow for real-time and batch data...

  • Data Pipeline Engineer

    1 week ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 10,00,000 - ₹ 13,00,000

    Job Title: Data Pipeline Tester We are seeking an experienced professional to test our data pipelines, ensuring seamless data flow and accurate data processing. As a key member of our team, you will play a vital role in identifying and resolving data pipeline issues, collaborating closely with developers and data engineers to implement fixes. The ideal...

  • Senior Data Pipeline Testing Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataPipeline Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Data Pipeline TesterThe Data Pipeline Tester is a key member of our team responsible for ensuring the smooth operation of data pipelines.