Senior Data Pipeline Specialist

18 hours ago

Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

About Our Opportunity

We are looking for a talented Data Engineer to join our team and play a key role in designing, building, and maintaining scalable data pipelines and infrastructure.

You will collaborate closely with developers, architects, analysts, and data scientists to ensure smooth, secure, and efficient data delivery across multiple products and projects.

Key Responsibilities

  • Design, build, and maintain data pipelines that power insights across the business.
  • Assemble and manage large datasets from diverse sources.
  • Automate and optimize data processes for greater efficiency and scalability.
  • Develop ETL workflows using SQL and cloud-based big data tools.
  • Build analytics tools to deliver actionable insights into business performance.
  • Collaborate with executives, product managers, and analysts to meet evolving data needs.
  • Ensure data systems are secure, reliable, and high-performing.
  • Support data scientists and analysts by creating data tools and environments for advanced analytics.

Requirements

  • Hands-on experience as a Data Engineer (2-7 years).
  • A degree in Computer Science, IT, Statistics, or a related quantitative field.
  • Advanced knowledge of SQL and relational databases.
  • Proven experience building big data pipelines, architectures, and datasets.
  • Strong analytical skills, especially in handling unstructured data.
  • Working knowledge of cloud-based big data services.
  • Familiarity with big data tools such as Hadoop, Spark, Kafka, etc.
  • Experience with ETL tools like Informatica, DataStage, or Azure Data Factory.
  • Knowledge of stream-processing systems like Storm or Spark Streaming.
  • Proficiency in scripting/programming languages such as Python, Java, or Scala.
  • Excellent communication skills and the ability to thrive in cross-functional teams.

  • Strategic Data Pipeline Developer

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer Job DescriptionOur organization is seeking a skilled Senior Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process, and store it in the Databricks Lakehouse platform. The successful candidate will integrate the data into Oracle EPM (Enterprise Performance Management) to...

  • Data Pipeline Specialist

    7 days ago

    Allahabad, Uttar Pradesh, India beBeeSenior Full time ₹ 12,00,000 - ₹ 30,00,000

    Job Title: Senior Test Engineer">The role of a senior test engineer is multifaceted, requiring expertise in designing and executing manual and automated test cases for complex data pipelines.">Key Responsibilities:">">Design and develop test cases for Azure Data Factory ETL pipelines using Python and Pytest.">Validate data transformations, mappings, and...

  • Lead Data Pipeline Specialist

    4 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior AWS Data EngineerAs a Senior AWS Data Engineer, you will design and deploy end-to-end data pipelines on the AWS cloud infrastructure. You will utilize services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Develop and implement data processing and transformation workflows using Apache Spark and SQL to support analytics and reporting...

  • Data Pipeline Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeDatabaseEngineer Full time ₹ 18,90,000 - ₹ 25,20,000

    Database Engineering and Testing SpecialistThis role presents an excellent opportunity to leverage your expertise in database engineering and testing.Key Responsibilities:Design efficient data pipelines utilizing ETL concepts and data warehouse testing methodologies.Maintain and monitor scripts for data integrity and quality.Proficiently work with RDBMS:...

  • Data Pipeline Specialist

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 12,00,000

    Job Overview:We are seeking an accomplished Data Engineer to spearhead our data pipeline initiatives.About the Role:The ideal candidate will possess experience in designing and implementing data pipelines utilizing Google Cloud Platform and Azure Databricks. Proficiency in DBT and a solid understanding of secure coding practices are essential.In addition,...

  • #Top Data Pipeline Architect

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer with deep expertise in designing, building, and operating data pipelines that support real-time clinical workflows. This is a critical role where you will create scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver...

  • Senior Data Transformation Specialist

    1 day ago

    Allahabad, Uttar Pradesh, India beBeeDataTransformation Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Data Transformation SpecialistWe are seeking an experienced professional to play a key role in ensuring the quality and integrity of our data transformations.With 5+ years of experience in QA with automation, you will leverage strong SQL skills and expertise in automation frameworks like TestNg, Selenium, SoapUI, etc.Responsibilities include:Key...

  • Senior Big Data Specialist

    21 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistWe are seeking an experienced professional to design and implement scalable data pipelines and architectures on modern cloud & big data platforms.Key Responsibilities:Design, develop, test, and deploy large-scale data processing systems and workflows using tools like Databricks (Delta Lake, Workflows, CLI, Job Clusters,...

  • Senior Data Pipeline Developer

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Highly skilled data professionals are sought after to spearhead the development of complex data pipelines. This role involves leveraging expertise in streaming data environments and frameworks such as Apache Spark, Streamsets, or Apache NIFI to ensure high-quality data delivery.Mandatory Skills:Experience with Kafka Framework, including kSQL and Mirror...

  • Data Architect Specialist

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Data Architect SpecialistWe are seeking a Senior Data Engineer to join our team of experts in cloud-native data engineering. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering automation.