Data Pipeline Specialist

19 hours ago

Dindigul, Tamil Nadu, India beBeePipeline Full time ₹ 18,00,000 - ₹ 22,00,000
Job Description

We are seeking an experienced Data Pipeline Specialist with a strong background in database engineering to join our data team. The ideal candidate will be proficient in writing complex SQL queries, performing data profiling, and testing data pipelines.

The Data Pipeline Specialist will play a critical role in ensuring the integrity, accuracy, and performance of our data pipelines and dashboards. Key responsibilities include:

  • Data Profiling: Analyze source data to understand data structures, distributions, and anomalies to ensure data quality and readiness for processing.
  • Data Pipeline Testing: Validate the extraction, transformation, and loading processes to confirm data accuracy and completeness during migrations or regular data pipeline runs.
  • Test Strategy Development: Design comprehensive testing plans and strategies for data workflows, data migrations, and reporting tools.
  • Report Testing: Validate the accuracy, completeness, and performance of reports generated from the data warehouse, including front-end dashboards and backend reporting systems.
Required Skills and Qualifications
  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • Proven experience (3+ years) as a Data QA Analyst, ETL Tester, or similar role.
  • Strong proficiency in SQL (write complex, optimized queries, stored procedures, etc.)
  • Familiarity with data profiling, data validation, and data migration testing.
  • Experience with testing dashboard frontends and backend services.
  • Knowledge of databases such as SQL Server, Oracle, MySQL, or PostgreSQL.
Benefits

This is an exciting opportunity to work with a talented team and contribute to the success of our organization. We offer a dynamic and inclusive work environment, with opportunities for growth and development.

Others

We welcome applicants who share our passion for delivering high-quality data solutions. If you have a strong background in database engineering and are looking for a challenging role, we encourage you to apply.

  • Data Pipeline Tester

    16 hours ago

    Dindigul, Tamil Nadu, India beBeeAutomation Full time ₹ 12,00,000 - ₹ 15,00,000

    ETL Test SpecialistWe are seeking an ETL Test Specialist to join our team for a high-profile project. This role requires strong technical expertise and experience in testing complex data pipelines and large-scale data systems.Key Responsibilities:Perform thorough ETL testing across intricate data pipelines and large-scale data systems.Develop and execute...

  • Data Pipeline Specialist

    2 weeks ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled Senior Data Engineer to take on the challenge of building and maintaining our data pipelines.Responsibilities:Develop ETL pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client...

  • Data Pipeline Specialist

    2 weeks ago

    Dindigul, Tamil Nadu, India beBeeSoftwareEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an experienced professional to drive testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management. Additionally, the role requires experience with GitHub/Bitbucket...

  • Cloud Data Pipeline Specialist

    17 hours ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer OpportunityWe are seeking a skilled Cloud Data Engineer to support the modernization of our platform.This role involves designing data pipelines, orchestrating workflows, processing data, managing datasets, and integrating with various APIs and CI/CD Pipelines.Design and deploy data pipelines using Big Query and Google Cloud Platform...

  • Data Pipeline Specialist

    7 days ago

    Dindigul, Tamil Nadu, India beBeeSoftwareDeveloper Full time ₹ 7,50,000 - ₹ 15,00,000

    Job OpportunityWe are seeking a highly motivated and detail-oriented Trainee Engineer to join our team. The ideal candidate will have a strong foundation in software development, with a focus on building data pipelines and automation scripts.Key Responsibilities:Assist in designing and implementing data pipelines using Python programmingSupport the...

  • Senior Data Pipeline Specialist

    1 week ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewData Engineering RoleThis role involves designing and implementing robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making.The successful candidate will be responsible for ensuring the integrity, security, and performance of data processing and storage systems while collaborating with cross-functional...

  • Principal Data Pipeline Specialist

    1 week ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewAs a key team member, you will play a vital part in developing and refining data pipelines. Your expertise is crucial in ensuring that data is reliable, secure, and accessible for analytics and operations.This role offers the opportunity to work autonomously while being part of a dynamic team, tackling diverse challenges daily...

  • Senior Data Engineer

    4 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 19,00,000

    Unlock the power of data pipeline management with this exciting opportunity!About the RoleWe are seeking a Senior Data Engineer to join our team, responsible for designing and developing complex data pipelines using Airflow, Python, and Snowflake.Key Responsibilities:Design and develop robust data pipelines using Airflow and PythonIntegrate with various data...

  • Data Pipeline Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert Data Engineer WantedWe are seeking a highly skilled and experienced Data Engineer to design and develop scalable data pipelines using Spark technology.Key Responsibilities:Develop efficient and scalable data processing pipelines using Apache SparkDesign and implement robust frameworks for generating reports using Python and SparkUtilize Snowflake SQL...

  • Chief Data Pipeline Architect

    7 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    We are seeking a highly motivated and experienced Data Engineer to lead the design, build, and maintenance of robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Responsibilities:Create scalable data pipelines using cloud services (GCP, AWS, or Azure).Implement data...