Data Pipeline Specialist

2 days ago

meerut, India beBeePlatformEngineer Full time

We're seeking a talented Platform Engineer to spearhead data pipeline design, utilizing Python, Apache Spark, and Databricks. The ideal candidate will develop and manage notebook-based workflows for data processing and automation.Must have strong experience in Python for data engineering, scripting, and automation.Solid understanding of Apache Spark and distributed data processing.Experience working with notebooks is essential.Key qualifications include:Bachelor's or Master's degree in Computer Science, Engineering, or a related field.4+ years of progressive experience as a Software Engineer, Data Engineer, or Platform Engineer.A strong background in DevOps practices, CI/CD pipelines, and cloud environments would be advantageous but not required.Data integration workflows and reusable components should be able to handle ingestion, transformation, and orchestration seamlessly.Strong emphasis on scalability and maintainability.Collaboration with cross-functional teams to drive process improvements and innovation.Foster a culture of experimentation and continuous learning.Tech stack includes:PythonApache SparkDatabricksThis role involves:Designing and implementing scalable data pipelines.Developing and maintaining notebook-based workflows.Ensuring seamless data integration and transformation.The successful candidate will be:Able to work effectively in a collaborative environment.Possess excellent communication and problem-solving skills.We offer a dynamic and supportive work environment that encourages growth and development.Competitive compensation and benefits package.Please submit your application if you're a motivated and detail-oriented professional looking to take your career to the next level.

  • Senior Data Pipeline Specialist

    2 weeks ago

    meerut, India beBeeDataPipeline Full time

    Job Summary:We are seeking a highly skilled Data Pipeline Specialist to join our team. The ideal candidate will have strong experience in data validation, SQL, ETL process testing, and working with modern data platforms.Key Responsibilities:Validate and analyze data pipelines to ensure accuracy, performance, and reliability.Test ETL processes to identify and...

  • Senior Data Pipeline Validator

    2 weeks ago

    meerut, India beBeeData Full time

    Role OverviewWe seek a skilled QA Specialist with hands-on experience in data pipeline validation and testing.Perform end-to-end testing of complex data pipelines across cloud and on-prem environments.Validate source-to-target mappings, data transformations, and business logic rules.Test integration patterns, taskflows, and data ingestion processes.Key...

  • Scalable Data Pipelines Specialist

    2 weeks ago

    meerut, India beBeeData Full time

    Job Title:Senior Pipeline SpecialistWe are seeking an experienced professional to design, build, and maintain scalable data pipelines using Python, PySpark, and AWS services.Develop, optimize, and implement ETL/ELT pipelines utilizing Python, PySpark, and AWS Glue.Implement data ingestion, transformation, and integration from diverse structured and...

  • ETL Data Specialist

    1 week ago

    meerut, India beBeeData Full time

    Job SummaryWe are seeking an experienced professional to fill the role of ETL Data Specialist. The ideal candidate will have strong skills in data pipeline testing and API validation.About the RoleThis is a challenging position that requires expertise in ETL / data pipeline testing. As an ETL data specialist, you will be responsible for testing complex data...

  • Data Pipeline Architect

    2 weeks ago

    meerut, India beBeeDataEngineering Full time

    Data Engineering ExpertWe are seeking experienced Data Engineers to join our international data platform and cloud engineering teams. These long-term freelance roles are ideal for professionals who can design and build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initiatives.Core...

  • Cloud-Based Data Pipeline Specialist

    2 weeks ago

    meerut, India beBeeDataEngineer Full time

    Job Title: Cloud-Based Data EngineerJob Summary:We are seeking a skilled Data Engineer to design and implement a robust batch processing pipeline in a cloud-based environment (AWS). The ideal candidate will have hands-on experience with NextFlow, Python, and strong DevOps expertise.Responsibilities:The consultant will be responsible for:Designing and...

  • Chief Data Pipeline Architect

    1 week ago

    meerut, India beBeeDataEngineer Full time

    Job SummaryOur organization is seeking a skilled Data Engineer to join our team. You will build scalable data pipelines that drive business insights and efficiency.Experience in Python, PySpark and Snowflake is required for this role. ResponsibilitiesDesign scalable ETL/ELT pipelines using PySpark and AWS GlueBuild data models in Snowflake to support...

  • Data Management Specialist

    2 weeks ago

    meerut, India beBeeZenOps Full time

    ZenOps Data Management SpecialistWe are seeking a highly skilled professional to join our team as a ZenOps Data Management Specialist. The successful candidate will possess strong expertise in data management, release management, and hands-on experience with the ZenOps framework and product suite.This role combines responsibilities of data migration design...

  • Data Validation Specialist

    1 week ago

    meerut, India beBeeData Full time

    Job Title: Data Validation SpecialistWe are seeking a skilled Data Validation Specialist to join our team. In this role, you will be responsible for ensuring the accuracy and completeness of data across various systems.Develop and execute test plans and scripts for data ingestion, transformation models, and system functionality.Collaborate with...

  • Optimizing Data Pipelines as a GCP Expert

    1 week ago

    meerut, India beBeeDataEngineer Full time

    Job OpportunityThreatXIntel is a leading cybersecurity firm offering tailored solutions for businesses. We monitor and test clients' digital environments to identify vulnerabilities.Our mission is to deliver reliable cybersecurity services, empowering businesses to focus on growth while safeguarding their assets.We are seeking an experienced GCP Data...