Senior Data Pipeline Specialist

7 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

We are seeking an experienced Data Engineer to join our team.

As a Data Engineer, you will design, build, and maintain robust data pipelines for processing channel activity data. You will work on AWS cloud infrastructure and orchestration tools like Airflow to ensure high availability, scalability, and performance.

You will collaborate with cross-functional teams to ensure data from various digital channels is effectively ingested and processed. You will contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.

Key responsibilities include:

  • Designing, building, and maintaining data pipelines for processing channel activity data.
  • Working on AWS cloud infrastructure and orchestration tools.
  • Leveraging Python for building automated data engineering solutions.
  • Collaborating with cross-functional teams.
  • Contributing to architecture decisions.

Required skills and qualifications include:

  • Proven experience working as a Data Engineer in greenfield environments.
  • AWS: Strong hands-on experience with AWS technologies.
  • Python: Proficiency in Python for data processing, automation, and pipeline development.
  • Big Data Platforms: Experience with big data technologies.

Benefits include a dynamic and collaborative work environment, opportunities for professional growth and development, and a competitive compensation package.

This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources. The ideal candidate will possess strong knowledge of AWS, Python, and has work experience in handling data from various sources such as Hadoop and Terradata.

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Senior Data Pipeline Specialist to join our team.As a Senior Data Pipeline Specialist, you will be responsible for designing and developing real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow.Design and develop scalable data pipelines that meet the needs of various business...

  • Senior Data Pipeline Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Pipeline Specialist to lead the development and maintenance of complex data pipelines and enterprise-grade data systems.Job DescriptionThe ideal candidate will have 6-15 years of experience in ETL testing, software development, and data engineering. They must be proficient in Python, SQL, DWH, CI/CD, AWS, Automation,...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    The Role of Senior Data Integration SpecialistJob Overview:We are seeking an experienced Senior Data Integration Specialist to join our team. This is a key position that will play a vital role in the smooth operation of our enterprise data integration platform.As a Senior Data Integration Specialist, you will be responsible for designing, implementing, and...

  • Data Pipeline Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Opportunity: Data Pipeline SpecialistWe are seeking a skilled data pipeline expert to validate and optimize our data transformations.ETL testing methodologies and best practicesDebugging data issues and resolving discrepanciesWorking with large datasets in cloud environmentsThe ideal candidate should have hands-on experience in Databricks, Python, SQL,...

  • Data Pipeline Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time

    Job Title: Data Pipeline SpecialistA leading IT consulting and software solutions provider is seeking a highly skilled professional to design, build, and maintain scalable and reliable data pipelines.This role involves developing ETL processes to ensure data quality, integrity, and consistency. The ideal candidate will collaborate with analysts, scientists,...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time US$ 1,00,000 - US$ 1,50,000

    Job Overview- We are seeking a highly skilled Data Pipeline Specialist to join our team. The ideal candidate will have experience building and productionizing data pipelines using industry-leading technologies.- A strong background in working with complex SQL datasets is required, as well as expertise in building efficient SQL scripts using BigQuery Syntax-...

  • Data Pipeline Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title : Data Pipeline SpecialistKey Responsibilities :Develop and manage scalable data pipelines using PySpark and SQL to drive business growth.Collaborate with cross-functional teams to implement data-driven solutions leveraging AWS services.Utilize Databricks for advanced data processing and analytics, working closely with data scientists and analysts...

  • Senior Data Solutions Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Senior Data Solutions SpecialistWe are seeking a highly skilled data solutions specialist to design and implement cutting-edge data pipelines and workflows.

  • Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Azure Data Factory SpecialistWe are seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and...

  • Senior Pipeline and GTM Data Expert

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job OpportunityPipeline and GTM Senior Data AnalystWe are seeking a skilled Senior Data Analyst to join our team. This role will involve contributing to pipeline and GTM analytics, dashboard creation and maintenance, and providing operational support for the Sales Development Representative (SDR) team.Key Responsibilities: