Building High-Performance Data Pipelines

2 days ago

Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Senior Data Engineer
Overview:

We are seeking a skilled Senior Data Engineer to collaborate with our Analytics Engineering team.

You will be responsible for designing, building and maintaining large-scale real-time stream and batch data processing systems.

The ideal candidate will have excellent programming skills in Python or Java, experience with SQL and NoSQL DBs, as well as REST APIs.

A strong understanding of distributed systems and streaming concepts is required.

Responsibilities:
  • Collaborate closely with engineering teams and product management.
  • Design and build pipelines and systems to deliver critical data insights.
  • Develop services and analytics SaaS solutions.
  • Write unit and end-to-end tests for developed code.
  • Own scalability, high availability, and data security for your services.
  • Mentor other developers in best practices.
Requirements:
  • 5+ years of working experience.
  • Proven record of building ETL and Analytics applications.
  • Excellent programming skills in Python or Java.
  • Experience with SQL and NoSQL DBs, as well as REST APIs.
  • Understanding of distributed systems and streaming concepts.
Preferred Skills:
  • Experience with modern Big Data stacks.
  • Familiarity with serverless architecture and systems.
What We Offer:
  • Competitive salary and comprehensive benefits package.
  • Opportunities for continuous career growth and development.
  • Exposure to cutting-edge technologies and advanced cybersecurity practices.

  • Data Pipeline Specialist

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled and experienced Data Engineer to drive our data strategy.This role is responsible for designing, developing, and maintaining scalable data pipelines using PySpark.Design and develop complex data pipelines utilizing PySpark and Spark SQL.Collaborate with cross-functional teams to ensure accurate data processing,...

  • Senior Data Pipeline Specialist

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Freelance Data Engineer PositionWe are seeking an experienced Freelance Data Engineer to join our team and play a key role in designing, building, and optimizing large-scale data pipelines.The successful candidate will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Designing, developing, and...

  • Building Data Pipelines and Software Solutions

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeSoftwareDeveloper Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Junior Software Developer Opportunity">We are seeking a talented and motivated Junior Software Developer to join our team. As a key member of the development team, you will be responsible for building data pipelines, automation scripts, and analytical algorithms under guidance.">Key Responsibilities:">Develop and implement data pipelines and automation...

  • Azure Data Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Azure Data Engineer RoleSeeking a skilled data engineer to design, build and maintain automated data pipelines supporting business intelligence and analytics initiatives.We're looking for an expert who can leverage their knowledge of Azure Databricks, PySpark, SQL and ETL/ELT pipeline design to develop robust data pipelines that ingest, transform and curate...

  • Chief Data Pipeline Architect

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDatabricks Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Databricks Engineer Job DescriptionThe primary objective of this role is to design, develop, and maintain scalable, secure, and high-performance data pipelines and ETL processes on Databricks.Key Responsibilities:Develop and implement data workflows that ensure performance, cost-efficiency, and reliability.Collaborate with cross-functional teams to gather...

  • High-Tech Data Pipeline Solutions Expert

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipeline SpecialistWe are seeking a highly skilled Data Pipeline Specialist to join our team in Pune. The ideal candidate will have hands-on experience with data processing, data modeling, and ensuring data quality.Key Responsibilities:Design, develop, and maintain data pipelines using Informatica and other tools to process and transform...

  • Data Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop, and optimize data ingestion pipelines.About the Role:Design and implement data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...

  • Senior Data Pipeline Developer

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionDesign and build a shared component library for data pipelines, including ingestion, parsing/normalization, extraction, validation, enrichment, and publishing.Define patterns/templates for Apache Beam pipelines and Databricks jobs, standardizing configuration, packaging, versioning, CI/CD, and documentation.Create interfaces so multiple teams...

  • Data Pipelines Engineer

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior ETL Developer – Data Pipelines EngineerLocation: RemoteJob Type: Full-timeJob DescriptionWe are seeking an experienced ETL Developer to join our data engineering team. The successful candidate will work on designing and developing efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The ideal candidate will collaborate...

  • Data Engineer

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    ETL Developer RoleWe are seeking an experienced ETL Developer to join our data engineering team.This role involves designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.About the RoleThe ideal candidate will have 4+ years of experience in ETL development with at least...