Data Pipeline Architect

6 days ago

Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,94,40,000 - ₹ 2,59,20,000
Senior Data Engineering Expert

We are seeking a seasoned data engineering expert to join our team.

Job Description:

The Senior Data Engineering Expert will be responsible for designing, building, and maintaining robust data pipelines using Python and SQL.

They will develop reusable scripts for data extraction from various structured and semi-structured file formats, write optimized and scalable queries to retrieve, clean, and transform data for analytics and reporting, integrate data from different sources including APIs and multiple databases, and work closely with analysts, data scientists, and business stakeholders to deliver clean, reliable datasets for analysis.

Required Skills and Qualifications:

  • Expert-level proficiency in writing efficient, modular, and production-grade Python code for data extraction, transformation, and loading (ETL) processes.
  • Expertise in using Pandas for complex data manipulation, cleaning, merging, and analysis of large datasets.
  • Highly skilled in writing complex SQL queries, stored procedures, and optimizing database interactions. Hands-on experience connecting Python scripts with various relational databases.
  • Extensive experience working with diverse file-based data sources such as CSV, JSON, and Excel, including parsing, transforming, and integrating them into ETL pipelines.
  • Exposure to consuming REST APIs for data ingestion and integrating multiple database sources in a unified workflow.
  • Familiarity with version control (Git), basic shell scripting, and working knowledge of data validation and performance tuning.

Benefits:

This is an exceptional opportunity to work with a talented team and contribute to the success of our organization.

Others:

As a member of our team, you will have the opportunity to grow professionally and personally, and make a meaningful impact on our organization's success.

  • Data Pipeline Architect

    2 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Job Overview">Design, Develop & Optimize Data PipelinesWe are seeking a skilled professional to join our team as a Data Engineer. In this role, you will be responsible for designing, developing, and optimizing scalable data pipelines that meet the needs of our business.">Key Responsibilities">Design and develop efficient data ingestion pipelines to collect...

  • Business Data Architect

    6 days ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 10,93,500 - ₹ 21,47,000

    Job Title: Business Data ArchitectWe are seeking a highly skilled Business Data Architect to spearhead the design and implementation of automated data pipelines, drive analytical insights, and deliver impactful business results.

  • Senior Data Architect

    3 days ago

    Noida, Uttar Pradesh, India beBeeDataDriven Full time

    Job Title: Senior Data ArchitectWe are seeking a seasoned data architect to lead the design and implementation of our AI-driven solutions.The ideal candidate will have extensive experience in designing and optimizing generative AI models and prompts, as well as collaborating with cross-functional teams to define and meet project goals.To succeed in this...

  • Data Architect

    3 days ago

    Noida, Uttar Pradesh, India beBeeDatabase Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Database ArchitectWe are seeking an experienced Database Architect to design and implement relational database structures for optimal performance.The successful candidate will write complex SQL queries, stored procedures, and functions to manage and retrieve data efficiently.Data security, backups, and disaster recovery plans are crucial for a smooth...

  • Principal Data Architect

    23 minutes ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Solutions ArchitectWe are seeking a seasoned Senior Data Solutions Architect to design and implement scalable data architectures for our enterprise workloads.This position demands a blend of strategic architecture skills and hands-on operational excellence, enabling high-performance and secure data solutions.Database Architecture & Design:...

  • Data Pipeline Specialist

    2 days ago

    Noida, Uttar Pradesh, India beBeePipeline Full time ₹ 18,00,000 - ₹ 2,59,20,000

    Job OverviewWe are seeking a skilled Data Pipeline Specialist to design and develop high-performance data ingestion pipelines using Apache NiFi.The ideal candidate will have expertise in building and maintaining real-time and batch processing workflows to ingest structured, semi-structured, and unstructured data sources into AWS-based data lakes or...

  • Lead Data Architect

    2 weeks ago

    Noida, Uttar Pradesh, India Zinnobyte Full time

    Job Title : Lead Data Architect ML & BIExperience : 10 - 15 yearsRole Overview : Zinnobyte's Client is looking for a hands-on Lead Data Architect to design and build the next-generation data, machine learning, and business intelligence platform for our HR, Payroll, and Benefits SaaS ecosystem. This is a builders role perfect for someone who thrives on...

  • Data Architect

    6 days ago

    Noida, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Data ArchitectWe are seeking an experienced Data Architect to lead the design and development of our data solutions.Key Responsibilities:Design and develop scalable data architectures using Google Cloud Platform services.Develop data pipelines to ensure data quality, security, and compliance.Migrate and deploy data across systems, ensuring...

  • Data Pipeline Specialist

    2 days ago

    Noida, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 10,00,000 - ₹ 15,00,000

    The role of a Data Pipeline Specialist involves providing critical support for data processing pipelines. This position requires troubleshooting skills to identify and resolve issues related to data processing.Collaboration with development teams is essential to resolve incidents and implement patches in a timely manner. System performance monitoring and...

  • Cloud Architect

    2 days ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description">We are seeking a highly skilled data professional to design, build, and maintain scalable data pipelines using Azure Databricks.">">The Role: Data Engineer - Cloud Architect">As a seasoned data engineer with 6+ years of experience, you will have the opportunity to work on high-profile projects, collaborating closely with cross-functional...