Principal Data Pipeline Architect

1 week ago

Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 36,00,000 - ₹ 48,00,000

As a skilled Data Engineer, you will play a pivotal role in designing and implementing robust data pipelines that extract insights from complex datasets. With strong expertise in Python, you will be responsible for building efficient scripts for data collection and transformation.

  • Data Pipeline Development:
  • Develop, test, and maintain Python scripts that efficiently collect and transform large datasets.

The ideal candidate will have a solid understanding of databases, with a strong proficiency in SQL and experience working with databases like PostgreSQL. They will also possess skills in version control systems (Git) and have the ability to analyze complex problems and provide actionable solutions.

Key Responsibilities:

  • Design web scraping solutions to extract structured and unstructured data from diverse sources.
  • Perform data cleaning, preprocessing, and analysis to identify patterns, trends, and insights.
  • Work with SQL and NoSQL databases for efficient data storage, retrieval, and manipulation.
  • Create interactive dashboards and visualizations to present metrics and business insights to stakeholders.
  • Collaborate with cross-functional teams to understand business needs and translate them into data-driven solutions.
  • Optimize existing data workflows and pipelines for performance and scalability.
  • Document code, workflows, and methodologies for clarity and maintainability.

Required Skills & Qualifications:

  • Bachelor's degree in Computer Science, Data Science, or a related field, or equivalent practical experience.
  • Minimum 2 years of professional experience as a Data Engineer or in a similar role.
  • Strong proficiency in Python and key data libraries (Pandas, NumPy, Scikit-learn).
  • Hands-on experience with web scraping tools and libraries (Scrapy, BeautifulSoup, Selenium).

  • Chief Data Pipeline Architect

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 82,00,000 - ₹ 1,21,00,000

    Job Title: Data EngineerSkillful and experienced data engineers are needed to design, implement, and maintain scalable data transformation pipelines using Snowflake and dbt.The ideal candidate will have a solid background in database management systems, data warehousing, and data engineering principles.Knowledge of cloud-based data platforms and experience...

  • Cloud Data Architect

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data ArchitectSummary:As a seasoned Cloud Data Architect, you will design and implement robust data pipelines using cutting-edge cloud technologies.Key Responsibilities:Develop scalable data architecture solutions for large-scale data processing systems.Collaborate with cross-functional teams to integrate data into various platforms and...

  • Data Pipeline Specialist

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Data Engineer Role SummaryAs a seasoned data professional with 10+ years of experience, you will work on challenging projects for various industries. You will design, develop, and maintain scalable data pipelines for both batch and real-time processing using GCP tools.About the PositionThis is a remote opportunity to join a leading provider of Data and...

  • Data Systems Architect

    1 week ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Systems ArchitectData systems architects design, build, and maintain large-scale data infrastructure to ensure the highest standards of data quality and performance. This role requires a proactive approach to problem-solving and collaboration with cross-functional teams.Key Responsibilities:Design, develop, and maintain scalable data...

  • Data Architect

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    **Job Summary:**We are seeking an experienced data professional to fill the role of Data Architect. In this position, you will be responsible for designing and implementing data pipelines that meet business requirements.**Key Responsibilities:Selecting and integrating Big Data tools and frameworks to provide requested capabilitiesDeveloping and maintaining...

  • Data Architect

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned Data Architect to join our team and contribute to the design and implementation of cutting-edge data solutions. The ideal candidate will have extensive experience in building and maintaining robust data pipelines, working with large-scale data projects, and collaborating with cross-functional teams.About the RoleAs a Data Architect,...

  • Principal Data Solutions Architect

    1 week ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerOur company is seeking a skilled Data Engineer to join our team. This role will involve designing and implementing data pipelines, managing deployments, and working with modern DevOps tools.The ideal candidate should have hands-on expertise in building and automating data pipelines using Python and SQL.Experience with CI/CD practices,...

  • High-Performance Data Architect Leader

    2 weeks ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,44,00,000 - ₹ 2,02,50,000

    Data Architect LeadAre you an experienced data professional seeking a new challenge? We are looking for a skilled Data Architect Lead to design and implement scalable, high-performance data pipelines using Snowflake and dbt.This role is ideal for someone with a strong background in data architecture, who can define architectural best practices and drive data...

  • Data Architect

    2 weeks ago

    Agra, Uttar Pradesh, India MGrow Full time

    Experience Level: 10+ YearsWho We AreArtefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing growth.Our broad range of data-driven solutions in...

  • Chief Data Architect

    1 week ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About usWe're a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries.Driven by a passionate team of developers, designers, and product experts, we're...