Data Pipeline Architect

1 week ago

Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 60,00,000 - ₹ 1,20,00,000
Job Summary

We're seeking a skilled Data Engineer to spearhead the development of scalable solutions.

This role is ideal for someone who thrives on early-stage challenges and loves building data pipelines from scratch.

  • Data Engineering Expertise: Develop automated systems to extract, process, and analyze large datasets.
    • Scalable Data Systems: Create multi-threaded architectures capable of handling high-volume data processing.
      • Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system.
        • Documentation & Maintenance: Keep data pipelines updated when requirements change and document logic for reproducibility.
        Requirements
        • Technical Skills:
          • Strong proficiency in Python (BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
          • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
          • Experience in handling large-scale data processing with proxy management and rate-limiting.
          • Basic knowledge of ETL processes and integration with data pipelines.
          • Soft Skills:
            • Detail-oriented, ensuring accuracy and reliability of processed data.
            • Strong problem-solving skills, particularly in adapting data pipelines to evolving requirements.
            • Curious mindset with a drive to discover new data sources.
            About Our Company

We are a tech-driven startup dedicated to solving business challenges through innovative technology and deep domain expertise.

  • Innovative Solutions: We're committed to solving real challenges that genuinely matter for our customers.
  • Rapid Innovation & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of our company.
  • Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
  • Continuous Learning: Business evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

  • Data Pipeline Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking a skilled Backend Developer with experience in Go or Rust to join our team. You will play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges (DEXs).This role is ideal for someone who enjoys low-level protocol work,...

  • Expert Data Pipelines Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeDataFlow Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Data Flow ConsultantDesign and develop scalable data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a thorough understanding of data patterns, Python, and SQL.Orchestrate complex data workflows, ensuring seamless integration and automation across data services. Manage large datasets with ease and efficiency.Key...

  • Chief Data Pipeline Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Data Engineering leader to spearhead the development of our data products and modernize existing platforms.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines and products using cloud-based services.Develop and optimize Extract, Load, Transform (ELT)/Extract, Transform, Load (ETL) processes utilizing Python for...

  • High-Performance Data Pipeline Specialist

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeAzure Full time ₹ 19,00,000 - ₹ 25,90,000

    Job Title: Azure Data Factory DeveloperWe are seeking a highly skilled Azure Data Factory developer to lead our data pipeline initiatives. The ideal candidate will possess strong hands-on experience with ADF, proficiency in T-SQL and SQL Server, and familiarity with Azure SQL Database, Azure Synapse Analytics, or Data Lake.The chosen candidate will design,...

  • Chief Data Pipeline Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We're seeking a skilled Senior Data Engineer to help us design and implement large-scale data processing systems.Key Responsibilities:Develop scalable data pipelines using Python, Scala, Spark, and PysparkCollaborate with cross-functional teams to implement data warehousing solutions using HIVE, HBase, Impala, and ParquetMaintain robust SQL queries and RDBMS...

  • Senior Data Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a seasoned data professional to spearhead the development and maintenance of our data pipelines. This role requires expertise in designing, building, and optimizing large-scale data architectures that can extract, process, and store complex data sets.The ideal candidate will have deep knowledge of data integration, ETL/ELT...

  • Cloud Data Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data ArchitectWe are seeking an experienced Cloud Data Architect to design and implement scalable data pipelines for structured and unstructured data.The ideal candidate will have a strong background in programming languages such as Scala and Spark, as well as experience with Hadoop and related tools like Apache Nifi and Airflow.You will be responsible...

  • Cloud Data Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data ArchitectRoles AvailableWe are seeking an experienced Cloud Data Architect to lead the design and implementation of large-scale data architectures.The ideal candidate will have 7+ years of experience in designing, implementing, and maintaining scalable data pipelines using cloud services.Key Responsibilities:Design and implement cloud-based data...

  • Senior Data Platform Architect

    2 weeks ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 90,00,000 - ₹ 2,10,00,000

    Key Engineering Role: Data Platform ArchitectOur organization seeks a highly skilled Data Platform Architect to lead the design and development of our enterprise data foundation. As a key member of our engineering team, you will be responsible for architecting clean, scalable models, driving data platform strategy, and enabling high-velocity product...

  • Cloud Data Architect

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data ArchitectOur organization is seeking an experienced Cloud Data Architect to join our cloud data platform team. As a key member of this team, you will be responsible for designing and implementing scalable and secure data platforms using Google Cloud Platform technologies.Your primary focus will be on building and maintaining complex data models,...