Big Data Architect

5 days ago

Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Data Engineering Specialist

Job Description:

We are seeking a highly skilled engineer to design, build, and maintain robust data pipelines that handle high-volume financial data. This individual will be responsible for developing scalable and efficient data architectures to meet the needs of our business.

Key Responsibilities:

  • Design and Develop End-to-End Data Pipelines: Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.
  • Integrate Third-Party APIs: Integrate third-party APIs and data feeds into internal systems.
  • Build and Optimize Data Workflows: Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Ensure Data Quality: Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with Cross-Functional Teams: Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
  • Monitor and Troubleshoot Pipeline Performance: Monitor, troubleshoot, and optimize pipeline performance.
  • Implement ETL/ELT Best Practices: Implement ETL/ELT best practices, data governance, and security protocols.
  • Contribute to Data Infrastructure Scalability: Contribute to the scalability and automation of our data infrastructure.

Requirements:

  • Experience as a Big Data Engineer: Proven experience as a Big Data Engineer / Data Engineer (preferably in financial or crypto domains).
  • Strong Expertise in Python and SQL: Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on Experience with Data Pipeline Tools: Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Cloud Platform Experience: Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • API Integrations and Real-Time Streaming: Knowledge of API integrations and handling real-time streaming data.
  • Databases and Data Modeling: Familiarity with databases (relational and NoSQL) and data modeling.
  • Financial Data Structures: Solid understanding of stocks, cryptocurrencies, and financial data structures (preferred).
  • Problem-Solving Skills: Strong problem-solving skills with the ability to handle large-scale data challenges.

  • Cloud Big Data Expert

    2 days ago

    Vellore, Tamil Nadu, India beBeeBigData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Cloud Data Architect PositionWe are seeking a skilled Cloud Data Architect to join our team. The ideal candidate will have a strong understanding of big data architecture, cloud adoption strategies, and solution design.

  • Big Data Engineer

    5 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineering RoleWe are looking for a skilled Big Data Engineer to lead our team in delivering scalable and efficient data infrastructure. The ideal candidate will have expertise in Cloudera and Linux commands, as well as strong knowledge of data migration, performance tuning, and application deployment.Key Responsibilities:Design and manage...

  • Big Data Technologist

    1 day ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryBig Data Specialist role involves working with large-scale data processing systems and technologies including PySpark, Scala Spark, and Java Spark SQL. The ideal candidate will have experience in implementation projects, building data pipelines, transformation logics, and data models.About the PositionDesign, develop, and maintain large-scale data...

  • Chief Data Architect

    1 week ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,30,00,000

    We are seeking a Senior Data Engineer to join our team of experts in designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have 5+ years of experience in data engineering or related fields, with a focus on big data technologies and cloud platforms. In this role, you will be responsible for architecting and...

  • Data Architect Leader

    2 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking an experienced data architect to lead our team in designing and implementing robust, scalable, and secure data architectures that meet business requirements. The ideal candidate will have a solid understanding of cloud-native data services, big data technologies, and data warehousing concepts.The successful applicant will also possess strong...

  • Data Architect

    2 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectWe are seeking a skilled Data Engineer to join our team.This position will be responsible for designing, building, and maintaining robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such as Hadoop and Terradata.The ideal candidate will possess strong...

  • Chief Data Architect

    6 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity: High-Performance Data ArchitectAbout the Role:We are seeking a highly skilled data architect to join our team.Key Responsibilities:Analyze and improve existing database systems for optimal performance and scalability.Establish robust database security structures and ensure regulatory compliance.Manage large-scale Cloudera Data Platform...

  • Senior Data Architect

    1 day ago

    Vellore, Tamil Nadu, India Sunfinity Technology Solutions Pvt Ltd Full time

    Location: MumbaiExperience: 8-12 yrsThe Senior Solutions Architect is a leading member of our Professional Services team. Cloudera Senior Solutions Architects function as technical leads and trusted advisors, you will work on some of the most exciting distributed data business problems at private and public sector organizations. Engage from early stage...

  • Big Data Engineer

    4 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    As a seasoned professional, you will have the opportunity to design and build large-scale data pipelines that handle massive amounts of structured and unstructured data.Key Responsibilities:Develop, implement, and maintain complex data pipelines that ensure high availability, scalability, and reliability.Own end-to-end ETL/ELT processes, focusing on...

  • Data Solutions Architect

    1 week ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    **Job Title: Data Solutions Architect**We are seeking a skilled Data Solutions Architect to join our team. The ideal candidate will have expertise in designing, building and maintaining data systems.The role involves cross-functional collaborations and ensuring highest standards of data quality and performance by extending expertise in data engineering, data...