Distributed Data Systems Architect

1 day ago

Vadodara, Gujarat, India beBeeDataEngineer Full time US$ 80,000 - US$ 1,20,000
Job Title: Distributed Data Systems Architect

This role involves building scalable data pipelines, working with real-time streaming data, and collaborating with cross-functional teams to deliver high-quality solutions.

About the Role

We are seeking a seasoned Data Engineer to design, build, and maintain large-scale distributed data systems. The ideal candidate will have hands-on experience with big data technologies, including Spark, PySpark, and SQL.

Key Responsibilities
  • Design and develop efficient data processing pipelines using Apache Spark.
  • Manage and process large datasets using distributed computing frameworks.
  • Collaborate with data scientists and product teams to integrate machine learning models into production environments.
  • Ensure data quality, scalability, and performance in all data pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
Requirements:
  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, and PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.

  • Systems Architect

    8 hours ago

    Vadodara, Gujarat, India TRS Staffing Solutions Full time

    Position: Systems Architect (Azure AI Foundry)Location: VadodaraWe are seeking a highly experienced Systems Architect with deep expertise in Azure AI Foundry to lead the design and implementation of intelligent, scalable, and secure enterprise solutions. This role requires a strategic thinker with a strong technical foundation in AI/ML systems, cloud-native...

  • ERP Systems Architect

    4 days ago

    Vadodara, Gujarat, India beBeeArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Technical Architect - ERP SolutionsWe are seeking an experienced Technical Architect to lead the design and implementation of enterprise-grade ERP solutions. This role demands deep technical expertise in architecting end-to-end ERP systems with a strong understanding of finance, supply chain, manufacturing, HR, and payroll systems.Key Responsibilities:Design...

  • Manager - Mass Distribution

    2 days ago

    Vadodara, Gujarat, India Vodafoneidea Full time ₹ 5,00,000 - ₹ 10,00,000 per year

    Vodafone Idea Limited is an Aditya Birla Group and Vodafone Group partnership. It is India's leading telecom service provider. The Company provides pan India Voice and Data services across 2G, 3G and 4G platform. With the large spectrum portfolio to support the growing demand for data and voice, the company is committed to deliver delightful customer...

  • Chief Data Architect

    2 days ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architects design and develop data systems that provide insights and drive business growth.About the Role:Develop and maintain robust data pipelines and ETL processes to load data into a centralized data warehouse.Create frameworks that improve data logging efficacy, collaborating with cross-functional teams to resolve issues.Validate data integrity...

  • Chief Data Architect

    3 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary">We're seeking a highly skilled Data Architect to join our team. In this role, you will be responsible for designing and implementing data warehouse solutions that meet business needs.The ideal candidate will have strong experience with SQL Servers and relational databases, as well as expertise in data visualization and reporting tools such as...

  • Financial Systems Architect

    1 day ago

    Vadodara, Gujarat, India beBeeFinancial Full time ₹ 1,83,60,000 - ₹ 2,43,10,000

    Job TitleFinancial Systems ArchitectPurpose:The SAP FI/CO Module Lead will be part of the global IT Center of Excellence (IT COE), playing a crucial role in the overall structure.As an expert in SAP, this individual is responsible for setting and managing the organization's SAP IT landscape in alignment with business requirements. They possess strong...

  • Marketing Data Solutions Architect

    1 day ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Marketing Data Solutions ArchitectWe're seeking a highly skilled data engineer to join our team as a marketing data solutions architect. This role is for someone who will dedicate themselves to designing and building robust, scalable data infrastructure that drives business growth and informs strategic decision-making.Key Responsibilities:Design...

  • Lead Big Data Architect

    24 hours ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Data Engineer to join our team of consultants.In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure...

  • Senior Systems Engineer

    2 days ago

    Vadodara, Gujarat, India beBeeSystemEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    Key Position: Senior Systems EngineerWe are seeking an experienced systems engineer to play a vital role in developing foundational systems that power customer experience and business operations.This is a high-impact position working on mission-critical systems that directly affect customer satisfaction and business efficiency.Main Responsibilities:The...

  • Data Intelligence Engineer

    4 days ago

    Vadodara, Gujarat, India beBeeArtificialintelligence Full time US$ 2,00,000 - US$ 2,50,000

    About the RoleWe are seeking a senior expert to lead the development of our Entity Resolution and Network Generation services within a next-generation data intelligence platform built using microservices architecture.The PlatformThe cloud-native platform leverages:Microservices architecture with Kubernetes orchestrationApache Spark for distributed...