Cloud-Scale Data Architect

1 week ago

Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Data Engineer

Experience:

  • 5–7 Years

Location: Hybrid

About the Role:

We are seeking a skilled Data Engineer with hands-on experience in designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.

You will work closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern Azure tools and best practices.

Key Responsibilities:

  1. Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  2. Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  3. Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  4. Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  5. Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  6. Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
  7. Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  8. Support data quality checks, logging, alerting, and observability mechanisms for production workloads.
  9. Participate in sprint ceremonies and contribute to task estimation and delivery planning.

Must-Have Skills:

  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
    • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
    • Azure Databricks – building and managing Spark jobs in PySpark.
    • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
    • Apache Kafka – consuming and processing real-time data streams.
  • Strong in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
  • Understanding of data lake architecture and modern data warehousing principles.

Nice-to-Have Skills:

  • Experience with Delta Lake, Event Hub, or Azure Stream Analytics.
  • Familiarity with infrastructure-as-code tools like Terraform or ARM templates.
  • Exposure to Data Governance, Data Quality frameworks, or metadata management.
  • Understanding of networking, security, and access control in Azure data services

Preferred Certifications:

  • Microsoft Certified: Azure Data Engineer Associate
  • Databricks Certified Associate Developer for Apache Spark
  • Azure Fundamentals (AZ-900) – optional but helpful

  • Cloud Data Architect

    1 week ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Job Title: Cloud Data ArchitectOverview:We are seeking a skilled and experienced Cloud Data Architect with hands-on expertise in designing and implementing scalable data architectures on cloud platforms. The ideal candidate will have strong knowledge of Google Cloud Platform services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a foundational...

  • Big Data Cloud Architect

    2 weeks ago

    Alleppey, Kerala, India beBeecloud Full time ₹ 40,00,000 - ₹ 50,00,000

    Big Data Cloud ArchitectWe are seeking a skilled Big Data Cloud Architect to join our team."],

  • Cloud-Native Data Architect

    2 weeks ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Platform ArchitectWe are seeking a highly skilled Platform Architect to lead the development and communication of a clear platform vision. This role involves designing end-to-end data pipelines, implementing data product storage and APIs, and driving platform governance.Key Responsibilities:Partner with cross-functional teams to define priorities and solve...

  • Cloud Architect

    1 week ago

    Alleppey, Kerala, India iVedha Inc. Full time

    Overview:Seeking a highly experienced Cloud Architect to design and oversee robust, scalable, and securecloud solutions for enterprise environments in oil & gas and other regulated industries (energy,finance, government).Key Responsibilities:Architect end-to-end cloud solutions (public, private, hybrid) with a focus on reliability, security,compliance, and...

  • Cloud Data Architect

    2 weeks ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering OpportunityWe are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) to design, build, deploy, and maintain large-scale data processing systems.About the RoleThis is an exciting opportunity for a talented individual to work on designing, developing, and deploying scalable data processing pipelines using...

  • Senior Cloud Architect

    2 weeks ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering LeadWe are seeking a visionary Senior Data Engineering Lead to lead our data engineering team. This leadership role requires a strong focus on designing, developing, and managing scalable data infrastructure and pipelines.The ideal candidate will have deep hands-on expertise with cloud-based data platforms such as AWS,...

  • Cloud Data Architect Specialist

    2 weeks ago

    Alleppey, Kerala, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Cloud Data Architect to design and implement scalable, secure data solutions in the cloud.Design and develop cloud-based data architectures to meet business requirements.Collaborate with cross-functional teams to ensure data solutions align with overall business strategy.Required Skills and QualificationsTo be...

  • Data Architect

    1 week ago

    Alleppey, Kerala, India beBeeCloudDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect - Cloud SolutionsWe are seeking an experienced Data Architect - Cloud Solutions to join our team. As a key member of the organization, you will design and develop scalable data pipelines using Azure Data Factory, Databricks, and PySpark.Key Responsibilities:Design and Develop Data Pipelines: Utilize Azure Data Factory, Databricks,...

  • Cloud Data Engineer

    1 week ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled professional to drive innovation in Big Data technologies and AWS Cloud Services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions.The role involves designing, developing, and optimizing Big Data...

  • Cloud Data Architect

    1 week ago

    Alleppey, Kerala, India beBeeDataarchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a highly skilled Data Architect to lead our data architecture and modeling efforts. The ideal candidate will be responsible for designing and implementing end-to-end data architectures leveraging Snowflake and Matillion for data ingestion, transformation, and storage.Data Architecture & Modeling: Design and implement scalable...