Cloud Data Architect with Big Data, Analytics, Cloud Computing

2 days ago

Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,50,00,000
Senior Data Engineer Position

We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing large-scale data systems using Databricks and AWS.

Key Responsibilities:

  • Analyze existing data warehouse implementations to support migration and consolidation efforts.
  • Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.
  • Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation.
  • Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks.
  • Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards.
  • Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform.
  • Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability.
  • Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination.
  • Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform.
  • Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming.
  • Triage, debug, and fix technical issues related to Data Lakes.
  • Maintain and manage Code repositories like Git.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field.
  • 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations.
  • 3+ years of experience in designing and implementing data lake architectures on Databricks.
  • Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures.
  • Hands-on experience with data modeling and warehouse design principles.
  • Proficiency in at least one programming language (Python, Scala, Java).
  • Experience working in Agile environments and contributing to iterative development cycles.

Preferred Skills:

  • Databricks cloud certification is a big plus.
  • Exposure to enterprise data governance and metadata management practices.

  • Cloud Data Architect

    7 hours ago

    Tirupati, Andhra Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud and Big Data ArchitectWe are seeking a skilled Cloud and Big Data Architect to join our team.This is a full-time role offering flexibility for remote work. The ideal candidate will have hands-on experience in Azure, proficient in Big Data technologies, and a strong understanding of data management principles and best practices.Key responsibilities...

  • Cloud Data Architect

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeDataGovernance Full time ₹ 1,72,80,000 - ₹ 2,59,20,000

    Job DescriptionPixeldust Technologies is seeking an experienced Data Governance Specialist to design, develop and manage enterprise data solutions on Google Cloud Platform (GCP).The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration with expertise in delivering scalable,...

  • Senior Big Data Architect

    7 days ago

    Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ArchitectJob Summary:About this Role:We are seeking an experienced and strategic technology leader with expertise in designing and delivering scalable data solutions using Microsoft Azure, Databricks, and Big Data platforms.The ideal candidate will lead a team of talented engineers to architect and oversee the development of...

  • Big Data Engineer Manager

    5 days ago

    Tirupati, Andhra Pradesh, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Engineer Manager - Cloud ArchitectureOverviewWe are seeking a highly experienced and strategic engineering manager to lead our team of data engineers. The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The successful candidate will design and deliver scalable data pipelines and analytics...

  • Cloud Data Architect

    7 hours ago

    Tirupati, Andhra Pradesh, India beBeeCloudDataArchitect Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Cloud Data ArchitectAbout the Role:We are seeking a skilled Cloud Data Architect to design and implement large-scale data processing systems using AWS technologies.The ideal candidate will have strong expertise in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions. They should be proficient in Lambda or...

  • Cloud Data Architect

    6 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data ArchitectWe are seeking an experienced AWS data engineer to join our team. This role involves designing, building, and maintaining scalable and reliable data pipelines on AWS.Key Responsibilities:Design and build data pipelines that integrate with various systems and applications.Lead end-to-end data migration projects ensuring data...

  • Cloud Data Engineering Position

    7 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Specialist We are seeking an experienced data engineer to join our team. Key Responsibilities:Design and implement large-scale data pipelines using cloud-based services.Develop data solutions utilizing cloud platforms and possess proficiency in programming languages such as SQL and Python.Collaborate with cross-functional teams...

  • Senior Big Data Architect

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000

    We are seeking an experienced professional to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks.The ideal candidate will have strong expertise in big data environments, ETL/ELT workflows, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases.

  • Cloud Data Architect

    5 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 24,50,000

    Job Title: Cloud Data ArchitectThe successful candidate will design and build scalable data pipelines to efficiently curate and ingest data.They will work with Azure cloud services to deploy and manage robust data solutions, utilizing CI/CD pipelines for seamless workflows.Cross-functional collaboration is essential to ensure data integrity, security, and...

  • Big Data Architect

    7 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer - Large Scale Data PlatformsWe are seeking a seasoned Senior Data Engineer to design and build robust data pipelines for ingestion, transformation, and analytics. The ideal candidate will have expertise in the GCP ecosystem and hands-on experience with Big Data tools such as Hadoop, Spark, and Kafka.The selected professional will be responsible...