Principal Data Architect

1 week ago

Anand, Gujarat, India beBeeDataEngineer Full time

Job Summary

">

We are seeking a highly skilled Data Engineer with 4+ years of experience in designing, building, and optimizing ETL pipelines using Azure Cloud technologies. The ideal candidate will have hands-on experience working with Databricks, managing large-scale data processing workflows, and implementing data transformation workflows for high-performance data processing.

">

Key Responsibilities

">
  • Design and develop scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.">
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.">
  • Work extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Database, and related services.">
  • Troubleshoot, debug, and resolve job failures by identifying root causes.">
  • Optimize data processing jobs for performance and cost efficiency.">
  • Collaborate with business and technical teams to gather requirements and translate them into effective data solutions.">
  • Develop reusable and efficient data engineering solutions following best practices.">
  • Maintain detailed documentation for solutions, processes, and troubleshooting guides.">
">

Technical Skills Required

">
  • Microsoft Certified: Azure Fundamentals (preferred)">
  • Microsoft Certified: Azure Data Engineer Associate (preferred)">
  • Strong programming skills in Python and Scala">
  • Hands-on experience with Spark (PySpark & Scala Spark)">
  • Proficiency in SQL for data querying and transformation">
  • Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks">
  • Strong understanding of ETL pipeline design and implementation">
  • Proven ability to troubleshoot jobs and analyze root causes effectively">
">

About the Role

">

This is an exciting opportunity to join our team as a highly skilled Data Engineer. If you are passionate about designing, building, and optimizing ETL pipelines, this role is for you.

">

What We Offer

">

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development.

"]},

  • Principal Python Software Architect

    5 days ago

    Anand, Gujarat, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Principal Python Software ArchitectWe are seeking an experienced software professional with hands-on expertise in designing and developing large-scale data processing systems using Apache Beam, Databricks, and Python.Key Responsibilities:Designing and implementing efficient data processing pipelines using Apache Beam and Python.Developing and...

  • Data Architect Specialist

    5 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, build, and optimize scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.

  • Principal Data Architect

    7 days ago

    Anand, Gujarat, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 18,00,000

    We are seeking a highly skilled Senior Database Administrator to support our data infrastructure.This role blends traditional DBA responsibilities with modern data engineering tasks to ensure optimal performance of critical database systems.Data Architecture & Scalability: Redesign and improve JSON blob storage strategies that have reached scalability...

  • Data Architect

    5 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 8,00,000 - ₹ 14,00,000

    Job Title: Data ArchitectWe are seeking an experienced Data Architect to play a key role in designing and implementing scalable data processing solutions within Azure Synapse Analytics.Main Responsibilities:Data Warehousing and Azure Synapse AnalyticsDesign and implement efficient data models and ETL processes to drive business growth.Collaborate with...

  • Principal Architect

    1 day ago

    Anand, Gujarat, India beBeeArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Site Architect Job SummaryThe ideal candidate will have excellent design and presentation skills, as well as strong communication, leadership, and problem-solving skills.Excellent design and presentation skillsIdentifying and addressing architectural challengesSite coordination and identifying and resolving site challenges proactivelyWorking Drawings and...

  • Strategic Data Architect

    1 day ago

    Anand, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data ArchitectWe are seeking an experienced and dynamic Cloud Data Architect to drive the full lifecycle of our data engineering solutions.The ideal candidate will have 10-12 years of experience in designing and developing robust, scalable, and secure data architectures that meet business requirements.Key Responsibilities:Design and develop data...

  • Financial Architect

    5 days ago

    Anand, Gujarat, India beBeeDevelopment Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleOracle EPM FCCS Principal/Sr Principal Consultant sought with 8+ years' experience.Job Locations - PAN India (Bangalore, Mumbai, Pune, Hyderabad, Chennai, Noida, Gurgaon, Kolkata, Gandhinagar)Establish long-term relationships with customers through annuity-based service contracts and project-based one-time services. Offshore Hub catering to the...

  • Master Data Architect Specialist

    7 days ago

    Anand, Gujarat, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned data expert to take on the role of Data Architect at our organization.The successful candidate will have a strong background in data engineering, including data warehousing, ETL, and data governance. Proficiency in languages such as Python, Scala, or Java, and experience with Databricks APIs, Spark, and Delta Lake is required.This...

  • Visionary Systems Architect

    3 days ago

    Anand, Gujarat, India beBeeBackend Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Principal EngineerWe are seeking a highly skilled technologist to drive system design and platform architecture decisions.The ideal candidate will have 8-12 years of backend development experience, deep Java expertise (Spring Boot, Hibernate), and hands-on developer skills who can code, architect, and lead by example.The selected individual will own...

  • Scalable Data Solutions Architect

    1 day ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineer - Cloud ArchitectWe are seeking an experienced Cloud Architect and Data Engineer to help build and optimize scalable, high-performance data solutions on Databricks. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture.Key Responsibilities:Design,...