Chief Data Architect

7 days ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Title: Data Engineer

Job Description:

A skilled Data Engineer is required to architect, develop, and optimize data platforms on Azure Databricks.

Key Responsibilities:

  • Design and implement scalable data warehouses using dimensional modeling techniques.
  • Develop and optimize ETL/ELT pipelines using Python and PySpark for large-scale data processing.
  • Establish best practices for ingestion, transformation, and storage following the Bronze, Silver, Gold architecture.
  • Build and deploy distributed data applications on Azure Databricks for performance and reliability.
  • Optimize Databricks clusters, jobs, and ETL workflows for efficiency and scalability.
  • Manage Azure Data Lake Storage (ADLS) and Delta Lake with Unity Catalog for data governance, security, and compliance.
  • Develop and schedule Databricks notebooks/jobs with monitoring, alerting, and automated recovery for failures.
  • Troubleshoot, resolve bottlenecks, and follow best coding practices to improve performance and maintainability.
  • Use GitHub for version control and implement CI/CD pipelines for deployment/testing using Azure DevOps.
  • Create comprehensive documentation for data architecture, pipelines, and business processes.

Requirements:

  • 8+ years of experience as a Data Engineer with strong expertise in Azure Databricks & PySpark.
  • Proven experience in ETL/ELT pipeline development and large-scale data processing.
  • Strong understanding of Medallion architecture (Bronze, Silver, Gold).
  • Hands-on with ADLS, Delta Lake, and Unity Catalog.
  • Strong knowledge of Python, Spark optimization, and distributed computing.
  • Experience in cluster optimization and performance tuning.
  • Proficiency in GitHub, CI/CD pipelines, and Azure DevOps.
  • Excellent problem-solving skills with the ability to troubleshoot and optimize code.
  • Strong communication and documentation skills.

Preferred Qualifications:

  • Experience with data integration across multiple systems.
  • Familiarity with BI/reporting tools.
  • Exposure to data security, compliance, and governance frameworks.

  • Chief Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Chief Data ArchitectWe are seeking a highly skilled and experienced Chief Data Architect to join our team. As a key member of our organization, you will be responsible for designing, building, and maintaining efficient, reusable, and reliable code.Key Responsibilities:Design and implement data architectures that meet business requirementsDevelop...

  • Chief Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled Chief Data Architect to join our team.The ideal candidate will have a strong background in data engineering and a proven track record of designing and implementing large-scale data systems.Main Responsibilities:Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow,...

  • Chief Software Solutions Architect

    7 days ago

    Pune, Maharashtra, India beBeeSoftware Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Chief Software Solutions ArchitectAt our organization, we are seeking a highly skilled Chief Software Solutions Architect to join our team.Key Responsibilities:Design and develop scalable software architecture for our enterprise solutions.Provide technical leadership to ensure best practices in software development and system design.Lead migration...

  • 15h Left) Data Architect Consultant

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 293343NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Architect Consultant to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Data Architect...

  • Chief Application Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeApplication Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionAs a Chief Application Architect, you will be responsible for leading the effort to design, build, and configure applications. You will act as the primary point of contact and collaborate with various teams to ensure project milestones are met.Key ResponsibilitiesExpected to be a Subject Matter Expert (SME)Collaborate and manage the team to...

  • Chief Data Architect

    1 week ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Lead Data EngineerWe are seeking a highly skilled and experienced data engineer to lead our data engineering projects from inception to delivery. As a key member of our team, you will be responsible for driving initiatives to develop and continuously improve our data/AI practice.The ideal candidate will have hands-on experience with modern unified...

  • Chief Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview: We seek a seasoned Data Engineering Manager to lead our data development and analytics initiatives. This role will be responsible for architecting and optimizing data solutions, managing a cross-functional team, and implementing scalable Business Intelligence frameworks.Lead the development of relational and non-relational databases to support...

  • Chief Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 19,20,000 - ₹ 25,50,000

    Job OpportunityA senior data engineer with expertise in designing, developing and implementing scalable data pipelines is required. The ideal candidate will combine deep technical expertise with insurance domain knowledge to drive innovation and deliver business impact.Lead the end-to-end design and development of data pipelines supporting rating...

  • Chief Data Architect

    1 week ago

    Pune, Maharashtra, India beBeeData Full time US$ 1,80,000 - US$ 2,40,000

    Job OverviewThe Team Lead for Advanced Data Systems Delivery will lead a team responsible for delivering high-performance, scalable data solutions with a focus on designing and optimizing data architectures for mission-critical Tier 1 systems.This role requires deep expertise in deploying real-time and batch processing systems utilizing the AI platform to...

  • Chief Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,60,000

    Transforming Data EngineeringLead End-to-End Design and Development of Data PipelinesDevelop and implement end-to-end data pipelines to support TurboRater RQR: CPQ Rating.Architect and implement scalable, efficient, and effective Medallion Architecture for structured and semi-structured data.Drive adoption of Data Mesh principles, decentralizing ownership...