Chief Data Architect

1 week ago

Bellary, Karnataka, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

We are seeking a highly skilled Data Architect to join our team. As a key member of the data platform implementation team, you will be instrumental in designing, developing and maintaining ETL processes to ensure efficient extraction, transformation and loading of data from various sources into our data lake and data warehouse.

Key Responsibilities:

  • Design and develop ETL processes using Databricks PySpark to extract, transform and load data from heterogeneous sources into our data lake and data warehouse.
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver and Gold layers.
  • Ensure data is appropriately cleansed, enriched and optimized at each stage to support robust analytics and reporting.

Data Pipeline Management:

  • Hands On experience in creating advanced data pipelines using Databricks workflows
  • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity and reliability throughout the ETL lifecycle.
  • Collaborate with data engineering, data science and business intelligence teams to translate data requirements into efficient ETL workflows and pipelines.

Project Coordination and Continuous Improvement:

  • Participate in project planning and coordination activities to ensure timely delivery of ETL solutions.
  • Stay updated on the latest developments in Databricks PySpark, Spark SQL and related technologies, recommending and implementing best practices and optimizations.
  • Document ETL processes, data lineage and metadata to facilitate knowledge sharing and ensure compliance with data governance standards.

Required Skills:

  • Bachelor's degree in Computer Science, Engineering or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation and analysis.
  • Proven experience in working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

PREFERRED SKILLS:

  • Experience with cloud platforms, preferably AWS.
  • Experience with data platform tools such as DataBricks, Snowflake and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL or related technologies.

  • Chief Data Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Chief Data Architect to join our organization in India. This role offers the opportunity to work on complex data projects, collaborate with talented professionals, and contribute to the success of our business.Job Description:The successful candidate will be responsible for designing, building, and maintaining large-scale data...

  • Chief Marketing Data Architect

    1 week ago

    Bellary, Karnataka, India beBeeAnalytics Full time ₹ 1,44,00,000 - ₹ 1,92,00,000

    Marketing Data Governance ExpertThe successful candidate will play a pivotal role in the Chief Data Office, directly supporting the Global Director of Enterprise & AI Stewardship and Delivery – Engage-to-Consume. This key position partners with global, regional, and business leaders to analyze, document, optimize, and orchestrate enterprise data for...

  • Chief Systems Architect

    15 hours ago

    Bellary, Karnataka, India beBeeLeadership Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Chief Systems ArchitectAbout the Role:We are seeking a highly experienced Chief Systems Architect to lead the development of high-speed communication protocol-based solutions.Main Responsibilities:Design and implement system architecture for high-speed protocols such as Ethernet, PON, and OTN.Leverage expertise in developing IPs to create...

  • Chief Physical Design Architect

    18 hours ago

    Bellary, Karnataka, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Chief Physical Design ArchitectWe are seeking a highly skilled Chief Physical Design Architect to lead our team in delivering high-quality designs.Develop block-level physical design from RTL/Netlist to GDSII using advanced tools and techniques.Ensure physical, timing, and power signoff at the block level, adhering to industry standards and best...

  • Chief Data Architect

    2 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to join our team. As a key member of our data organization, you will design and build scalable data pipelines, infrastructure, and tools that power insights across our business.You will collaborate closely with developers, architects, analysts, and data scientists to ensure smooth, secure,...

  • Chief Data Architect

    1 week ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock the Power of Data Engineering\Entities In this pivotal role, you will be instrumental in architecting and implementing robust data pipelines that fuel business growth. Working closely with cross-functional teams, you will identify opportunities for data acquisition, develop analytical tools and programs, and collaborate to improve data models.Key...

  • Chief Data Architect

    2 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleWe are seeking a visionary Data Engineer to lead the design and implementation of scalable, high-performance data solutions that support Sales, Marketing, Manufacturing, Finance, and Engineering across a world-class manufacturing organization.This is an exciting opportunity to work with a talented team of professionals who share your passion for...

  • Chief Data Solutions Architect

    5 days ago

    Bellary, Karnataka, India beBeeCloudDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Cloud Data EngineerWe are looking for a Cloud Data Engineer to join our team.Location: BangaloreWork Model: HybridExperience: 5-7 yearsNotice Period: Immediate- 15 daysOpen roles: 22The candidate will be responsible for end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWS. Strong expertise in architecting...

  • Chief Data Architect

    2 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a Senior Data Engineer to develop and optimize data-driven products and services for our product suite, including data lakehouse, data access APIs, and reporting.The successful candidate will be responsible for designing and architecting future-state solutions, maintaining conceptual, logical, and physical product data models,...

  • Chief Data Architect

    1 week ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Apache Druid Data EngineerThis role involves working with a cutting-edge data analytics platform, leveraging the power of Apache Druid to drive business insights and decision-making. As a seasoned professional in this space, you will be responsible for designing, building, and maintaining complex data pipelines, ensuring seamless integration with...