Data Architect

19 hours ago

Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
Job Overview

We are seeking a highly skilled data architect to join our team. In this role, you will be instrumental in designing, developing, and maintaining data platforms to ensure efficient extraction, transformation, and loading of data from various sources.

Main Responsibilities:
  • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources.
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Design and implement data solutions following the best practices, organizing data into clear layers.
  • Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.
  • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
  • Collaborate with cross-functional teams to translate data requirements into efficient ETL workflows and pipelines.
  • Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.
  • Participate in project planning and coordination activities to ensure timely delivery of data solutions.
  • Stay updated on the latest developments in Databricks PySpark, Spark SQL, and related technologies, recommending and implementing best practices and optimizations.
  • Document ETL processes, data lineage, and metadata to facilitate knowledge sharing and ensure compliance with data governance standards.
Required Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Proven experience in working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:
  • Experience with cloud platforms with a preference for AWS.
  • Experience with data platform tools such as DataBricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.

  • Data Architect

    22 hours ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectAbout the Role:We are seeking a skilled and experienced Data Architect to design, develop, and maintain scalable data infrastructure that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will...

  • Data Architect Role

    2 hours ago

    Anantapur, Andhra Pradesh, India beBeeDataSpecialist Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Big Data SpecialistWe are seeking a talented data architect to lead our data strategy and design scalable data pipelines. The ideal candidate will have experience with distributed systems, data engineering, and cloud-based architectures.Responsibilities:Data pipeline development: Design, build, and maintain robust data pipelines for various financial...

  • Principal Data Science Architect

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeDataScience Full time ₹ 1,73,40,000 - ₹ 2,42,70,000

    Key Responsibilities:Strategic Visionary: Develop and champion a data-driven vision that aligns with business objectives.Architecture Expert: Design and architect scalable, robust data platforms and solutions to support advanced analytics and AI/ML initiatives.Model Developer & Innovator: Lead the development and implementation of advanced statistical and...

  • SAP HANA Data Architect

    18 hours ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    As a SAP HANA Data Architect, you will play a pivotal role in designing and implementing advanced data models using SAP HANA technology.The ideal candidate should have a strong background in database design, data warehousing, and business intelligence.Key responsibilities include:Designing and developing complex data models using SAP HANA SQL...

  • Senior Cloud Data Architect

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeCloudDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Cloud Data ArchitectJob Description:We are seeking a seasoned Senior Cloud Data Architect to spearhead the design, development, and optimization of our data ingestion, transformation, and governance frameworks. This role will play a pivotal part in building scalable data pipelines, implementing enterprise-grade data governance, security, and...

  • Principal Data Solutions Architect

    3 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Data Engineering expert to join our team.This role involves designing, constructing and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts and other engineers to ensure the availability, reliability and efficiency...

  • Unlock Your Potential as a Senior Data Architect

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer Job OpportunityK&K Talents is a leading provider of technical resources, offering global solutions since 1993. This position is with one of our clients in India, who is actively hiring candidates to expand their teams.Job Description:We are seeking an experienced Data Engineer to join our Data Warehouse team. As a key member of the team, you...

  • AI Engineer

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeDataIntelligence Full time ₹ 18,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Intelligence Architect to design and implement scalable data platforms that integrate structured and unstructured data sources.Key Responsibilities:Data Platform Development: Develop and implement scalable data intelligence platforms that integrate structured and unstructured data sources.Generative AI Modeling: Develop...

  • Data Architect

    22 hours ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 17,16,956 - ₹ 24,22,861

    Data Manager: A Key Role in Aviation OperationsAt the heart of any successful aviation business lies data management. The Data Manager plays a pivotal role in ensuring that data is structured, accessible, and trusted to support operational excellence and strategic decision-making.Job DescriptionThe Data Manager will be responsible for leading the design,...

  • Chief Data Strategist

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Description: We are seeking an experienced Data Architect to lead the development of our enterprise data architecture strategy. This individual will design, build, and optimize scalable and secure data ecosystems, working closely with engineers, stakeholders, and business teams.Key Responsibilities:Technical (70%):We require a seasoned professional to...