Senior Data Developer

6 days ago

Vizag, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 25,00,000
Job Description

As a seasoned Data Analyst, you will play a vital role in crafting data pipelines that drive business growth. Your expertise in Databricks PySpark development will enable us to efficiently process large data volumes and extract valuable insights.

The ideal candidate will have a strong background in ETL processes, with hands-on experience in designing and developing scalable data architectures using Spark RDDs, DataFrames, and Spark SQL.

  • Key Responsibilities:
  • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Collaborate with cross-functional teams to design and implement data solutions following the Medallion Architecture principles.
  • Develop and maintain high-quality data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
Required Skills and Qualifications

The successful candidate will possess the following qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
Benefits

The chosen candidate will enjoy a competitive compensation package, comprehensive benefits, and opportunities for professional growth and development.

Others

This is a unique opportunity to join our team and contribute to driving business success through data-driven insights.

  • Senior Data Development Specialist

    6 hours ago

    Vizag, Andhra Pradesh, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Development SpecialistThe Role:We are seeking a skilled data development specialist to play a key role in analyzing business requirements and designing data models to support informed decision-making.Key Responsibilities:Analyze business needs to identify data requirements and design effective data models.Design and model robust data...

  • Senior Data Engineer

    2 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 19,10,000

    **Senior Data Engineer Role**We are seeking a senior data engineer to join our team and contribute to the development of our data infrastructure.The ideal candidate will have a strong background in data engineering, with experience in designing, building, and maintaining large-scale data systems.The successful candidate will be responsible for:Designing and...

  • Senior Data Strategist

    8 hours ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are seeking experienced professionals to fill the role of Senior Data Strategist. As a member of our data-driven team, you will be responsible for developing and implementing advanced machine learning solutions.Key responsibilities include:Designing and developing predictive algorithms to solve complex business problems.Extracting actionable insights from...

  • Advanced Data Systems Developer

    5 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job Title:Senior Data Engineer", "About the Role:We are seeking an experienced data engineer to join our team. As a senior data engineer, you will be responsible for designing, developing, and automating large-scale ETL workflows using Python and Pandas.", "Key Responsibilities:Design and implement scalable ETL pipelines to handle complex supply chain...

  • Senior Data Developer

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000

    Data Engineer Position OverviewAs a Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and ETL workflows. This role requires expertise in Spark, PySpark, and SQL to manage and process large datasets.About the RoleCreate scalable and efficient data pipelines using Spark and ETL tools.Collaborate with data scientists...

  • Senior Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistKey Responsibilities:Design and develop high-performance data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and efficient data solutions.Collaborate with stakeholders to gather requirements and deliver actionable data insights.Optimize data workflows for...

  • Senior Data Architect

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About this Role:As a senior data architect, you will be responsible for designing and implementing information solutions that support business objectives. This includes discovering data and analytics requirements, developing database solutions, and collaborating with stakeholders to gather and validate requirements.Main Responsibilities:Design and implement...

  • Senior Geospatial Development Engineer

    1 week ago

    Vizag, Andhra Pradesh, India beBeeGeospatial Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Geospatial Development Engineer Avoid routine tasks, build a career that pushes boundaries. We're looking for a highly skilled Senior Geospatial Development Engineer to join our team. We are a forward-thinking company with a passion for innovation and technology. Our vision is to create cutting-edge solutions that transform industries and...

  • Senior Data Coordinator

    5 days ago

    Vizag, Andhra Pradesh, India beBeeDataManagement Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Summary:We are seeking a seasoned professional to fill the role of Senior Data Coordinator. This position involves managing project-specific and departmental documents, as well as coordinating with cross-functional teams to ensure seamless delivery.Key Responsibilities:Document Management: Responsible for tracking, reviewing, and controlling...

  • Senior Data Engineering Specialist

    4 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Data Engineer to lead a team of Senior Engineers and develop innovative data-intensive applications.The ideal candidate has 10+ years of experience in software development, with a focus on backend and data engineering. They should have hands-on experience in using Python, JVM, and Shell Scripting, as well as...