Senior Data Developer

18 hours ago

Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Senior Data Developer

Job Description:

We are seeking a highly skilled and experienced data developer to join our data platform team. As a key member of our team, you will play a vital role in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into our data lake and data warehouse.

Key Responsibilities:

  • ETL Development:
    • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
    • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
    • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
    • Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.
    • Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.
  • Data Pipeline Management:
    • Hands-on experience in creating advanced data pipelines using Databricks Workflows.
    • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
    • Collaborate with data engineering, data science, and business intelligence teams to translate data requirements into efficient ETL workflows and pipelines.
  • Data Analysis and Query Optimization:
    • Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.
  • Project Coordination and Continuous Improvement:
    • Participate in project planning and coordination activities to ensure timely delivery of ETL solutions.
    • Stay updated on the latest developments in Databricks PySpark, Spark SQL, and related technologies, recommending and implementing best practices and optimizations.
    • Document ETL processes, data lineage, and metadata to facilitate knowledge sharing and ensure compliance with data governance standards.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Proven experience in working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Qualifications:

  • Experience with cloud platforms with a preference for AWS.
  • Experience with data platform tools such as DataBricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.

  • Senior Data Analyst

    2 hours ago

    Thrissur, Kerala, India beBeeDataAnalysis Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Analyst to lead our team in delivering high-quality datasets and visualizations.Key ResponsibilitiesDevelop advanced data visualizations using Python libraries such as pandas, matplotlib, plotly, bokeh, and dash.Create scalable and reliable solutions for data wrangling, cleaning, and transformation.Analyze complex data sets to...

  • Senior Data Integration Specialist

    7 hours ago

    Thrissur, Kerala, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Integration SpecialistOur team is seeking an experienced Senior Data Integration Specialist to lead the design and implementation of data integration solutions using Oracle Data Integrator (ODI). The ideal candidate will have a strong background in ODI, SQL/PLSQL, and data warehousing concepts.Key Responsibilities:Design and develop Extract,...

  • Senior Data Engineering Professional

    3 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a skilled professional to fill the role of Senior Data Engineer.Key Responsibilities:Develop and maintain efficient data pipelines using FiveTran, DBT Cloud, and custom frameworks.Implement client-specific data transformations for HighTouch integration.Support data ingestion and quality checks during client onboarding.Optimize...

  • Senior Business Development Specialist

    2 days ago

    Thrissur, Kerala, India beBeeExecutive Full time ₹ 12,00,000 - ₹ 16,00,000

    Key Role: Executive SoughtWe are in search of a seasoned business development professional to spearhead senior-level participation at international events and conferences.This role involves acquiring the right mix of industry leaders in AI, Data, and Technology domains through effective communication skills, persistence, and relationship-building with senior...

  • senior webflow developer

    4 weeks ago

    Thrissur, Kerala, India RR.T Full time

    Company DescriptionRight Remote Team is a managed remote solutions provider specializing in AI, Creative, and Marketing services. We enable businesses to grow remotely by leveraging our Remote Talent as a Service (TaaS), offering top-tier talent in Data, Creative, Tech, and Marketing domains. Our Agentic AI products empower modern marketing teams with...

  • Senior Data Operations Manager

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Operations ManagerWe are seeking a highly skilled and experienced Senior Data Operations Manager to lead our data operations team. As a key member of our leadership team, you will be responsible for developing and implementing strategic plans to drive business growth and improve operational efficiency.Key...

  • Senior Data Engineering Leader

    1 hour ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job OverviewWe are seeking a seasoned professional to assume the role of Senior Data Engineer Lead.About the PositionThis is an opportunity for an experienced data engineer with expertise in designing, developing, and optimizing large-scale data pipelines.The successful candidate will leverage their knowledge of cloud-based platforms, including AWS Glue,...

  • Senior Data Analyst Position

    2 hours ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Analytics LeaderIn a rapidly evolving business landscape, data-driven decision making is crucial to success. As a highly skilled Senior Data Scientist, you will lead advanced analytics initiatives, leveraging complex datasets to uncover insights and drive strategic growth.Main Responsibilities:Implement cutting-edge AI/ML frameworks to build,...

  • Senior AI Software Developer

    2 days ago

    Thrissur, Kerala, India beBeeAgentic Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Senior AI Software DeveloperWe are seeking an experienced Senior AI Software Developer to design, develop, and deploy next-generation intelligent agent solutions. The ideal candidate will have strong expertise in Python, Large Language Models (LLMs), and cloud infrastructure with the ability to build scalable multi-agent workflows and optimize...

  • Senior Data Analyst Leader

    22 hours ago

    Thrissur, Kerala, India beBeeDataDriven Full time ₹ 12,00,000 - ₹ 25,00,000

    Job DescriptionAs a senior professional in data and analytics, you will lead cross-functional teams to drive business growth through strategic insights.Key Responsibilities:Develop and execute comprehensive strategies to identify new business opportunities.Collaborate with stakeholders to define roadmaps, prioritize features, and bridge technical...