Senior Data Engineer

4 days ago

Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: Senior Data Engineer

We are seeking a highly motivated and experienced data engineer to join our team.

The ideal candidate will have hands-on expertise in PySpark, Python, SQL, and real-time data streaming and contribute to the design and implementation of scalable data pipelines in cloud environments.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
  • Adhere to best practices for coding, testing, and deployment.

Required Skills & Qualifications:

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Senior Data Engineering Role

    4 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 40,00,000 - ₹ 60,00,000

    GreetingsSenior Data Engineer Position OverviewWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in GCP, ETL, and related technologies.The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing...

  • Senior Data Engineer

    5 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectWe are seeking a skilled Data Architect to lead our data engineering initiatives.The ideal candidate will be responsible for designing and implementing enterprise data platforms, driving innovation and adoption of new technologies, mentoring junior and mid-level data engineers, collaborating with stakeholders across teams,...

  • Senior Data Engineering Expertise

    4 days ago

    Thrissur, Kerala, India beBeeData Full time US$ 80,000 - US$ 1,50,000

    Job Description">As a senior data engineer, you will play a critical role in driving innovation and excellence in our products by designing and building scalable data pipelines that deliver critical insights to our customers and internal stakeholders.">",

  • Senior Data Engineering Professional

    5 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Engineering ProfessionalWe are seeking a seasoned data engineering expert to spearhead our data strategy and drive business outcomes.Key Responsibilities:Data Strategy and Architecture: Develop and maintain large-scale data engineering solutions using cloud-based platforms like Snowflake, Databricks, SQL databases, PySpark, Tableau,...

  • Senior Data Engineering Professional

    2 weeks ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a skilled professional to fill the role of Senior Data Engineer.Key Responsibilities:Develop and maintain efficient data pipelines using FiveTran, DBT Cloud, and custom frameworks.Implement client-specific data transformations for HighTouch integration.Support data ingestion and quality checks during client onboarding.Optimize...

  • Senior Data Engineering Leader

    1 week ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job OverviewWe are seeking a seasoned professional to assume the role of Senior Data Engineer Lead.About the PositionThis is an opportunity for an experienced data engineer with expertise in designing, developing, and optimizing large-scale data pipelines.The successful candidate will leverage their knowledge of cloud-based platforms, including AWS Glue,...

  • Senior Software Engineer for Financial Data Platform

    5 days ago

    Thrissur, Kerala, India beBeeEngineering Full time ₹ 1,94,92,000 - ₹ 2,14,73,000

    Job OverviewTalent500 is hiring for one of its clients.About Talent500:As the go-to premium destination for global job opportunities at Global Capability Centres or GCCs in India, we believe in opportunities that favor the bold.We help the best tech and non-tech talent find their dream jobs at renowned companies leading to a transformative experience career...

  • Senior AI Data Engineer

    5 days ago

    Thrissur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,50,000

    AI Data Engineer - SeniorAbout the Role:We are seeking a seasoned AI data engineer to spearhead the development of cutting-edge AI and machine learning solutions.Key Responsibilities:Design, develop, and deploy end-to-end AI/ML pipelines using Python, PyTorch, TensorFlow, Scikit-learn, and Hugging Face.Lead large-scale projects involving Large Language...

  • Senior Software Engineer

    2 weeks ago

    Thrissur, Kerala, India beBeeTechnical Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Architect in Blockchain EngineeringClients seeking high-caliber engineers trust you to excel. You are here to build a platform for financial data.You will work with skilled colleagues, relishing the pressure and privilege of solving problems that make an impact.The Role:Lead architecture and development of financial data platforms.Collaborate closely...

  • Senior Azure Data Engineer

    2 weeks ago

    Thrissur, Kerala, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Position Overview">We are seeking a senior technical professional with extensive experience in Azure and Databricks data engineering to join our team.The ideal candidate should have a proven track record of delivering high-quality solutions with speed and precision while mentoring junior colleagues to improve their technical skills.">