PySpark Data Engineer

4 weeks ago

Thrissur, Kerala, India BLS360 Full time

Role Overview

This is a contract remote role. We are seeking a highly motivated PySpark Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions. The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming and will contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure.

·         Location: India. Remote.

·         Job type: Contract

Key Responsibilities

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
  • Adhere to best practices for coding, testing, and deployment.

Required Skills & Qualifications

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Lead Data Engineer | Revenue Cycle Management Platform in Healthcare | YoE

    4 weeks ago

    Thrissur, Kerala, India Geektrust Full time

    LogixHealth, a Massachusetts-based physician-founded leader in healthcare revenue cycle management, with over 20 years of experience serving providers across 40+ states, is seeking a Senior/Principal Data Engineer to join our technology team.What You'll DoLead development of a self-service data platform for reporting and analytics.Build scalable data...

  • Senior Data Engineer

    4 weeks ago

    Thrissur, Kerala, India DAIC Full time

    Company DescriptionAs a technology consulting and delivery company, DAIC partners with businesses to unlock the power of their data, optimize their technology infrastructure, and drive data-driven success. We provide expert guidance and solutions in data analytics and cloud technologies. Our mission is to empower businesses to transform data into actionable...

  • Senior Data Scientist

    1 week ago

    Thrissur, Kerala, India Jk Lucent Pvt Ltd Full time ₹ 7,00,000 - ₹ 15,00,000 per year

    Job Title: Senior Data ScientistExperience: 5+ yearsLocation: Infopark, Koratty, KeralaJob Type: Full TimeJob Summary:We are looking for a highly skilled Senior Data Scientist to join the team at JK Lucent. The ideal candidate will bring a strong background in developing and deploying machine learning models, extracting actionable insights from complex...

  • Data science Mentor

    4 days ago

    Thrissur, Kerala, India GALTech School of Technology Pvt Ltd Full time ₹ 2,40,000 - ₹ 3,60,000 per year

    We are seeking a Lead Trainer to lead, oversee, and deliver our training programs in AI Agents, Data Science, and Data Analytics. The ideal candidate will have a solid foundation in these domains, along with a passion for teaching, mentoring, and guiding learners.Key Responsibilities:Curriculum Delivery: Deliver interactive and engaging training sessions on...

  • Python Data Science Developer

    7 days ago

    Thrissur, Kerala, India Smacar Solutions Full time ₹ 18,00,000 - ₹ 30,00,000 per year

    Job description:We are seeking Python Data Science Trainer cum Developer to lead our AI engineering and Data science course and support projects.JOB LOCATION - THRISSUR ,KeralaThe ideal candidate will have a strong background in Python programming, machine learning, deep learning, and Django web development and be enthusiastic about teaching these concepts...

  • Security Engineer for Structured Data Protection

    2 weeks ago

    Thrissur, Kerala, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job description:Short DescriptionWe're looking for a Security Engineer to:• Implement and manage IT security controls across applications and systems.• Oversee operational management and ownership of IT security areas.• Contribute to the development and refinement of security policies.• Provide technical expertise to support project objectives.•...

  • Production Engineer

    5 days ago

    Thrissur, Kerala, India Wider World Immigration Full time ₹ 4,20,000 - ₹ 8,40,000 per year

    Min Experience:Min 3 YearsJob Location:DubaiSalary Range:40-70 LPA with other BenefitsRole DescriptionThis is a full-time on-site role for a Production Engineer located inDubai. The Production Engineer will be responsible for planning, coordinating, and overseeing the manufacturing processes to ensure efficient production. Key day-to-day tasks include...

  • Data Science Trainer cum Developer

    3 days ago

    Thrissur, Kerala, India GALTech School of Technology Pvt. Ltd Full time ₹ 1,40,000 - ₹ 28,00,000 per year

    We are seeking an Python Data Science Trainer cum Developer to lead our advanced AI engineering and data science course, inspiring the next generation of data scientists. The ideal candidate will have a strong background in Python programming, machine learning, deep learning, and Django web development and be enthusiastic about teaching these concepts...

  • Data Science Trainer cum Developer

    1 week ago

    Thrissur, Kerala, India GALTech School of Technology Pvt Ltd Full time ₹ 6,00,000 per year

    We are seeking a Data Science Trainer to oversee and deliver our AI Agents, Data Science, and Data Analytics training programs. The ideal candidate will have a strong foundation in these domains, along with a passion for teaching and mentoring.Key ResponsibilitiesConduct engaging training sessions covering Python programming, Machine Learning, Deep Learning,...

  • Quality Engineer

    1 week ago

    Thrissur, Kerala, India Wider World Immigration Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Min Experience:Min 6 YearsJob Location:CanadaSalary Range:40-70 LPA with other BenefitsQuality Engineer Role And ResponsibilitiesThe primary roles and responsibilities of a quality engineer listed in many job descriptions, are:Determine what quality standards are and establish detailed guidelines about what to checkCreate blueprints and documentation for...