Big Data Developer

3 weeks ago

Kollam, India Hireologist Full time

Job Title: Big Data Engineer

Location: Pune (Hybrid)

Experience - 5-7 YOE

Salary Range: ₹35–40 LPA


About the Role

We are looking for a Big Data Engineer to design, build, and scale high-performance data pipelines that power our products and insights. You’ll be working closely with product managers, architects, and engineering leads to define technical strategies and ensure the availability, reliability, and quality of data across the organization. This is a high-impact individual contributor role with ownership of critical data components and the opportunity to shape our evolving data platform.


Key Responsibilities

  • Design, build, and maintain robust data pipelines (batch and streaming) from diverse data sources.
  • Ensure high data quality, reliability, and availability throughout the pipeline lifecycle.
  • Collaborate with cross-functional teams to define technical strategy and deliver data-driven solutions.
  • Participate in code reviews, testing, and deployment to uphold engineering best practices.
  • Own and manage smaller components of the data platform with end-to-end responsibility.
  • Identify and resolve performance bottlenecks to optimize data pipelines.
  • Proactively explore and adopt new technologies, contributing as a senior individual contributor across multiple products and features.


Required Qualifications

  • 5–7 years of experience in Big Data or Data Engineering roles.
  • Strong programming skills in Java or Scala (Python acceptable with solid Big Data experience).
  • Hands-on experience with distributed processing and streaming frameworks such as Apache Spark, Kafka, Flink.
  • Experience with orchestration tools like Airflow (or equivalent).
  • Familiarity with cloud platforms (AWS, GCP, Azure) and services such as S3, Glue, BigQuery, EMR.
  • Solid understanding of data structures, algorithms, and object-oriented programming.
  • Proven ability to write clean, efficient, and maintainable code.


Tooling & Ecosystem

  • Proficiency with version control (e.g., Git) and CI/CD tools.
  • Experience with data orchestration frameworks (Airflow, Dagster, etc.).
  • Understanding of common file formats: Parquet, Avro, ORC, JSON.
  • Basic exposure to containerization (Docker) and infrastructure-as-code (Terraform a plus).

  • Big data developer

    2 days ago

    Kollam, India BayOne Solutions Full time

    Job Description:We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering,...

  • GCP Data Engineer

    2 weeks ago

    Kollam, India Insight Global Full time

    Must-Have Technical Skills: - Strong SQL (expert-level querying, performance tuning, optimization) - ETL/BI Development (data pipelines, transformations, dimensional modeling) - GCP - Big Query - DBT/ Dataform Nice-to-Have Technical Skills - AtScale (or similar cube tech), SSAS/SSIS - Marketing or paid ad experience (Adobe Click Stream, Google Ads, Meta)

  • Frontend Lead Developer

    2 days ago

    Kollam, India OneIoT Full time

    🚀 We’re Hiring – Frontend Lead Developer @ OneIoT Looking for someone who can lead from the front, get things done, and loves the thrill of building something impactful. If you have 3–6 years of hands-on experience, thrive in a startup environment, and take ownership to deliver, let’s talk. ⚠️ If you’re chasing “work-life balance,” this...

  • Data Engineer

    11 hours ago

    Kollam, India Magma Consultancy Full time

    Location: RemoteType: Part-time (20–25 hours per week)About the RoleWe are seeking a skilled Data Engineer to support our growing data operations on a part-time basis. The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers, and business teams...

  • Databricks Data Engineer

    2 days ago

    Kollam, India Insight Global Full time

    Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and optimizing data...

  • Data integration reliability and devops engineer

    2 days ago

    Kollam, India RapidBrains Full time

    Job Title: Data Integration Reliability & Dev Ops Engineer Experience: 7–10 Years Location: Remote Contract Duration: Long Term Work Time: Normal IST (with 2–3 hours overlap as per client need)We are seeking a highly skilled Data Integration Reliability & Dev Ops Engineer to join our team. This role focuses on maintaining the operational reliability and...

  • data base admin executive

    4 weeks ago

    Kollam, India EDUBEX Full time

    We are seeking a highly skilled and detail-oriented Database Administrator (DBA) to join our organization. The ideal candidate will bring deep technical expertise in SQL Server, data governance, and real-time data processing, along with strong proficiency in Microsoft Excel, Power Query, and CRM systems. You will be responsible for maintaining the...

  • data base admin executive

    2 weeks ago

    Kollam, Kerala, India EDUBEX Full time ₹ 18,00,000 - ₹ 21,60,000 per year

    We are seeking a highly skilled and detail-oriented Database Administrator (DBA) to join our organization. The ideal candidate will bring deep technical expertise in SQL Server, data governance, and real-time data processing, along with strong proficiency in Microsoft Excel, Power Query, and CRM systems. You will be responsible for maintaining the...

  • Python Developer

    4 weeks ago

    Kollam, India Alphalize Full time

    Company Description Alphalize is a leading software company specializing in providing innovative and comprehensive ERP and business solutions to a wide range of clients. With our expertise in modern technologies, including AI/ML and ERP frameworks like Odoo, we empower businesses to streamline operations, improve efficiency, and drive growth. We are...

  • Developer

    4 weeks ago

    Kollam, India Alphalize Full time

    Company Description Alphalize is a leading software company specializing in providing innovative and comprehensive ERP and business solutions to a wide range of clients. With our expertise in modern technologies, including AI/ML and ERP solutions, we empower businesses to streamline operations, improve efficiency, and drive growth. We are committed to...