Data Engineer

2 days ago

Coimbatore, Tamil Nadu, India ShellKode Full time ₹ 5,00,000 - ₹ 12,00,000 per year

Role Overview
We are seeking a skilled Data Engineer with 3+ years of hands-on experience in building and managing data pipelines, data models, and cloud-based analytics solutions on
Google Cloud Platform (GCP)
. The ideal candidate will have strong expertise in GCP-native services such as
BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer
, along with proven experience in SQL, Python, and ETL/ELT design.

This role requires working closely with data scientists, analysts, and business teams to ensure scalable, reliable, and high-performance data infrastructure.

Key Responsibilities

  • Data Pipeline Development

  • Design, build, and optimize scalable ETL/ELT pipelines using GCP services (Dataflow, Composer, Pub/Sub, BigQuery).

  • Ingest structured and unstructured data from multiple sources into cloud storage and warehouse solutions.

  • Data Warehousing & Modeling

  • Develop efficient and optimized data models in BigQuery.

  • Implement partitioning, clustering, and query optimization for performance and cost efficiency.

  • Cloud Infrastructure

  • Work with GCP-native tools for data integration, storage, and analytics.

  • Ensure high availability, security, and compliance of data systems.

  • Collaboration & Support

  • Partner with data scientists, analysts, and application teams to deliver reliable datasets.

  • Troubleshoot issues, monitor pipelines, and ensure SLAs for data delivery.

  • Best Practices & Governance

  • Implement data quality checks, monitoring, and lineage tracking.

  • Follow DevOps and CI/CD practices for data engineering projects.

Required Skills & Qualifications

  • 3+ years of hands-on experience in data engineering.

  • Strong expertise in GCP data services:

  • BigQuery (SQL, performance tuning, cost optimization)

  • Dataflow (Apache Beam pipelines)
  • Cloud Composer (Airflow orchestration)
  • Pub/Sub (streaming ingestion)

  • Cloud Storage, Dataproc

  • Proficiency in SQL and Python for data transformation and automation.

  • Good knowledge of ETL/ELT design, data modeling, and warehousing principles.
  • Experience with Git, CI/CD pipelines, and version control.
  • Understanding of data security, IAM, and compliance in cloud environments.

Nice-to-Have Skills

  • Familiarity with Terraform/Deployment Manager for IaC (Infrastructure as Code).
  • Knowledge of Kafka, Spark, or DBT for advanced data engineering use cases.

Skills: gcp,pipelines,data,data engineering

  • Data Engineer

    6 days ago

    Coimbatore, Tamil Nadu, India DataWeave Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionDataWeave is a digital commerce analytics SaaS platform that helps consumer brands and retailers optimize revenue and margins across online channels. Our solutions include Digital Shelf Analytics and Brand Protection for consumer brands, as well as Pricing Intelligence and Assortment Analytics for omnichannel retailers. We enable...

  • Data Engineer

    4 weeks ago

    Coimbatore, Tamil Nadu, India Mold Masters Full time

    Job DescriptionAs a Data Engineer in our Business Reporting Centre, you will manage the data workflow from various ERP systems to our data warehouse. Your role includes overseeing ETL processes, maintaining data quality and integrity, and developing a secure data warehouse infrastructure.Key Responsibilities:- Design and implement ETL processes for data...

  • Data Engineer

    17 hours ago

    Coimbatore, Tamil Nadu, India Reveille Technologies,Inc Full time ₹ 14,00,000 - ₹ 14,40,000 per year

    We're Hiring | Data Engineer – FTELocation:CoimbatoreExperience:3–5 YearsCTC:Up to ₹14 LPAImmediate Joiners OnlyJoin our growing team as aData Engineerand work on exciting data-driven solutions using cutting-edge cloud and big data technologies.Key Skills:Data Engineering fundamentalsAWS Cloud ServicesPython / PySparkDatabricks Apply now : ./

  • Data Engineer

    16 hours ago

    Coimbatore, Tamil Nadu, India Augusta HiTech Software Full time US$ 1,50,000 - US$ 2,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: SQL, PythonWorking Shift: 2PM to 11PM ISTCity: CoimbatoreCountry: IndiaJob Title: Senior Data EngineerLocation: [Insert Location or "Remote"]Job Type: [Full-time / Contract]Experience Level: 8+ YearsOverviewWe are seeking a highly experienced Data Engineer with a strong background in SQL and Python. The...

  • Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India Incept Labs Full time

    Position: Software Engineer (Data)Location: Remote, IndiaAt Incept Labs, we believe the future of education and research lies in humans and AI workingtogether side by side. AI brings the ability to process knowledge at scale, while peoplecontribute imagination, values, and lived experience. When combined, they create a partnershipwhere each strengthens the...

  • Data Engineer

    13 hours ago

    Coimbatore, Tamil Nadu, India Prognova Partners Pvt Ltd Full time ₹ 47,000 - ₹ 18,18,638 per year

    Job Title: Data EngineerLocation: CoimbatoreExperience: 3 – 5 yearsResponsibilities:Design, build, and maintain robust ETL/ELT pipelines to process large-scale property data.Collaborate with UK-based data analysts and developers to ensure smooth, clean data flow into dashboards and reports.Develop and manage data lakes and data warehouses using Azure...

  • GCP Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtreeKey Skill : GCP Data EngineerLocation: Coimbatore/Nagpur/Indore/BhubaneswarMandatory Skills :GCP Data Engineer.Job Title GCP Data EngineerExperience Required 3 to 12 yearsMust Have Skills GCP services,BigQuery Dataflow,Dataproc Cloud Composer.GCP Professional Data Engineering certification is a plusJob DescriptionWe are seeking an...

  • GCP Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtreeKey Skill : GCP Data EngineerLocation: Coimbatore/Nagpur/Indore/BhubaneswarMandatory Skills :GCP Data Engineer.Job Title GCP Data EngineerExperience Required 3 to 12 yearsMust Have Skills GCP services,BigQuery Dataflow,Dataproc Cloud Composer.GCP Professional Data Engineering certification is a plusJob DescriptionWe are seeking an...

  • AWS Data Engineer

    2 weeks ago

    Coimbatore, Tamil Nadu, India Reveille Technologies Full time

    Job Summary :We are seeking a highly skilled AWS Data Engineer with 3-5 years of experience to enable data-driven operations and decision-making in an agile, product-centric environment. The ideal candidate will have extensive hands-on experience with Python and big data platforms on AWS, including Redshift, Glue, and Lambda. You will be responsible for...

  • Gcp data engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India LTIMindtree Full time

    Greetings from LTIMindtreeKey Skill : GCP Data EngineerLocation: Coimbatore/Nagpur/Indore/BhubaneswarMandatory Skills : GCP Data Engineer.Job Title GCP Data EngineerExperience Required 3 to 12 yearsMust Have Skills GCP services, Big Query Dataflow, Dataproc Cloud Composer.GCP Professional Data Engineering certification is a plusJob DescriptionWe are seeking...