Data Engineer

2 weeks ago

Coimbatore, India R Systems Full time

Job Title: Data Engineer

Contract Period: 12 Months

Location: Offshore candidates accepted (Singapore Based Company)

Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)


Experience

  • Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)
  • Proven experience in Python, Spark, and PySpark (non-negotiable).(mandatory*)
  • Hands-on in building ETL pipelines, real-time streaming, and data transformations.
  • Worked with data warehouses, cloud platforms (AWS/Azure/GCP), and databases.


✅ Technical Skills

  • Spark Core API: RDDs, transformations/actions, DAG execution.
  • Spark SQL: DataFrames, schema optimization, UDFs.
  • Streaming: Structured Streaming, Kafka integration.
  • Data Handling: S3, HDFS, JDBC, Parquet, Avro, ORC.
  • Orchestration: Airflow/Prefect.
  • Performance Tuning: Partitioning, caching, broadcast joins.
  • Cloud Deployment: Databricks, AWS EMR, Azure HDInsight, GCP Dataproc.
  • CI/CD: Pytest/unittest for Spark jobs, Jenkins, GitHub Actions.


✅ Education & Soft Skills

  • Bachelor’s/Master’s in Computer Science, Computer Engineering, or equivalent.
  • Strong analytical, problem-solving, and communication skills.


About the Role

We are seeking an experienced Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.


Key Responsibilities

  • Design, build, and optimize data pipelines and ETL workflows.
  • Manage and process large datasets using Spark, PySpark, and SQL.
  • Build and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with data scientists and product teams to integrate AI/ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate testing and deployment of Spark jobs via CI/CD pipelines.


Requirements

  • Bachelor’s/Master’s degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).


Budget

  • Onshore: As per market standards.

  • Database Engineer

    2 weeks ago

    Coimbatore, India Sun Data Tech Full time

    At Sun Data Tech, we cultivate an environment where passion meets purpose, empowering individuals to thrive both personally and professionally. Our foundation rests on the pillars of teamwork, integrity, and a commitment to excellence, fostering a culture of innovation and mutual respect. Here, challenges are opportunities, and every voice contributes to our...

  • Data Engineer

    6 days ago

    Coimbatore, Tamil Nadu, India DataWeave Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionDataWeave is a digital commerce analytics SaaS platform that helps consumer brands and retailers optimize revenue and margins across online channels. Our solutions include Digital Shelf Analytics and Brand Protection for consumer brands, as well as Pricing Intelligence and Assortment Analytics for omnichannel retailers. We enable...

  • Data Engineer

    4 weeks ago

    Coimbatore, Tamil Nadu, India Mold Masters Full time

    Job DescriptionAs a Data Engineer in our Business Reporting Centre, you will manage the data workflow from various ERP systems to our data warehouse. Your role includes overseeing ETL processes, maintaining data quality and integrity, and developing a secure data warehouse infrastructure.Key Responsibilities:- Design and implement ETL processes for data...

  • Data Engineer

    2 weeks ago

    Coimbatore, India Reveille Technologies,Inc Full time

    We're Hiring | Data Engineer – FTE Location:Coimbatore Experience:3–5 Years CTC:Up to ₹14 LPA Immediate Joiners Only Join our growing team as aData Engineerand work on exciting data-driven solutions using cutting-edge cloud and big data technologies. Key Skills: Data Engineering fundamentals AWS Cloud Services Python / PySpark Databricks Apply now : ...

  • Data Engineer

    1 day ago

    Coimbatore, Tamil Nadu, India Reveille Technologies,Inc Full time ₹ 14,00,000 - ₹ 14,40,000 per year

    We're Hiring | Data Engineer – FTELocation:CoimbatoreExperience:3–5 YearsCTC:Up to ₹14 LPAImmediate Joiners OnlyJoin our growing team as aData Engineerand work on exciting data-driven solutions using cutting-edge cloud and big data technologies.Key Skills:Data Engineering fundamentalsAWS Cloud ServicesPython / PySparkDatabricks Apply now : ./

  • Data Engineer

    2 weeks ago

    Coimbatore, India Augusta HiTech Software Full time

    Industry: IT Qualification: Any Degree Required Skills: SQL, Python Working Shift: 2PM to 11PM IST City: Coimbatore Country: India Job Title: Senior Data EngineerLocation: (Insert Location or "Remote")Job Type: (Full-time / Contract)Experience Level: 8+ Years Overview We are seeking a highly experienced Data Engineer with a strong background in SQL and...

  • Data Engineer

    24 hours ago

    Coimbatore, Tamil Nadu, India Augusta HiTech Software Full time US$ 1,50,000 - US$ 2,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: SQL, PythonWorking Shift: 2PM to 11PM ISTCity: CoimbatoreCountry: IndiaJob Title: Senior Data EngineerLocation: [Insert Location or "Remote"]Job Type: [Full-time / Contract]Experience Level: 8+ YearsOverviewWe are seeking a highly experienced Data Engineer with a strong background in SQL and Python. The...

  • Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India ShellKode Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Role OverviewWe are seeking a skilled Data Engineer with 3+ years of hands-on experience in building and managing data pipelines, data models, and cloud-based analytics solutions onGoogle Cloud Platform (GCP). The ideal candidate will have strong expertise in GCP-native services such asBigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer, along with...

  • Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India Incept Labs Full time

    Position: Software Engineer (Data)Location: Remote, IndiaAt Incept Labs, we believe the future of education and research lies in humans and AI workingtogether side by side. AI brings the ability to process knowledge at scale, while peoplecontribute imagination, values, and lived experience. When combined, they create a partnershipwhere each strengthens the...

  • Data Engineer

    2 weeks ago

    Coimbatore, India Prognova Partners Pvt Ltd Full time

    Job Title: Data EngineerLocation: CoimbatoreExperience: 3 – 5 years Responsibilities: Design, build, and maintain robust ETL/ELT pipelines to process large-scale property data. Collaborate with UK-based data analysts and developers to ensure smooth, clean data flow into dashboards and reports. Develop and manage data lakes and data warehouses using Azure...