Data Engineer

3 weeks ago

Kota, Rajasthan, India R Systems Full time

Job Title: Data Engineer

Contract Period: 12 Months

Location: Offshore candidates accepted (Singapore Based Company)

Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)

Experience

  • Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)
  • Proven experience in Python, Spark, and PySpark (non-negotiable).(mandatory*)
  • Hands-on in building ETL pipelines, real-time streaming, and data transformations.
  • Worked with data warehouses, cloud platforms (AWS/Azure/GCP), and databases.

Technical Skills

  • Spark Core API: RDDs, transformations/actions, DAG execution.
  • Spark SQL: DataFrames, schema optimization, UDFs.
  • Streaming: Structured Streaming, Kafka integration.
  • Data Handling: S3, HDFS, JDBC, Parquet, Avro, ORC.
  • Orchestration: Airflow/Prefect.
  • Performance Tuning: Partitioning, caching, broadcast joins.
  • Cloud Deployment: Databricks, AWS EMR, Azure HDInsight, GCP Dataproc.
  • CI/CD: Pytest/unittest for Spark jobs, Jenkins, GitHub Actions.

Education & Soft Skills

  • Bachelor's/Master's in Computer Science, Computer Engineering, or equivalent.
  • Strong analytical, problem-solving, and communication skills.

About the Role

We are seeking an experienced Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.

Key Responsibilities

  • Design, build, and optimize data pipelines and ETL workflows.
  • Manage and process large datasets using Spark, PySpark, and SQL.
  • Build and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with data scientists and product teams to integrate AI/ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate testing and deployment of Spark jobs via CI/CD pipelines.

Requirements

  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).

Budget

  • Onshore: As per market standards.

  • GCP Data Engineer

    3 weeks ago

    Kota, Rajasthan, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • Chief Data Engineer

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock Your Career in Data EngineeringJob Summary:We are seeking an experienced Data Platform Engineering Lead to drive the design and development of our enterprise SaaS and AI-driven data foundation. This role involves leading the architecture of clean, scalable models, driving data platform strategy, and enabling a high-velocity product development...

  • Senior Data Engineer

    2 weeks ago

    Kota, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned data engineer to lead our team's efforts in designing, building, and maintaining large-scale data systems.Key Responsibilities:Develop and implement data pipelines using various tools and technologies.Design and deploy scalable data architectures that meet business requirements.Collaborate with...

  • Cloud Data Engineer

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer Job DescriptionWe are seeking a highly experienced cloud data engineer with 5+ years of experience in designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP). Our ideal candidate is hands-on with Google Cloud Storage (GCS), BigQuery, Apache Airflow, and Python, and adept at managing...

  • Master Data Engineer

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking an accomplished Senior Data Engineer to spearhead our data modeling and engineering efforts. The ideal candidate will possess 3-5 years of experience in designing, developing, and maintaining complex data pipelines using Snowflake, SnowSight, and Snowpipes.Design and develop scalable data architectures that meet the...

  • Data Engineering Leader

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time US$ 1,62,000 - US$ 2,02,500

    Job Title: Data Engineering Leader About the Role:We are seeking a highly skilled and experienced Senior Data Engineer to spearhead large-scale data processing pipelines, collaborating with cross-functional teams to translate business requirements into actionable insights. Main Responsibilities:Designing, developing, and maintaining complex data processing...

  • Senior Data Architect

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,50,000

    About the RoleWe are seeking an experienced Data Engineering Lead to drive our technology strategy and lead a team of data engineers in developing cutting-edge capabilities.This is an exciting opportunity for a seasoned professional to join our technology hub and spearhead innovation in data science, data analytics, e-commerce, automation, cloud computing,...

  • Data Engineering Specialist

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Join a dynamic team of data experts as a Data Engineering Specialist. This role involves the design, development, and maintenance of large-scale data systems. Your strong programming skills and experience with data architecture will be key to delivering efficient and scalable solutions.Key Responsibilities:Develop robust data pipelines using various tools...

  • Data Quality Engineer

    2 weeks ago

    Kota, Rajasthan, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Quality SpecialistAs a key member of our data engineering team, you will play a crucial role in ensuring the quality and reliability of our data validation and transformation processes.Data Validation and Transformation: Develop automated and manual test cases for data validation and transformation processes.Data Integrity: Validate data integrity...

  • Data Pipeline Engineer

    2 weeks ago

    Kota, Rajasthan, India beBeebackend Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Backend Data & Integration EngineerA seasoned software engineer is required to design and implement data pipelines, integrate external systems and interfaces, and develop crawling/fetch pipelines.Key Responsibilities:Development of efficient crawling/fetch pipelines using API-first approach with playwright/requests where permitted.Parsing and...