Data Engineer

2 days ago

Kota, Rajasthan, India R Systems Full time

Job Title: Data Engineer

Contract Period: 12 Months

Location: Offshore candidates accepted (Singapore Based Company)

Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)

Experience

  • Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)
  • Proven experience in Python, Spark, and PySpark (non-negotiable).(mandatory*)
  • Hands-on in building ETL pipelines, real-time streaming, and data transformations.
  • Worked with data warehouses, cloud platforms (AWS/Azure/GCP), and databases.

Technical Skills

  • Spark Core API: RDDs, transformations/actions, DAG execution.
  • Spark SQL: DataFrames, schema optimization, UDFs.
  • Streaming: Structured Streaming, Kafka integration.
  • Data Handling: S3, HDFS, JDBC, Parquet, Avro, ORC.
  • Orchestration: Airflow/Prefect.
  • Performance Tuning: Partitioning, caching, broadcast joins.
  • Cloud Deployment: Databricks, AWS EMR, Azure HDInsight, GCP Dataproc.
  • CI/CD: Pytest/unittest for Spark jobs, Jenkins, GitHub Actions.

Education & Soft Skills

  • Bachelor's/Master's in Computer Science, Computer Engineering, or equivalent.
  • Strong analytical, problem-solving, and communication skills.

About the Role

We are seeking an experienced Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.

Key Responsibilities

  • Design, build, and optimize data pipelines and ETL workflows.
  • Manage and process large datasets using Spark, PySpark, and SQL.
  • Build and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with data scientists and product teams to integrate AI/ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate testing and deployment of Spark jobs via CI/CD pipelines.

Requirements

  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).

Budget

  • Onshore: As per market standards.

  • Data Engineer

    4 days ago

    Kota, Rajasthan, India beBeeDataEngineer Full time US$ 56,000 - US$ 73,000

    Unlocking Data PotentialWe are seeking an experienced Data Engineer to join our global engineering team.You will bring data engineering expertise onto a greenfield multi-year project initiative, working with cutting-edge technologies such as Python, PySpark, and TypeScript.The ideal candidate will have at least 5-10 years of experience as a Data Engineer,...

  • Big Data Engineer

    1 day ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking a seasoned Data Engineering Lead to helm a team of data engineers in designing and delivering scalable data pipelines and analytics platforms leveraging Microsoft Azure and Databricks.Key Responsibilities:Lead and grow a high-performing team of data engineers working on large-scale distributed data systems.Architect end-to-end data...

  • Data Engineering Expert

    1 day ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Engineering ExpertRole Summary:We are seeking a skilled data engineer to join our team. As a data engineering expert, you will be responsible for designing, developing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement scalable data architectures on Azure Databricks.Develop high-performance...

  • Strategic Data Engineer

    5 hours ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 7,20,000 - ₹ 14,40,000

    As a seasoned Data Engineer, you will play a pivotal role in designing and building large-scale data systems.Key ResponsibilitiesData Pipeline Development: Design and develop scalable data pipelines using Azure Data Factory, Data Bricks, and MS Synapse.Real-Time Integration: Collaborate with cross-functional teams to implement real-time and...

  • Lead Data Engineer

    1 day ago

    Kota, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer PositionThis is an exciting opportunity for a skilled Senior Data Engineer to take on a leadership role in our organization. The ideal candidate will have extensive experience in data engineering, with a strong background in developing and maintaining complex data pipelines.The successful applicant will be responsible for designing,...

  • Data Platform Engineer

    7 hours ago

    Kota, Rajasthan, India beBeeTechnicalBusinessAnalyst Full time ₹ 9,43,865 - ₹ 12,34,567

    Job Title: Technical Business AnalystLocation: RemoteThe Technical Business Analyst role plays a critical part in supporting operations across process improvement, data platform engineering and automation, cost management, and infrastructure operations while contributing to the customer's strategic vision of expanding EDP data entitlement.Core...

  • IoT Data Engineer Specialist

    1 day ago

    Kota, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: IoT Data Engineer Specialist We are seeking a skilled Senior IoT Data Engineer to join our team. The ideal candidate will have hands-on expertise in Python and PySpark coding, as well as strong knowledge of Telemetry, Big Data, and backend engineering. Required Skills & Qualifications:5+ years of experience as a Data Engineer with a focus on IoT...

  • Data Architect

    5 hours ago

    Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe seek an experienced professional to assume a Senior Data Engineer role. The ideal candidate will have in-depth knowledge of designing and optimizing data solutions for analytics, reporting, and business intelligence initiatives.The successful individual will possess expertise in ETL development, data modeling, and financial data...

  • Data Engineer Specialist

    3 hours ago

    Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled professional to design and develop robust data pipelines using ETL/ELT tools.Key Responsibilities: Develop and optimize Snowflake stored procedures for complex business logic and data transformations. Design and implement data ingestion processes using AWS services such as Lambda, DMS and Glue. Manage and monitor scheduled data...

  • Senior Data Engineer

    3 hours ago

    Kota, Rajasthan, India beBeeData Full time ₹ 12,50,000 - ₹ 17,50,000

    Job Title: ETL DeveloperJob Description:This role involves understanding requirements, designing, developing, and testing of ETL architecture, transformation jobs, and workflow schedules for a full-time position based in Bengaluru.The ideal candidate will have 5+ years experience in Informatica BDM/DEI and Telecom (Telco) domain expertise.Design and develop...