Apply in 3 Minutes: Data Engineer

2 days ago


Bengaluru, India Recro Full time

Role - Data Engineer

Experience - 2+ Yrs

Location - Bangalore

Roles and Responsibilities:

Create and maintain optimal data pipeline architecture

Create and maintain events/streaming based architecture/design

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Work with data scientists to strive for greater functionality in our data systems.

Mandatory Qualifications:

Proficiency in either Scalar or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is also Mandatory.

We are looking for a candidate with 2+ years of experience in a Data Engineer role.

Experience with big data tools: HDFS/S3, Spark/Flink,Hive,Hbase, Kafka/Kinesis, etc.

Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.

Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

Experience with AWS /GCP cloud services

Experience with stream-processing systems: Spark-Streaming/Flink etc.

Experience with object-oriented/object function scripting languages: Java, Scala, etc.

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

Strong analytic skills related to working with structured/unstructured datasets.

Build processes supporting data transformation, data structures, dimensional modeling, metadata, dependency, schema registration/evolution and workload management.

Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

Experience supporting and working with cross-functional teams in a dynamic environment

Have a few weekend side projects up on GitHub

Have contributed to an open-source project

Have worked at a product company

Have a working knowledge of a backend programming language

Programming Language (Mandatory) → Candidate should be really good in either Scala OR Python (not necessarily both).

Used mainly for writing data pipelines and transformations.

Big Data Framework (Mandatory) → Strong hands-on expertise in Apache Spark.

Must know how to write Spark jobs and also tune/optimize them for better performance (not just basic Spark usage).

Performance Tuning & Optimization (Mandatory) →

Able to handle large datasets efficiently.

Optimize Spark jobs (partitions, shuffles, caching, memory usage, etc.)

DBT (Mandatory) →

Must have hands-on experience with dbt (Data Build Tool) for data transformations and data modeling.

This is often used on top of warehouses like BigQuery, Snowflake, Redshift.



  • Bengaluru, India Jobted IN C2 Full time

    Overview: QSC is a global leader in full-stack AV solutions, delivering cutting-edge technology that transforms collaboration and physical experiences across corporate, education, hospitality, entertainment, and other markets. With a reputation for innovation, quality, and customer-first service, QSC is one of the fastest-growing companies in the industry,...


  • Bengaluru, India Syniverse Technologies Asia Pacific Ltd Full time

    Job Description Syniverse is the world's most connected company. Whether we're developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world's most recognized...


  • Bengaluru, India Live Connections Full time

    Job Title: Azure Data Engineer / MSBI Developer Location: Bangalore / Kolkata Key Responsibilities: - Develop and manage ETL processes using SSIS, ADF, Databricks (PySpark) - Build and optimize data models & OLAP cubes (SSAS/Analysis Services) - Design and deploy reports/dashboards (SSRS, Power BI) - Migrate SQL workloads to Azure SQL, Data Lake,...


  • Bengaluru, India Fidelity International Full time

    Job Description About the Opportunity Job Type: Permanent Application Deadline: 21 September 2025 The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support our next evolutionary stage of the Investment Process. They build robust data pipelines,...


  • Bengaluru, India Deloitte Full time

    Hi, Looking for Skilled AWS Data Engineer, Interested candidates please find the JD below: • Bachelor’s Degree and 3+ years’ experience in the implementation of modern data ecosystems in AWS/Cloud platforms. • 3+ years’ experience in Python, SQL. • 3+ years’ experience in Lambda • 3+ years’ experience in Glue • 3+ years’...


  • Bengaluru, India Ai Health Highway Full time

    Company Description Ai Health Highway is a global team of medical professionals, signal processing engineers, data scientists, and clinicians. The company is AI-first and focused on making screening of chronic diseases cost-effective at the primary care clinic. This approach aims to improve patient outcomes and accessibility to healthcare services. We are...


  • Bengaluru, India Aliqan Services Full time

    Job Description As a Consultant - Data Engineer, you will be responsible for: - Working with large datasets, including terabyte-scale and growing data - Utilizing various technologies and tools associated with databases and big data - Designing and modeling data to meet business requirements - Developing complex ETL processes from concept to...


  • Bengaluru, India L&T Technology Services Full time

    AWS Data Engineer: Exp: 8-10 yrs Location: Bangalore Skills: 1) Graduate with 8-10 years of experience working as a AWS Data Engineer 2) Excellent knowledge of PySpark, JavaScript, AWS - RDS, and Redshift


  • Bengaluru, India Jobted IN C2 Full time

    About Us: Mixing technology, data, and first-in-class innovation, EagleView® is not only leading the property data analytics market, but also changing lives along the way. Come join us and make great things happen! EagleView is a fast-growing technology company driving game-changing innovation in multibillion-dollar markets such as property insurance,...


  • Bengaluru, India Triomics Full time

    Position: NLP Research Engineer Location: On-site, HSR Layout, Benagluru. Type: Full Time About the Role: We are seeking a driven NLP Research Engineer with 2–3 years of hands-on experience in model development and prototyping. In this R&D-focused role, you will explore and implement state-of-the-art LLM architectures, prompt engineering strategies,...