Apply in 3 Minutes: Data Engineer
2 days ago
Role - Data Engineer
Experience - 2+ Yrs
Location - Bangalore
Roles and Responsibilities:
Create and maintain optimal data pipeline architecture
Create and maintain events/streaming based architecture/design
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data scientists to strive for greater functionality in our data systems.
Mandatory Qualifications:
Proficiency in either Scalar or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is also Mandatory.
We are looking for a candidate with 2+ years of experience in a Data Engineer role.
Experience with big data tools: HDFS/S3, Spark/Flink,Hive,Hbase, Kafka/Kinesis, etc.
Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with AWS /GCP cloud services
Experience with stream-processing systems: Spark-Streaming/Flink etc.
Experience with object-oriented/object function scripting languages: Java, Scala, etc.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Strong analytic skills related to working with structured/unstructured datasets.
Build processes supporting data transformation, data structures, dimensional modeling, metadata, dependency, schema registration/evolution and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Experience supporting and working with cross-functional teams in a dynamic environment
Have a few weekend side projects up on GitHub
Have contributed to an open-source project
Have worked at a product company
Have a working knowledge of a backend programming language
Programming Language (Mandatory) → Candidate should be really good in either Scala OR Python (not necessarily both).
Used mainly for writing data pipelines and transformations.
Big Data Framework (Mandatory) → Strong hands-on expertise in Apache Spark.
Must know how to write Spark jobs and also tune/optimize them for better performance (not just basic Spark usage).
Performance Tuning & Optimization (Mandatory) →
Able to handle large datasets efficiently.
Optimize Spark jobs (partitions, shuffles, caching, memory usage, etc.)
DBT (Mandatory) →
Must have hands-on experience with dbt (Data Build Tool) for data transformations and data modeling.
This is often used on top of warehouses like BigQuery, Snowflake, Redshift.
-
Bengaluru, India Jobted IN C2 Full timeOverview: QSC is a global leader in full-stack AV solutions, delivering cutting-edge technology that transforms collaboration and physical experiences across corporate, education, hospitality, entertainment, and other markets. With a reputation for innovation, quality, and customer-first service, QSC is one of the fastest-growing companies in the industry,...
-
▷ Apply in 3 Minutes: Sr Data Engineer
6 days ago
Bengaluru, India Syniverse Technologies Asia Pacific Ltd Full timeJob Description Syniverse is the world's most connected company. Whether we're developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world's most recognized...
-
▷ (Apply in 3 Minutes) Azure Data Engineer
4 days ago
Bengaluru, India Live Connections Full timeJob Title: Azure Data Engineer / MSBI Developer Location: Bangalore / Kolkata Key Responsibilities: - Develop and manage ETL processes using SSIS, ADF, Databricks (PySpark) - Build and optimize data models & OLAP cubes (SSAS/Analysis Services) - Design and deploy reports/dashboards (SSRS, Power BI) - Migrate SQL workloads to Azure SQL, Data Lake,...
-
Modern Data Engineer
1 week ago
Bengaluru, India Fidelity International Full timeJob Description About the Opportunity Job Type: Permanent Application Deadline: 21 September 2025 The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support our next evolutionary stage of the Investment Process. They build robust data pipelines,...
-
Bengaluru, India Deloitte Full timeHi, Looking for Skilled AWS Data Engineer, Interested candidates please find the JD below: • Bachelor’s Degree and 3+ years’ experience in the implementation of modern data ecosystems in AWS/Cloud platforms. • 3+ years’ experience in Python, SQL. • 3+ years’ experience in Lambda • 3+ years’ experience in Glue • 3+ years’...
-
Machine Learning Engineer
6 days ago
Bengaluru, India Ai Health Highway Full timeCompany Description Ai Health Highway is a global team of medical professionals, signal processing engineers, data scientists, and clinicians. The company is AI-first and focused on making screening of chronic diseases cost-effective at the primary care clinic. This approach aims to improve patient outcomes and accessibility to healthcare services. We are...
-
(Apply in 3 Minutes) Consultant
6 days ago
Bengaluru, India Aliqan Services Full timeJob Description As a Consultant - Data Engineer, you will be responsible for: - Working with large datasets, including terabyte-scale and growing data - Utilizing various technologies and tools associated with databases and big data - Designing and modeling data to meet business requirements - Developing complex ETL processes from concept to...
-
(Apply in 3 Minutes) AWS Data Engineer
1 week ago
Bengaluru, India L&T Technology Services Full timeAWS Data Engineer: Exp: 8-10 yrs Location: Bangalore Skills: 1) Graduate with 8-10 years of experience working as a AWS Data Engineer 2) Excellent knowledge of PySpark, JavaScript, AWS - RDS, and Redshift
-
Apply in 3 Minutes! Senior Software Engineer
1 week ago
Bengaluru, India Jobted IN C2 Full timeAbout Us: Mixing technology, data, and first-in-class innovation, EagleView® is not only leading the property data analytics market, but also changing lives along the way. Come join us and make great things happen! EagleView is a fast-growing technology company driving game-changing innovation in multibillion-dollar markets such as property insurance,...
-
▷ Apply in 3 Minutes: Research Engineer
1 week ago
Bengaluru, India Triomics Full timePosition: NLP Research Engineer Location: On-site, HSR Layout, Benagluru. Type: Full Time About the Role: We are seeking a driven NLP Research Engineer with 2–3 years of hands-on experience in model development and prototyping. In this R&D-focused role, you will explore and implement state-of-the-art LLM architectures, prompt engineering strategies,...