Senior Data Engineer
1 week ago
Job Setup and maintain infrastructure to solve high volume data engineering problems for stream processing and batch processing.
- Design and build a data warehouse with a maintainable metadata store.
- Build scalable query platforms for automation and democratization of data requirements.
- Stakeholder management for solutioning of data use cases.
- Design processes for system troubleshooting and maintenance.
- Build devops automation for helping product teams to manage their 4-6 years of experience in building and managing high scale data systems for product companies.
- Min 2 years of experience in maintenance of data at scale for both stream and batch processing.
- Strong understanding of AWS data infrastructure and has implemented a few data systems on AWS.
- Should be comfortable with the unix ecosystem.
- Strong understanding of AWS or any other cloud offerings.
- Understanding of Database internals, data structures and OS internals.
- Experience with tracing and monitoring systems.
- Should be able to come up with deployment strategies of production service.
Ideal candidate:
a. Star Schema / Snowflake
b. Kafka / Kinesis
c. OLTP vs OLAP
d. Building ETL Pipelining
e. ETL Tools: Kubeflow / pentaho / informatica / greenplum / teradata / talend
f. Data versioning tools : DVC / Quilt
g. Stores: BigData / Hadoop / redshift / apache fling (1 year)
h. Change Data Capture ( CDC )
i. Request per second and other ways of calculating ways to understand scale to build a system
j. Java / Golang / Scala / Python
k. Concepts about Fact Table / Dimensions
l. Data Quality and Governance
(ref:hirist.tech)
-
Data engineer
2 months ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...
-
Senior Data Engineer
2 weeks ago
Bangalore, India Rakuten Symphony Full timeJob Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...
-
Senior Data Engineer
2 weeks ago
Bangalore, India Rakuten Symphony Full timeJob Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...
-
Data Engineer
4 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
4 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
2 months ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Senior Data Engineer
2 weeks ago
Bangalore, India ThoughtFocus Full timeJob Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Market/Investment banking/BFSI domain. ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary: We are looking for a highly skilled Senior Data Engineer with 8-13 years of...
-
Data Engineer
1 month ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...
-
Senior Data Engineer
1 month ago
Bangalore, India Expian Technologies Pvt Ltd Full timeAbout the RoleWe are seeking a skilled Senior Data Engineer to join our team at Expian Technologies Pvt Ltd. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining data processing pipelines and workflows using Databricks on the Azure platform.Key ResponsibilitiesCollaborate with cross-functional teams to understand...
-
Senior Data Engineer
4 weeks ago
bangalore, India ThoughtFocus Full timeJob Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server...
-
Senior Data Engineer
1 month ago
bangalore, India ThoughtFocus Full timeJob Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server...
-
Senior Data Engineer
1 month ago
Bangalore, India ThoughtFocus Full timeJob Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF),...
-
Senior Data Engineer
1 month ago
bangalore, India ThoughtFocus Full timeJob Description: Senior Data EngineerPosition: Senior Data EngineerExperience: 8-10 YearsLocation: BangaloreEmployment Type: Full-TimeMust have experience in Capital Markets, Investment banking domain.---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration...
-
Data Engineer
2 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
3 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
2 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Senior Data Engineer
1 month ago
Bangalore, India Talent Corner HR Services Full timeJob Title: Senior Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Talent Corner HR Services. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure, pipelines, and systems.Key Responsibilities:Lead the design and implementation of robust data pipelines for...
-
Senior Data Engineer
2 months ago
Bangalore, India Talent Corner HR Services Full timeJob Title: Senior Data EngineerJob Summary:We are seeking a skilled and experienced Data Engineer to join our dynamic team at Talent Corner HR Services. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure, pipelines, and systems.Key Responsibilities:Lead the design and implementation of...
-
Senior Data Engineer
4 weeks ago
Bangalore, India Capco Full timeGreetings from Capco... We are hiring for Senior Data Engineer for Bangalore Location. Qualifications: Proven 5-8 years of experience as a Senior Data Engineer or similar role. • Experience with big data tools: Hadoop, Spark, Scala, Hive, etc. • Expert level SQL skills for data manipulation (DML) and validation (DB2). • Experience with...
-
Senior Data Engineer
4 weeks ago
bangalore, India Capco Full timeGreetings from Capco...We are hiring for Senior Data Engineer for Bangalore Location.Qualifications:Proven 5-8 years of experience as a Senior Data Engineer or similar role.• Experience with big data tools: Hadoop, Spark, Scala, Hive, etc.• Expert level SQL skills for data manipulation (DML) and validation (DB2).• Experience with data pipeline and...