Data Engineer
4 weeks ago
Data engineer : Hadoop.
Location : Bangalore (Hybrid).
We are looking for an Engineer II to join our growing team of data experts.
This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics.
The Engineer will work closely with product partner, data analyst, report developers, architects, data scientists and other engineers on data initiatives and will be involved in designing our next generation of data platform architecture to support increasing data demands.
Primary Responsibilities :
- Design, build and maintain scalable and reliable data pipelines to process large volumes of structures, semi-structured and un-structured data from diverse sources.
- Develop ETL processes to ingest, transform and load data into data warehouse, ensuring data quality, integrity and consistency.
- Collaborate with business stakeholders, report developers and data scientists to understand data requirements and translate then into technical solutions for various business purposes.
- Optimize performance and efficiency of data infrastructure and processes, including data storage, processing and querying.
- Implement data governance policies and best practice to ensure compliance, security and privacy of sensitive data.
- Troubleshoot data issues, identify root cause and implement solutions in timely manner.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Basic Qualifications :
- We are looking for candidate with 4+ years of experience in a Data Engineer role and has attained bachelor's degree in technology and has experienced with Agile/Scrum development process and methodologies.
- Experience as a Data Engineer with strong track record of designing and implementing data solutions.
- Experience in programming language as Python or Java, with experience in building data pipelines and workflows.
- Experience with cloud data warehousing technologies, such as Snowflake and Redshift.
- Experience with distributed computing frameworks such as Cloudera, Apache Hadoop and Spark.
- Experience with Cloud platforms such as AWS, Azure or Google Cloud Platform.
- Experience with AWS cloud services, such as S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda.
- Experience with containerization and orchestration technologies, such as Docker and Kubernetes.
- Experience with building CI/CD pipeline using tools, such has GitLab and Bitbucket.
- Experience with data pipeline orchestration tools, such as Airflow and Jenkins.
- Knowledge of database concepts, data modelling, schemas and query languages, SQL and Hive.
- Knowledge of data visualization and reporting tools, such as MicroStrategy, Tableau and Power BI.
- Knowledge of data quality and monitoring techniques and tools, such as Great Expectations or similar.
- Knowledge of data governance processes, lineage, cataloging, dictionaries using tools, such as DataHub or similar.
- Knowledge of streaming data processing and real-time analytics technologies, such as Kafka.
- Retail experience is a plus.
-
Data engineer
1 month ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...
-
Solution Engineer
2 months ago
Bangalore, Karnataka, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...
-
Data Engineer
2 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
2 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
1 month ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
3 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
1 week ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
2 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
2 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data engineer
3 weeks ago
Bangalore City, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Solutions Architect
4 weeks ago
Bangalore, India HEVO DATA Full timeOverview:We're seeking a talented Solutions Engineer to join our Sales team at Hevo Data. As a Solutions Engineer, you'll work closely with the sales team to understand customers' business and technical needs and demonstrate how our platform can solve their real-time data replication needs.This role requires a deep understanding of our architecture and a...
-
Software Development Engineer II
2 months ago
Bangalore, Karnataka, India HEVO DATA Full timeAbout Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...
-
Senior Engineering Manager
2 months ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
2 weeks ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
1 month ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
3 weeks ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior engineering manager
1 month ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
1 month ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
6 months ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
3 months ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
