Data Engineer

4 weeks ago

Bangalore, India ANB IT Solutions Pvt Ltd Full time

- 8+ Years of Experience candidate.

Primary skills : Spark, Scala, hive and SQL.

Secondary skills : Python and Java.

Hands on experience in Spark Scala ,hive.

Should have experience in SQL.

Job location : Bangalore(Kadubeesanahalli)

Job Mode : Hybrid

We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering with primary skills in Spark, Scala, Hive, and SQL, and secondary skills in Python and Java.

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain robust data pipelines using Spark and Scala.

- Implement ETL (Extract, Transform, Load) processes to consolidate and transform data from various sources.

- Ensure data is processed efficiently and made available for analytics and reporting.

Primary Skills :

Spark and Scala :

- Develop and optimize data processing workflows using Apache Spark and Scala.

- Implement complex data transformations and aggregations with Spark and Scala.

Hive :

- Write and optimize Hive queries for data warehousing solutions.

- Manage and query large datasets stored in Hive.

SQL :

- Write complex SQL queries to extract, manipulate, and analyze data from various databases.

- Optimize SQL queries for efficiency and performance.

- Ensure data accuracy and integrity by performing regular data validation and quality checks.

Secondary Skills :

Python :


- Utilize Python for data analysis, scripting, and automation tasks.

- Develop Python scripts for data processing and integration.

- Experience with Python libraries such as pandas, NumPy, and PySpark.

Java :

- Leverage Java for developing data processing and integration solutions.

- Integrate Java applications with data processing frameworks and databases.

(ref:hirist.tech)

  • Data engineer

    2 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    2 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Solution Engineer

    4 weeks ago

    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...

  • Hevo Data

    4 weeks ago

    Bangalore, India HEVO DATA Full time

    About Hevo Data : Unleash the power of data at Hevo! Join our team of brilliant minds as we revolutionize the world of data connectivity. Our mission is simple: to empower organisations with seamless access to their data universe, enabling smarter decisions and unlocking their full potential. Are you ready to be part of the data revolution that is shaping...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • AWS DataLake Data Engineer

    1 month ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 296111  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS DataLake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Data Solutions Architect

    4 days ago

    Bangalore, India HEVO DATA Full time

    Overview:We're seeking a talented Solutions Engineer to join our Sales team at Hevo Data. As a Solutions Engineer, you'll work closely with the sales team to understand customers' business and technical needs and demonstrate how our platform can solve their real-time data replication needs.This role requires a deep understanding of our architecture and a...

  • Software Development Engineer II

    4 weeks ago

    Bangalore, Karnataka, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...

  • Solutions Engineer

    1 month ago

    bangalore, India Hevo Data Full time

    Overview : We’re seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You’ll work one-on-one with the sales team to help discover our customers’ business and technical needs and demonstrate how Hevo’s platform can solve their real-time data replication needs. In this role, you will have a deep...

  • Senior Engineering Manager

    2 weeks ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    5 months ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    2 weeks ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior engineering manager

    1 week ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    1 month ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    1 month ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    2 months ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    6 days ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    4 weeks ago

    Bangalore, India HEVO DATA Full time

    About Hevo : At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...