See more Collapse

Elixir - Lead Big Data Engineer - Hive/Hadoop

2 months ago

BangaloreGurgaonGurugram, India Gi Group Full time

Job Description :


The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning.

Technical skills requirements :

The candidate must demonstrate proficiency in :

- CDH On-premise for data processing and extraction

- Ability to own and deliver on large, multi-faceted projects

- Fluency in complex SQL and experience with RDBMSs

- Project Experience in CDH experience, Spark, PySpark, Scala, Python, NiFi, Hive, NoSql DBs)

- Experience designing and building big data pipelines

- Experience working on large scale, distributed systems

- Experience working on any Databricks would be added advantage

- Strong hands-on experience of programming language like PySpark, Scala with Spark, Python.

- Exposure to various ETL and Business Intelligence tools

- Experience in shell scripting to automate pipeline execution.

- Solid grounding in Agile methodologies

- Experience with git and other source control systems

- Strong communication and presentation skills

- Lead the team of 7 - 10 Data Engineers.

Nice-to-have skills :

- Certification in Hadoop/Big Data - Hortonworks/Cloudera

- Databricks Spark certification

- Unix or Shell scripting

- Strong delivery background across the delivery of high-value, business-facing technical projects in major organizations

- Experience of managing client delivery teams, ideally coming from a Data Engineering / Data Science environment

Qualifications :

- B.Tech./M.Tech./MS or BCA/MCA degree from a reputed university

(ref:hirist.tech)

We have other current jobs related to this field that you can find below

  • Big Data Developer

    2 months ago

    bangalore, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPA Requirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in loading and...

  • Big Data Developer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPARequirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...

  • Big Data Developer

    3 weeks ago

    Bangalore, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPA Requirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...

  • Big Data Developer

    2 months ago

    Bangalore, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPA Requirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...

  • Thoucentric - Big Data Engineer - Hive/Hadoop

    4 weeks ago

    Bangalore, Karnataka, India Thoucentric Full time

    Job Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Thoucentric - Big Data Engineer - Hive/Hadoop

    3 weeks ago

    Bangalore, India Thoucentric Full time

    Job Description : As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Thoucentric - Big Data Engineer - Hive/Hadoop

    1 week ago

    bangalore, India Thoucentric Full time

    Job Description : As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Thoucentric - Big Data Engineer - Hive/Hadoop

    3 weeks ago

    bangalore, India Thoucentric Full time

    Job Description : As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Thoucentric - Big Data Engineer - Hive/Hadoop

    4 weeks ago

    Bangalore, India Thoucentric Full time

    Job Description : As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Thoucentric - Big Data Engineer - Hive/Hadoop

    3 weeks ago

    Bangalore, Karnataka, India Thoucentric Full time

    Job Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Valiance Solutions

    2 weeks ago

    bangalore, India Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Big Data Engineer

    6 days ago

    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Valiance Solutions

    2 months ago

    Noida/Bangalore/Mumbai, IN Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Valiance Solutions

    3 weeks ago

    Noida/Bangalore/Mumbai, India Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Valiance Solutions

    2 months ago

    Noida/Bangalore/Mumbai, India Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Valiance Solutions

    3 weeks ago

    Noida/Bangalore/Mumbai, IN Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Data Engineer

    2 months ago

    Bangalore, India Gethyr Full time

    Responsibilities : - Design and implement fine-tuned production-ready data/ml pipelines in the hadoop platform.- Drive optimization, testing, and tools to improve quality.- Review and approve high-level & detailed design to ensure alignment with business needs and data & analytics architecture principles.- Understand business requirements and develop...

  • Big Data Developer

    3 weeks ago

    Bangalore/Hyderabad/Noida/Gurgaon/Gurugram/Indore, India ARR Recruitment Solutions Full time

    Requirement :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).- Solid Data warehousing concepts.- Knowledge of Financial reporting ecosystem will be a plus.- 4+ years of experience within Data Engineering/ Data...

  • Big Data Developer

    2 months ago

    Bangalore,Hyderabad,Noida,Gurgaon,Gurugram,Indore, India ARR Recruitment Solutions Full time

    Requirement :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).- Solid Data warehousing concepts.- Knowledge of Financial reporting ecosystem will be a plus.- 4+ years of experience within Data Engineering/ Data...

  • Engineer- Big Data

    4 weeks ago

    Gurugram, India AMEX Full time

    You Lead the Way. Weve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, youll learn and grow as we help you create a...