Big Data Engineer

4 weeks ago

BangaloreDelhi NCRNoidaGurgaonGurugramPune, India Sureminds Solutions Pvt. Ltd. Full time

Job Description have skills :


1. Handson experience of Spark, Scala and conversant with SQL

2. Good knowledge on Hadoop (Oozie)

3. Reverse engineer the SQL queries, Scala code to understand functionality

4. Capable of identifying, analysing and interpret patterns and trends in complex data sets

5. Should have strong experience on AWS (EMR, S3)

6. Has worked on creating database design, data models & techniques for data mining.

Good to have skills :

1. Adept at using data processing platforms like Hadoop and CouchDB

2. Performing analysis to assess quality and meaning of data

3. Preparing reports for the management stating trends, patterns, and predictions using relevant data

Detailed Requirements :


1. Using automated tools to extract data from primary and secondary sources

2. Removing corrupted data and fixing coding errors and related problems

3. Performing analysis to assess quality and meaning of data

4. Filter Data by reviewing reports and performance indicators to identify and correct code problems

5. Using statistical tools to identify, analyze, and interpret patterns and trends in complex data sets that could be helpful for the diagnosis and 6. prediction

7. Assigning numerical value to essential business functions so that business performance can be assessed and compared over periods of time.

8. Analyzing local, national, and global trends that impact both the organization and the industry

9. Preparing reports for the management stating trends, patterns, and predictions using relevant data

10. Working with programmers, engineers, and management heads to identify process improvement opportunities, propose system modifications, and devise data governance strategies.

11. Preparing final analysis reports for the stakeholders to understand the data-analysis steps, enabling them to take important decisions based on various facts and trends.

12. Knowledge of programming languages like SQL, Oracle, R and Python

13. Technical proficiency regarding database design development, data models, techniques for data mining, and segmentation.

14. Experience in handling reporting packages like Business Objects, programming (JavaScript, XML, or ETL frameworks), databases

15. Proficiency in statistics and statistical packages like Excel, SPSS, SAS to be used for data set analyzing

16. Adept at using data processing platforms like Hadoop and Apache Spark

17. Knowledge of data visualization software like Tableau, Qlik

18. Knowledge of how to create and apply the most accurate algorithms to datasets in order to find solutions

19. Data mapping (ACRS, MARSHA) creation & maintenance, track open questions, issues, and support on all ongoing epics with data related queries

(ref:hirist.tech)

  • Big Data Engineer

    47 minutes ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description :- Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core,...

  • Paisabazaar - Data Engineer - Big Data Technologies

    3 weeks ago

    Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Paisabazaar - Data Engineer - Big Data Technologies

    2 weeks ago

    Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...

  • Big Data Developer

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Engineer

    5 days ago

    pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    5 days ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    5 days ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    5 days ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    3 weeks ago

    Delhi, India TekJobs Full time

    This role is for a Data Engineering Lead to work on the Vanguard Big Data Platform. The team is responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value.Job Background/context:The technology team is responsible for building and maintaining a multitude of applications including:Real-time...

  • Senior Data Engineer

    2 days ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Big Data Developer

    3 weeks ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    4 weeks ago

    gurgaon, India IntraEdge Full time

    Big Data Engineer Position Available in GurgaonWe are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners, so having...

  • Senior Data Engineer

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Lead Big Data Engineer

    4 weeks ago

    pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...

  • Big Data Engineer

    1 week ago

    Gurgaon, India Chiselon Technologies Pvt Ltd Full time

    # Hiring Alert # We are looking for Immediate Joiners Skills: Big Data with GCP  GCP; Hive; PySpark; Python  GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization     "Join us and become an integral part of our success story. Apply today and let's achieve...