Big Data Engineer

4 weeks ago


BangaloreDelhi NCRNoidaGurgaonGurugramPune, IN Sureminds Solutions Pvt. Ltd. Full time

Job Description have skills :


1. Handson experience of Spark, Scala and conversant with SQL

2. Good knowledge on Hadoop (Oozie)

3. Reverse engineer the SQL queries, Scala code to understand functionality

4. Capable of identifying, analysing and interpret patterns and trends in complex data sets

5. Should have strong experience on AWS (EMR, S3)

6. Has worked on creating database design, data models & techniques for data mining.

Good to have skills :

1. Adept at using data processing platforms like Hadoop and CouchDB

2. Performing analysis to assess quality and meaning of data

3. Preparing reports for the management stating trends, patterns, and predictions using relevant data

Detailed Requirements :


1. Using automated tools to extract data from primary and secondary sources

2. Removing corrupted data and fixing coding errors and related problems

3. Performing analysis to assess quality and meaning of data

4. Filter Data by reviewing reports and performance indicators to identify and correct code problems

5. Using statistical tools to identify, analyze, and interpret patterns and trends in complex data sets that could be helpful for the diagnosis and 6. prediction

7. Assigning numerical value to essential business functions so that business performance can be assessed and compared over periods of time.

8. Analyzing local, national, and global trends that impact both the organization and the industry

9. Preparing reports for the management stating trends, patterns, and predictions using relevant data

10. Working with programmers, engineers, and management heads to identify process improvement opportunities, propose system modifications, and devise data governance strategies.

11. Preparing final analysis reports for the stakeholders to understand the data-analysis steps, enabling them to take important decisions based on various facts and trends.

12. Knowledge of programming languages like SQL, Oracle, R and Python

13. Technical proficiency regarding database design development, data models, techniques for data mining, and segmentation.

14. Experience in handling reporting packages like Business Objects, programming (JavaScript, XML, or ETL frameworks), databases

15. Proficiency in statistics and statistical packages like Excel, SPSS, SAS to be used for data set analyzing

16. Adept at using data processing platforms like Hadoop and Apache Spark

17. Knowledge of data visualization software like Tableau, Qlik

18. Knowledge of how to create and apply the most accurate algorithms to datasets in order to find solutions

19. Data mapping (ACRS, MARSHA) creation & maintenance, track open questions, issues, and support on all ongoing epics with data related queries

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...


  • Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...


  • Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Big Data Engineer

    2 days ago


    Gurgaon/Gurugram/Bangalore, IN TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...


  • Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Data Engineer

    4 weeks ago


    Bangalore/Pune, IN Pylon Management Consulting Full time

    Requirements:- Overall 5+ years of IT experience with 3+ years in data-related technologies.- Minimum 2.5 years of experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP).- Hands-on experience with the Hadoop stack - HDFS, sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink,...

  • Valiance Solutions

    4 weeks ago


    Noida/Bangalore/Mumbai, IN Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Big Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • Big Data Engineer

    4 weeks ago


    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...

  • AWS Data Architect

    4 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • Publicis Sapient

    5 days ago


    Delhi NCR/Gurgaon/Gurugram/Noida/Bangalore, IN Publicis Sapient Full time

    Job Description :Role : Senior Associate Data Engineering Level 2In the role of Senior Associate L2 in Data Engineering, you'll be instrumental in translating client requirements into technical designs and implementing components for data engineering solutions. Your impact spans across data ingestion, integration, transformation, storage, computation...


  • Bangalore/Gurgaon/Gurugram/Noida, IN MakeMyTrip Full time

    Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...


  • Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...


  • Bangalore/Delhi, IN SavvyR Solutions Private Limited Full time

    Your primary focus will be writing clean, maintainable, and efficient Java code to extract, transform, and load massive datasets. You will also collaborate closely with data scientists, analysts, and other engineers to ensure our solutions meet business needs and deliver real value.Responsibilities :Design, develop, test, and deploy robust, scalable Java...


  • Gurgaon/Gurugram, IN Huquo Full time

    Job Description :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering- Engages in...

  • Big Data Engineer

    4 weeks ago


    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...