Havells - Data Engineer/Senior Data Engineer - Spark/Hadoop

1 week ago


Bengaluru, Karnataka, India Havells India Limited Full time

Job Description :

Must have :

5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark

Very good expertise in algorithms and data structures

Excellent in at least one programming language - Python, Go, R

Hands-on expertise big data technologies such as Apache Spark, Hadoop, message queues(Kafka), Apache Airflow, Azure ML, Elastic Search

Hands-on expertise working on analytics platforms such as Azure synapse or equivalent

Good understanding of performance analysis and optimizations

Hands-on experience in at least one cloud platform Azure(preferred), AWS, or GCP

B.E/B.Tech/M.E/M.Tech/M.S in Computer/Electronics Engineering or equivalent degrees with experience

Databases : Hands-on expertise in data modeling, database schema definition, query optimization, usage of relevant data stores (blob storage, data warehouse, MongoDB, TimescaleDB)

Nice to have :

Experience in publishing research papers or filing patents

Knowledge of data visualization tools such as Power BI, Tableau

Working knowledge of the Internet of Things desired

Knowledge of internet-scale cloud-based distributed systems

Good understanding of MQTT, WebSockets, Azure Service Bus, Apache Pulsar

Good knowledge of Domain-Driven Design, Test Driven Development

Experience developing in an Agile / SCRUM Environment

Mandatory Skills : Azure, dat bricks, Data Factory,Pyspark,

)

  • Bengaluru, Karnataka, India Capleo Global Full time

    Lead Data Engineer Experience: 6-10 years Location: Bengaluru Availability: Immediate to 30 days Mandatory Skills: Spark Databricks Py Spark or Scala SQL & Python Github DWH (Snowflake or Presto or Hive or Hadoop) Data Pipeline & Data Model We are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru.If you are passionate about...

  • Data Engineering

    2 weeks ago


    Bengaluru, Karnataka, India NR Consulting - India Full time

    Role: Data EngineerLocation: BangaloreExp: 5+ yearsJDMandatory Skills: Data Engineer, Scala, Spark, Hadoop " Senior Data EngineerJD: " Proven experience as a data engineer, with at least 5 years of experience in a similar role. " Good hands-on experience in Scala and Scala Spark " Design, implement, and optimize data pipelines using Spark...

  • Data Engineering

    2 weeks ago


    Bengaluru, Karnataka, India NR Consulting - India Full time

    Role: Data EngineerLocation: BangaloreExp: 5+ yearsJDMandatory Skills: Data Engineer, Scala, Spark, Hadoop" Senior Data Engineer JD:" Proven experience as a data engineer, with at least 5 years of experience in a similar role." Good hands-on experience in Scala and Scala Spark" Design, implement, and optimize data pipelines using Spark ,Hadoop, Hive and...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Capleo Global Full time

    Lead Data EngineerExperience: 8-10 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...


  • Bengaluru, Karnataka, India Prescience Decision Solutions Full time

    Job Description Contribute to the development and maintenance of ETL jobs and components utilizing Apache Spark, Python, Pyspark, Talend, Kafka, Hadoop, Airflow, and GCP technologies. Engage in requirement gathering, analysis, and translation of functional requirements into technical tasks using Spark/Airflow. Produce comprehensive Technical ETL design...


  • Bengaluru, Karnataka, India iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Spark Engineer

    1 week ago


    Bengaluru, Karnataka, India Cyber Sphere LLC Full time

    Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Snaphunt Full time

    The OfferExcellent career development opportunitiesWork within a company with a solid track record of successFlexible working optionsThe JobYou will be responsible for :Design, develop, and maintain scalable and efficient data engineering solutions using Apache Spark and related technologies.Collaborate with cross-functional teams to understand data...


  • Bengaluru, Karnataka, India Target Corporation Full time

    Job Description : As a Data Engineer / Senior Data Engineer you serve as a specialist in the engineering team that supports the product. You help develop and gain insight in the application architecture. You can distill an abstract architecture into concrete design and influence the implementation. You show expertise in applying the appropriate software...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Philips Full time

    Job Title: Senior Data EngineerJob Description:Overall Job SummaryThe Senior Data Engineer specializes in designing and developing cutting-edge data pipelines and Analytical Solutions. In this role, you will play a key part in the company's transition from On-Premises to Cloud. Collaborate with Data Scientists, Business Analysts, and Clinical teams; provide...


  • Bengaluru, Karnataka, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.Manpower Planning.Preparing of Project Cost.Schedule wise work execution.As Drawing & quality work execution.Client & Third Party Manage.Working Team Manage & Review.Reporting to Management.ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India TalentPulse Consultant Full time

    Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...


  • Bengaluru, Karnataka, India Oracle Full time

    We are seeking a skilled Data Engineer with extensive experience in the Hadoop ecosystem and a strong background in integrating and managing data from FLEXCUBE core banking systems. The ideal candidate will play a key role in designing, implementing, and optimizing our data pipelines, ensuring seamless data flow and analysis.Career Level - IC3Key...

  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing JOB DESCRIPTION: The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Dexian India Full time

    Job Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, ETL processes, dashboarding, and data warehousing, with a focus on building high-quality, high-volume data pipelines. If you are passionate about leveraging data to drive...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, Karnataka, India Nityo Infotech Full time

    JD : Data Engineer Locatio-Bangalore Np -15 days Skills : Full Stack Development background with Java and JavaScript/CSS/HTML (Data Science)Knowledge of ReactJs/Angular is a plus Big Data Engineer with solid background with the larger Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop CLI/MapReduce/Storm/Kafka/Lambda...

  • GCP Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Tredence Inc. Full time

    Have Implemented and Architected solutions on Google Cloud Platform using the components of GCPExperience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines.Experience in some of the following:Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.Experience programming...