Havells - Azure Data Engineer - PySpark/Python

1 month ago


Bangalore, India Havells India Limited Full time

We are looking to hire a Data Engineer to join our data team. You will take responsibility for managing our master data set, developing reports, and troubleshooting data issues. To do well in this role you need a very fine eye for detail, experience as a data analyst, and deep understanding of the popular data analysis tools and databases.

Your responsibilities :

- Build, maintain, and manage data pipelines for efficient data flow between various systems.

- Collaborate with stakeholders to design and manage customized data pipelines.

- Test various ETL (Extract, Transform, and Load) tools for data ingestion and processing.

- Assist in scaling the data infrastructure to meet the growing data demands of the organization.

- Monitor data pipeline performance and troubleshoot any data issues.

- Document pipeline architectures and workflows for future reference and scaling.

- Evaluate data formats, data sources, and various data transformation techniques.

- Work closely with data scientists to ensure the availability and reliability of data for analytics.

Skill sets/Experience we require :

- Min 4+ Years' experience in Azure cloud, Pyspark & Python

- Experience in Python, PySpark, and Big Data concepts like Data Lakes and Data Warehouses.

- Strong SQL background.

- Experienced with cloud computing platforms like Azure Cloud, Data Bricks, and Cloud.

- Basic understanding of containerization technologies like Docker.

- Exposure to data orchestration tools like Apache Airflow or Luigi.\

Qualification :

- Bachelors' degree in Computer Science, Electrical Engineering, IT.

(ref:hirist.tech)
  • Azure Data Engineer

    1 month ago


    Any Location/Bangalore, India Diatoz Solutions Full time

    We Are Seeking A Skilled Azure Data Engineer To Join Our Dynamic Team. The Ideal Candidate Will Be Responsible For Designing, Developing, And Maintaining Data Solutions On The Microsoft Azure Platform. You Will Collaborate With Cross-Functional Teams To Gather Requirements, Design Data Pipelines, And Implement Solutions To Meet Business...


  • Bangalore, India Havells India Limited Full time

    Job Description : Must have : - 5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark - Very good expertise in algorithms and data structures - Excellent in at least one programming language - Python, Go, R - Hands-on expertise big data technologies such as Apache Spark, Hadoop, message...


  • Hyderabad/Bangalore, India Krishna Global Services Pvt. Ltd Full time

    Description :Role : Sr. Data Engineer Location : HYDERABADExperience : 4+ to 10 years! Key Skills : Data Engineer to join OPP team Responsibilities : Python Implementation Experience on Pyspark, Kafka, Spark, SQL, AZURE Description : We are looking for resources having 4 -10 years of experience with expertise in Data Engineer to join OPP team ...

  • Azure Data Engineer

    2 weeks ago


    bangalore, India Manvision Technologies Full time

    PySpark Development experience, especially in Spark SQL and Complex Transformations Python development experience Experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Databases Azure Skills Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases Azure DevOps Azure AD Integration,...


  • Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...

  • Colan Infotech

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...

  • Colan Infotech

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL. Job Description : Roles And Responsibilities : - Must have cloud knowledge in Azure - Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks,...

  • Valiance Solutions

    1 month ago


    Bangalore/Noida, India Valiance Analytics Pvt. Ltd. Full time

    Job Description Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team...


  • bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Azure Data Engineer

    2 months ago


    Anywhere in India,Multiple Locations,Bangalore Arting Digital Full time

    Position Title : Azure Data Engineer Exp : 5+ years Location : Remote Primary Skills :- Azure Databricks, Azure ADF, Pyspark, Python & SQL Qualification : AnyRoles and responsibilities : - An offshore Data Engineer to work with the Investment Analytics team. - This person needs to have a strong exp of - Azure Data bricks, Azure ADF, Pyspark Python & SQL...


  • Bangalore, India codersbrain Full time

    We have an opening for Azure Databricks.Experience : 6 to 12 yrsLocation : BangaloreInterview : Face to face interview on 2nd and 3rd MarchMandatory Skills :- Azure Data Factory- Python- Pyspark- SQL- Azure Data LakeJob Description :- Around 7 to 9 yrs of IT experience with at least 5 yrs in ETL/Pipeline Development using tools such as Azure...

  • ETL Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    4 weeks ago


    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • bangalore, India Global Pharma Tek Full time

    Role: Azure Data Engineer · At least years’ experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud · Experience as Azure Data Engineer · Azure Cloud + Azure Data Factory + Azure Data Bricks + Azure SQL + Pyspark · Proven experience deploying machine learning algorithms to production · Demonstrated...

  • Python Developer

    4 weeks ago


    bangalore, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    1 month ago


    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    1 month ago


    Bangalore, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • ML Engineer

    1 month ago


    Bangalore, Karnataka, India Petals Careers Full time

    Requirements :- Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions.- Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...

  • ML Engineer

    2 months ago


    Bangalore, India Petals Careers Full time

    Requirements : - Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions. - Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...

  • Data Engineer

    2 weeks ago


    bangalore, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description : We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage...