Havells - Azure Data Engineer - PySpark/Python

1 week ago


Bengaluru, Karnataka, India Havells India Limited Full time
We are looking to hire a Data Engineer to join our data team. You will take responsibility for managing our master data set, developing reports, and troubleshooting data issues.

To do well in this role you need a very fine eye for detail, experience as a data analyst, and deep understanding of the popular data analysis tools and databases.


Your responsibilities :

  • Build, maintain, and manage data pipelines for efficient data flow between various systems.
  • Collaborate with stakeholders to design and manage customized data pipelines.
  • Test various ETL (Extract, Transform, and Load) tools for data ingestion and processing.
  • Assist in scaling the data infrastructure to meet the growing data demands of the organization.
  • Monitor data pipeline performance and troubleshoot any data issues.
  • Document pipeline architectures and workflows for future reference and scaling.
  • Evaluate data formats, data sources, and various data transformation techniques.
  • Work closely with data scientists to ensure the availability and reliability of data for analytics.

Skill sets/Experience we require :

  • Min 4+ Years' experience in Azure cloud, Pyspark & Python
  • Experience in Python, PySpark, and Big Data concepts like Data Lakes and Data Warehouses.
  • Strong SQL background.
  • Experienced with cloud computing platforms like Azure Cloud, Data Bricks, and Cloud.
  • Basic understanding of containerization technologies like Docker.
  • Exposure to data orchestration tools like Apache Airflow or Luigi.\

Qualification :

  • Bachelors' degree in Computer Science, Electrical Engineering, IT.
)

  • Bengaluru, Karnataka, India Havells India Limited Full time

    Job Description : Must have : 5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark Very good expertise in algorithms and data structures Excellent in at least one programming language - Python, Go, R Hands-on expertise big data technologies such as Apache Spark, Hadoop, message...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Alp Consulting Limited Full time

    Responsibilities:As an Azure Data Engineer, your day-to-day work activities will be as follows:Design & develop the ETLCreate the Pipelines (simple and complex) using ADF.Work with other Azure stack modules like Azure Data Lakes, SQL DWMust be extremely well versed with handling large volumes of dataUnderstand the business requirements for Data flow process...


  • Bengaluru, Karnataka, India CAPCO Full time

    Spark Pyspark Python Data Engineer - Bangalore/ Chennai/ Puneat Capco IndiaJob Title: Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop Best Companies for Women in India by. With our presence across 32...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    Role: Azure Data Engineer At least years' experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud Experience as Azure Data Engineer Azure Cloud + Azure Data Factory + Azure Data Bricks + Azure SQL + Pyspark Proven experience deploying machine learning algorithms to production Demonstrated proficiency in...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    Role: Azure Data Engineer At least years' experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud Experience as Azure Data Engineer Azure Cloud + Azure Data Factory + Azure Data Bricks + Azure SQL + Pyspark Proven experience deploying machine learning algorithms to production Demonstrated proficiency in...


  • Bengaluru, Karnataka, India CAPCO Full time

    Spark Pyspark Python Data Engineer - Bangalore/ Chennai/ Puneat Capco IndiaJob Title: Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop Best Companies for Women in India by. With our presence across 32...


  • Bengaluru, Karnataka, India Saaki Argus & Averil Consulting Full time

    About the Client:Our client is focused on AI and Analytics.Skills and Qualifications:Bachelors or Masters degree in computer science or equivalent4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft AzureHands on experience in SQL, python and Spark (pyspark), Big Data.Experience in Azure Databricks, Azure Data...

  • Python+Pyspark

    1 week ago


    Bengaluru, Karnataka, India Wissen Full time

    Wissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...


  • Bengaluru, Karnataka, India Edstem Technologies Full time

    We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work inLocation: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...

  • Azure Data engineer

    1 week ago


    Bengaluru, Karnataka, India Trigyn Technologies Full time

    Job Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and...

  • azure data bricks

    1 week ago


    Bengaluru, Karnataka, India Growel Softech Ltd Full time

    Job Description 4+years experience Mandatory• Experience with Azure Data Bricks, Data Factory • Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics • Experience in Python/ Pyspark Programming. • Experience with Azure Databricks/ADB • Experience with building CI/CD pipelines in Data environments...

  • azure data bricks

    1 week ago


    Bengaluru, Karnataka, India Growel Softech Ltd Full time

    Job Description:4+years experience MandatoryExperience with Azure Data Components:Azure Data DatabricksData FactoryAzure SQL DatabaseAzure SQL WarehouseSYNAPSE AnalyticsExperience in Python/ Pyspark ProgrammingExperience with building CI/CD pipelines in Data environments Primary Skills:Azure Data Databricks (ADB)Python, Apache Pyspark, ScalaAzure SQLAzure...


  • Bengaluru, Karnataka, India Speridian Technologies Full time

    Experience : 5+ Years. Notice Period : Immediate to 30 Days (max). Role: Azure Data Engineer. Location: Bengaluru (Hybrid). Job Description : As an Azure Data Engineer, your role will involve designing, developing, and maintaining data solutions on the Azure platform. You will be responsible for building and optimizing data pipelines, ensuring data quality...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Manvision Technologies Full time

    PySpark Development experience, especially in Spark SQL and Complex Transformations Python development experience Experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Databases Azure SkillsMust have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases Azure DevOps Azure AD Integration,...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Torry Harris Integration Solutions Full time

    Job Title Azure Data Engineer Job Location Bangalore, Karnataka, India Job Description Implement highly available and scalable Azure and Data bricks cloud data solutions that meet business requirements. Collaborate with cross-functional teams to implement solutions that meet business requirements. Developing and maintaining data lake using Data bricks and...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Pylon Management Consulting Full time

    Responsibilities: Developing low to high complexity, secure, governed, high quality and efficient data pipelines from a variety of on and off premise, internal and external data source. Ensuring that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases. Building data observability and data...