Havells - Azure Data Engineer - PySpark/Python
1 month ago
We are looking to hire a Data Engineer to join our data team. You will take responsibility for managing our master data set, developing reports, and troubleshooting data issues. To do well in this role you need a very fine eye for detail, experience as a data analyst, and deep understanding of the popular data analysis tools and databases.
Your responsibilities :
- Build, maintain, and manage data pipelines for efficient data flow between various systems.
- Collaborate with stakeholders to design and manage customized data pipelines.
- Test various ETL (Extract, Transform, and Load) tools for data ingestion and processing.
- Assist in scaling the data infrastructure to meet the growing data demands of the organization.
- Monitor data pipeline performance and troubleshoot any data issues.
- Document pipeline architectures and workflows for future reference and scaling.
- Evaluate data formats, data sources, and various data transformation techniques.
- Work closely with data scientists to ensure the availability and reliability of data for analytics.
Skill sets/Experience we require :
- Min 4+ Years' experience in Azure cloud, Pyspark & Python
- Experience in Python, PySpark, and Big Data concepts like Data Lakes and Data Warehouses.
- Strong SQL background.
- Experienced with cloud computing platforms like Azure Cloud, Data Bricks, and Cloud.
- Basic understanding of containerization technologies like Docker.
- Exposure to data orchestration tools like Apache Airflow or Luigi.\
Qualification :
- Bachelors' degree in Computer Science, Electrical Engineering, IT.
-
Azure Data Engineer
1 month ago
Any Location/Bangalore, India Diatoz Solutions Full timeWe Are Seeking A Skilled Azure Data Engineer To Join Our Dynamic Team. The Ideal Candidate Will Be Responsible For Designing, Developing, And Maintaining Data Solutions On The Microsoft Azure Platform. You Will Collaborate With Cross-Functional Teams To Gather Requirements, Design Data Pipelines, And Implement Solutions To Meet Business...
-
Bangalore, India Havells India Limited Full timeJob Description : Must have : - 5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark - Very good expertise in algorithms and data structures - Excellent in at least one programming language - Python, Go, R - Hands-on expertise big data technologies such as Apache Spark, Hadoop, message...
-
Senior Data Engineer
7 days ago
Hyderabad/Bangalore, India Krishna Global Services Pvt. Ltd Full timeDescription :Role : Sr. Data Engineer Location : HYDERABADExperience : 4+ to 10 years! Key Skills : Data Engineer to join OPP team Responsibilities : Python Implementation Experience on Pyspark, Kafka, Spark, SQL, AZURE Description : We are looking for resources having 4 -10 years of experience with expertise in Data Engineer to join OPP team ...
-
Azure Data Engineer
2 weeks ago
bangalore, India Manvision Technologies Full timePySpark Development experience, especially in Spark SQL and Complex Transformations Python development experience Experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Databases Azure Skills Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases Azure DevOps Azure AD Integration,...
-
Azure Databricks Engineer/Data Engineer
1 month ago
Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...
-
Colan Infotech
4 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Colan Infotech Pvt Ltd Full timeSkill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...
-
Colan Infotech
4 weeks ago
Bangalore/Anywhere in India/Multiple Locations Colan Infotech Pvt Ltd Full timeSkill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL. Job Description : Roles And Responsibilities : - Must have cloud knowledge in Azure - Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks,...
-
Valiance Solutions
1 month ago
Bangalore/Noida, India Valiance Analytics Pvt. Ltd. Full timeJob Description Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team...
-
bangalore, India NTT DATA Full timeJob Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...
-
Azure Data Engineer
2 months ago
Anywhere in India,Multiple Locations,Bangalore Arting Digital Full timePosition Title : Azure Data Engineer Exp : 5+ years Location : Remote Primary Skills :- Azure Databricks, Azure ADF, Pyspark, Python & SQL Qualification : AnyRoles and responsibilities : - An offshore Data Engineer to work with the Investment Analytics team. - This person needs to have a strong exp of - Azure Data bricks, Azure ADF, Pyspark Python & SQL...
-
Azure Databricks Engineer
2 months ago
Bangalore, India codersbrain Full timeWe have an opening for Azure Databricks.Experience : 6 to 12 yrsLocation : BangaloreInterview : Face to face interview on 2nd and 3rd MarchMandatory Skills :- Azure Data Factory- Python- Pyspark- SQL- Azure Data LakeJob Description :- Around 7 to 9 yrs of IT experience with at least 5 yrs in ETL/Pipeline Development using tools such as Azure...
-
ETL Data Engineer
4 weeks ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeJob Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...
-
ETL Data Engineer
4 weeks ago
Bangalore, India Codersbrain technology pvt ltd Full timeJob Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...
-
Azure Data Factory, Azure Data Bricks, Pyspark
2 months ago
bangalore, India Global Pharma Tek Full timeRole: Azure Data Engineer · At least years’ experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud · Experience as Azure Data Engineer · Azure Cloud + Azure Data Factory + Azure Data Bricks + Azure SQL + Pyspark · Proven experience deploying machine learning algorithms to production · Demonstrated...
-
Python Developer
4 weeks ago
bangalore, India IT Full timeJob Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...
-
Python Developer
1 month ago
Bangalore, Karnataka, India IT Full timeJob Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...
-
Python Developer
1 month ago
Bangalore, India IT Full timeJob Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...
-
ML Engineer
1 month ago
Bangalore, Karnataka, India Petals Careers Full timeRequirements :- Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions.- Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...
-
ML Engineer
2 months ago
Bangalore, India Petals Careers Full timeRequirements : - Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions. - Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...
-
Data Engineer
2 weeks ago
bangalore, India WIZSTAFFING PRIVATE LIMITED Full timeJob Description : We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage...