Azure Databricks Engineer
2 months ago
Primary Skills : Databricks with Pyspark/Spark/ Python and SQL
Secondary skills : ADF
Job Overview :
- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.
- 4+ years of work experience with very large data warehousing environment
- 4+ years of work experience in Databricks, Pyspark and Python project development work
- Expertise in Bigdata Eco systems like HDFS and Spark
- Strong hands-on experience on Python or Scala.
- Hands on experience on Azure Data Factory.
- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
- SQL SERVER development work experience with relational databases and knowledge is a must
- Development of Stored Procedures for transformations in ETL pipeline
- Should have work experience in Agile projects
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
- Good experience on customer interaction is required.
- Possesses good interpersonal and communication skills.
-
Azure Databrick
4 weeks ago
Pune, India Braincranx IT solutions Full time**Job description** - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL,...
-
Azure Databricks
1 month ago
Pune, India Nityo Infotech Full timeData Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required5 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia
-
Azure Databricks
1 month ago
Pune, India Nityo Infotech Full timeData Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India
-
Sr. Data Engineer Azure Databricks
4 days ago
Pune, India Fusemachines Full timeAbout Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...
-
Azure Data Engineer
2 months ago
Hyderabad,Pune, India Recruitment Agency Full timeWe are looking for Azure Data Engineer/ Azure Databricks.Experience : 6+ years Notice period : Immediate Requirements : - Strong proficiency in Python programming language with a focus on data processing and analytics.- In-depth experience with Azure Databricks, including cluster management, job execution, and notebook workflows.- Knowledge of big data...
-
Azure Databricks
1 month ago
Pune, India CGI Group, Inc. Full time**Position Description**: Working on Azure Technologies -> Azure Databricks(primary req), Azure Datafactory, PowerBI, ADLS - Good to have knowledge on Datastage & Microstrategy because it is the main tool that is used in the team. Although the focus will be on Azure technologies - Relevant Exp in Azure atleast 2 years. **Your future duties and...
-
Data Engineer
2 months ago
Pune,Hyderabad, India HuQuo Full timeMust-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...
-
Azure Databricks
2 months ago
pune, India Nityo Infotech Full timeData Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India
-
Data Engineer
4 weeks ago
Pune, India EDGESOFT Full timeData Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...
-
Data Engineer
4 weeks ago
Pune, India EDGESOFT Full timeData Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...
-
Data Engineer
3 weeks ago
pune, India EDGESOFT Full timeData Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...
-
Azure Databricks Engineer
2 weeks ago
Pune, India manogna it services private limited Full timeJob Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...
-
Azure Databricks
1 month ago
Pune, India Braincranx IT solutions Full time**Job description** Sr. Data Engineer (Spark / Pyspark & Azure Data Bricks) Skills - Data Engineering experience along with 2yrs Experience on Spark / Pyspark & Azure Data Bricks. Roles and Responsibilities Minimum 4+ years of Data Engineering experience. Experience as Data Engineer in PySpark/ Spark with Azure Dataricks Stream Analytics Experience with...
-
Databricks Engineer
2 weeks ago
Pune, India Celebal Technologies Full timeJob Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...
-
Databricks Engineer
2 weeks ago
pune, India Celebal Technologies Full timeJob Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...
-
Databricks Engineer
2 weeks ago
Pune, India Celebal Technologies Full timeJob Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...
-
Databricks Engineer
2 weeks ago
Pune, India Celebal Technologies Full timeJob Description: Databricks EngineerPosition:Databricks EngineerExperience Required:3 to 8 years overall experience in Data engineering on DatabricksLocation:Pune and NoidaJob Summary:The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets using...
-
Azure Databricks Engineer
2 weeks ago
Pune/Bangalore/Hyderabad, India Advitha Tech Solutions Full timeJob Description : - Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...
-
Data Engineer
4 weeks ago
Pune/Hyderabad/Remote, India HARP Technologies and Services Full timeJob Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data...
-
Azure Databricks Engineer
2 weeks ago
Hyderabad/Pune/Bangalore, India manogna it services private limited Full timeJob Description : - Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience...