Senior data engineer
1 week ago
Skills: Python, Py Spark, Azure, SQL, Github
Domain : Pharmacy solutions, clinical care services.
Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies leveraging Python and Py Spark prominently. The ETL pipelines and high-level data processing are planned to be built using Python and the transformations using Py Spark/Databricks. The supporting cloud platform will be Azure. A good expertise is expected in Python and Py Spark. The team will be working with the US counter parts, so a seamless communication and the Agile way of working is expected. Apart from Python and Py Spark, knowledge of Azure, Github and Databases are also expected.
Years of experience: 4+ Years (With 4 years of hands-on experience in Python)
Location: Kochi/Bangalore
Work mode: Hybrid
Notice Period: Immediate
- Good understanding of Python and its ecosystem, including advanced programming techniques, libraries, frameworks, and best practices
- Areas include
- Connecting and sourcing data from multiple kind of data sources
- Python + Databricks integration
- Coding skills (well aware of classes, objects, loops, dictionary ,etc)
- Experienced with working with python modules like numpy, pandas, re, scipy, etc.
- Experience in build and package a Python application using the Wheel format
- Python data transformations
Py Spark/Databricks
- Pyspark functions and control operations
- Transformations (aggregation, functions, joints)
- Aware of managing Databricks job clusters, performance optimizations
- Secrets Management
Azure
- Familiarity with Azure services
- Azure Key Vaults
- Azure Data Lake
- Azure Dev Ops
Github
- Github source management
Database
- SQL/ oracle/ Postgre SQL
-
Senior data engineer
1 week ago
Kochi, India Recro Full timeTitle: Senior Data Engineer Skills: Python, Py Spark, Azure, SQL, Github Domain : Pharmacy solutions, clinical care services. Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack...
-
Senior Data Engineer
1 week ago
Kochi, India Recro Full timeTitle: Senior Data Engineer Skills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Senior Data Engineer
1 week ago
Kochi, India Recro Full timeTitle: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Senior Data Engineer
2 weeks ago
Kochi, India Recro Full timeTitle: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Senior Data Engineer
1 week ago
Kochi, India Recro Full timeTitle: Senior Data Engineer Skills: Python, PySpark, Azure, SQL, Github Domain : Pharmacy solutions, clinical care services. Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Senior Data Engineer
1 week ago
Kochi, India Recro Full timeTitle: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Senior Azure Data Engineer
4 weeks ago
kochi, India Bluo Software India LLP Full time- Job Title: Senior Azure Data Engineer- Experience: 5+ years- Location: Mumbai or Kerala- NEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Architecting, designing, and maintaining database pipeline architectures,...
-
Senior Azure Data Engineer
1 month ago
kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data Engineer Experience: 5+ years Location: Mumbai or Kerala NEED SOMEONE WHO CAN JOIN IMMEDIATELY Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Architecting, designing, and maintaining database pipeline architectures, ensuring...
-
Senior Azure Data Engineer
1 month ago
Kochi, India Bluo Software India LLP Full time- Job Title: Senior Azure Data Engineer- Experience: 5+ years- Location: Mumbai or Kerala- NEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Architecting, designing, and maintaining database pipeline architectures,...
-
Senior Azure Data Engineer
1 month ago
kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...
-
Senior azure data engineer
1 month ago
Kochi, India Bluo Software India LLP Full time- Job Title: Senior Azure Data Engineer- Experience: 5+ years- Location: Mumbai or Kerala- NEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Architecting, designing, and maintaining database pipeline architectures,...
-
Senior Azure Data Engineer
1 month ago
Kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...
-
Senior Azure Data Engineer
1 month ago
Kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...
-
Senior Azure Data Engineer
1 month ago
Kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data Engineer Experience: 5+ years Location: Mumbai or Kerala NEED SOMEONE WHO CAN JOIN IMMEDIATELY Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Architecting, designing, and maintaining database pipeline architectures,...
-
Senior Azure Data Engineer
1 month ago
kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...
-
Senior Azure Data Engineer
1 month ago
kochi, India Bluo Software India LLP Full timeJob Title: Senior Azure Data Engineer Experience: 5+ years Location: Mumbai or Kerala NEED SOMEONE WHO CAN JOIN IMMEDIATELY Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Architecting, designing, and maintaining database pipeline architectures,...
-
Recro | Senior Data Engineer | kochi
1 week ago
kochi, India Recro Full timeTitle: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Sr. Data Engineer
3 months ago
Kochi, India Invokhr Full timePosition: Senior Data Engineer / Data Engineer Desired Experience:6-9 You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a problem-solution...
-
Recro | Senior Data Engineer | kochi
1 week ago
Kochi, India Recro Full timeTitle: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...
-
Sr. QA Engineer
3 weeks ago
Kochi, India Penguin Data Centre Pvt.Ltd. Full timeSr. QA Engineer We are seeking a highly skilled and experienced Senior QA Engineer to join our dynamic team. You will play a crucial role in ensuring the quality and reliability of our travel software solutions. Key Responsibilities: •Develop comprehensive test strategies and plans, including test case design, test data preparation, and test...