Senior Data Engineer

2 weeks ago

Kochi, India Recro Full time

Title: Senior Data Engineer

Skills: Python, PySpark, Azure, SQL, Github

Domain : Pharmacy solutions, clinical care services.


Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies leveraging Python and PySpark prominently. The ETL pipelines and high-level data processing are planned to be built using Python and the transformations using PySpark/Databricks. The supporting cloud platform will be Azure. A good expertise is expected in Python and PySpark. The team will be working with the US counter parts, so a seamless communication and the Agile way of working is expected. Apart from Python and PySpark, knowledge of Azure, Github and Databases are also expected.

Years of experience: 4+ Years (With 4 years of hands-on experience in Python)

Location: Kochi/Bangalore

Work mode: Hybrid

Notice Period: Immediate

  • Good understanding of Python and its ecosystem, including advanced programming techniques, libraries, frameworks, and best practices
  • Areas include
  • Connecting and sourcing data from multiple kind of data sources
  • Python + Databricks integration
  • Coding skills (well aware of classes, objects, loops, dictionary ,etc)
  • Experienced with working with python modules like numpy, pandas, re, scipy, etc.
  • Experience in build and package a Python application using the Wheel format
  • Python data transformations

PySpark/Databricks

  • Pyspark functions and control operations
  • Transformations (aggregation, functions, joints)
  • Aware of managing Databricks job clusters, performance optimizations
  • Secrets Management

Azure

  • Familiarity with Azure services
  • Azure Key Vaults
  • Azure Data Lake
  • Azure DevOps

Github

  • Github source management

Database

  • SQL/ oracle/ PostgreSQL

  • Senior data engineer

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data Engineer Skills: Python, Py Spark, Azure, SQL, Github Domain : Pharmacy solutions, clinical care services. Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack...

  • Senior Data Engineer

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data Engineer Skills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Senior Data Engineer

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Senior data engineer

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data EngineerSkills: Python, Py Spark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Senior Data Engineer

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Senior Data Engineer

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data Engineer Skills: Python, PySpark, Azure, SQL, Github Domain : Pharmacy solutions, clinical care services. Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Senior Azure Data Engineer

    4 weeks ago

    kochi, India Bluo Software India LLP Full time

    - Job Title: Senior Azure Data Engineer- Experience: 5+ years- Location: Mumbai or Kerala- NEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Architecting, designing, and maintaining database pipeline architectures,...

  • Senior Azure Data Engineer

    1 month ago

    kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data Engineer Experience: 5+ years Location: Mumbai or Kerala NEED SOMEONE WHO CAN JOIN IMMEDIATELY Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Architecting, designing, and maintaining database pipeline architectures, ensuring...

  • Senior Azure Data Engineer

    1 month ago

    Kochi, India Bluo Software India LLP Full time

    - Job Title: Senior Azure Data Engineer- Experience: 5+ years- Location: Mumbai or Kerala- NEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Architecting, designing, and maintaining database pipeline architectures,...

  • Senior Azure Data Engineer

    1 month ago

    kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...

  • Senior azure data engineer

    1 month ago

    Kochi, India Bluo Software India LLP Full time

    - Job Title: Senior Azure Data Engineer- Experience: 5+ years- Location: Mumbai or Kerala- NEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Architecting, designing, and maintaining database pipeline architectures,...

  • Senior Azure Data Engineer

    1 month ago

    Kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...

  • Senior Azure Data Engineer

    1 month ago

    Kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...

  • Senior Azure Data Engineer

    1 month ago

    kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data EngineerExperience: 5+ yearsLocation: Mumbai or KeralaNEED SOMEONE WHO CAN JOIN IMMEDIATELYResponsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Architecting, designing, and maintaining database pipeline architectures, ensuring...

  • Senior Azure Data Engineer

    1 month ago

    Kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data Engineer Experience: 5+ years Location: Mumbai or Kerala NEED SOMEONE WHO CAN JOIN IMMEDIATELY Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Architecting, designing, and maintaining database pipeline architectures,...

  • Senior Azure Data Engineer

    1 month ago

    kochi, India Bluo Software India LLP Full time

    Job Title: Senior Azure Data Engineer Experience: 5+ years Location: Mumbai or Kerala NEED SOMEONE WHO CAN JOIN IMMEDIATELY Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Architecting, designing, and maintaining database pipeline architectures,...

  • Recro | Senior Data Engineer | kochi

    1 week ago

    kochi, India Recro Full time

    Title: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Sr. Data Engineer

    3 months ago

    Kochi, India Invokhr Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience:6-9 You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a problem-solution...

  • Recro | Senior Data Engineer | kochi

    1 week ago

    Kochi, India Recro Full time

    Title: Senior Data EngineerSkills: Python, PySpark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Sr. QA Engineer

    3 weeks ago

    Kochi, India Penguin Data Centre Pvt.Ltd. Full time

    Sr. QA Engineer We are seeking a highly skilled and experienced Senior QA Engineer to join our dynamic team. You will play a crucial role in ensuring the quality and reliability of our travel software solutions. Key Responsibilities: •Develop comprehensive test strategies and plans, including test case design, test data preparation, and test...