Senior Data Engineer
2 weeks ago
Location - Bengaluru & Kochi
Domain : Pharmacy solutions, clinical care services.
Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to used open stack technologies leveraging Python and PySpark prominently. The ETL pipelines and high-level data processing are planned to be built using Python and the transformations using PySpark/Databricks. The supporting cloud platform will be Azure. A good expertise is expected in Python and PySpark. The team will be working with the US counter parts, so a seamless communication and the Agile way of working is expected. Apart from Python and PySpark, knowledge of Azure, Github and Databases are also expected.
Years of experience : 4+ Years (With 4 years of hands-on experience in Python)
Location : Kochi/Bangalore
Work mode : Hybrid
Notice Period : Immediate
Good understanding of Python and its ecosystem, including advanced programming techniques, libraries, frameworks, and best practices
Areas include
Connecting and sourcing data from multiple kind of data sources
Python + Databricks integration
Coding skills (well aware of classes, objects, loops, dictionary ,etc)
Experienced with working with python modules like numpy, pandas, re, scipy, etc.
Experience in build and package a Python application using the Wheel format
Python data transformations
PySpark/Databricks
Pyspark functions and control operations
Transformations (aggregation, functions, joints)
Aware of managing Databricks job clusters, performance optimizations
Secrets Management
Azure
Familiarity with Azure services
Azure Key Vaults
Azure Data Lake
Azure DevOps
Github
Github source management
Database
SQL/ oracle/ PostgreSQL
-
delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...
-
Senior data integration engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
1 week ago
Delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Wavicle Data Solutions | Senior Data Scientist
14 hours ago
delhi, India Wavicle Data Solutions Full timeJob Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...
-
Senior Data Engineer
1 day ago
Delhi, India Rakuten Symphony Full timeJob Title: Senior Data Engineer Location: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...
-
Senior data engineer
4 weeks ago
Delhi, India IO Associates - UKEU Full timeJob Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAi O Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, Py Spark, Synapse, ADF, ADLS Gen2, and Azure...
-
Senior Data Engineer
1 month ago
delhi, India iO Associates - UKEU Full timeJob Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAiO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS Gen2, and Azure...
-
Lead data engineer
3 weeks ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Senior Data Engineer
3 weeks ago
Delhi, Delhi, India Muoro Full timeJob Title: Senior Data EngineerAbout the Role:We are looking for a skilled Data Engineer to help us build and maintain our data infrastructure. The ideal candidate will have a strong background in data engineering and experience working with AWS data services.Key Responsibilities:Design and build large-scale enterprise data solutions using AWS data...
-
Data Platform Engineer
2 days ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data platform engineer
2 days ago
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
2 days ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
AWS Data Engineer
4 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Senior AI and Data Engineer
7 hours ago
Delhi, Delhi, India LTIMindtree Full timeJob Title: Senior AI and Data EngineerWe are seeking a highly skilled Senior AI and Data Engineer to join our team at LTIMindtree. The successful candidate will have experience in developing and deploying machine learning models, as well as a strong understanding of data engineering principles.About the Role:This is an exciting opportunity for a motivated...
-
AWS Data Engineer
1 month ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
4 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
4 weeks ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....