Data Engineer
3 weeks ago
About the Role
We are seeking a Data Engineer with expertise in Data Bricks and Azure Environments tools to join our dynamic team in Noida. In this role, you will design and implement scalable data pipelines, visualize insights, troubleshoot complex data-related challenges, and support the operational and analytical needs of our healthcare-focused solutions. As part of a collaborative team, you will play a critical role in ensuring data integrity, optimizing performance, and enabling data-driven decision-making.
Timings - The candidate must be willing to work during night shifts and adjust schedules based on business needs.
Note - Must be able to join within a 30 days notice.
Hybrid- 3 Days onsite required
Primary Responsibilities and Assignments
Data Bricks Development and Administration:
o Design and implement end-to-end pipelines for data ingestion and processing.
o Develop schemas for Bronze, Silver, and Gold data layers to support robust data management.
o Manage user rights, permissions, and notebook maintenance.
o Troubleshoot advanced issues, including pipeline errors, capacity constraints, and schema
evolution.
Cloud Integration:
o Work with Azure cloud-native tools, including Azure Data Factory, for seamless data ingestion
and transformation.
Data Warehousing and Analytics:
o Define and maintain star schemas and apply Big Data concepts for optimized performance.
o Support analytical and reporting requirements with robust data models.
Database Management:
o Perform complex query optimization and relational database administration.
o Experience with MySQL is a plus.
Operational Support:
o Provide production-level support for pipelines and address critical issues outside of normal
working hours when necessary.
Collaboration and Documentation:
o Work closely with cross-functional teams to ensure data solutions align with business
objectives.
o Maintain comprehensive documentation for implemented solutions and processes.
Secondary Responsibilities and Assignments
Data Visualization and Analytics:
o Create insightful dashboards and visualizations using Power BI to support business objectives.
o Integrate visualizations into business workflows to enhance decision-making.
Required Skills and Professional Background
Technical Expertise:
o Proficiency with Data Bricks development and administration.
o Experience with data lookup tools for querying and analysing large datasets.
o Experience in designing schemas for data pipelines and warehousing layers.
o Advanced troubleshooting and optimization skills for pipelines and workflows.
Cloud and Data Warehousing:
o Hands-on experience with Azure cloud tools, particularly Azure Data Factory.
o Strong understanding of data warehousing principles and Big Data frameworks.
Database Knowledge:
o Advanced SQL skills with query formation and optimization.
o Experience with MySQL is an added advantage.
Education and Experience:
o Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
o Equivalent work experience may be considered in lieu of education requirements.
o Minimum 3 years of experience in data engineering or a similar field.
Optional Skills
Proficiency using Power BI to create dashboards and visualizations.
Shift Timings
This position requires rotational shifts to ensure seamless support for US-based products.
The candidate must be willing to work during night shifts and adjust schedules based on business needs.
-
Data engineer
3 weeks ago
India Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...
-
Data Engineer
3 weeks ago
India Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...
-
Data Engineer
3 weeks ago
India Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...
-
Data Engineer
3 weeks ago
India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...
-
Pyspark data engineer
3 weeks ago
India ITI Data Full timeLocation : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are...
-
ITI Data | PySpark Data Engineer
4 weeks ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
ITI Data | PySpark Data Engineer
4 weeks ago
india ITI Data Full timeLocation : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...
-
PySpark Data Engineer
4 weeks ago
India ITI Data Full timeLocation : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...
-
PySpark Data Engineer
3 weeks ago
India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
Data Platform Engineer
4 weeks ago
India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data Platform Engineer
4 weeks ago
India OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Pacific Data Integrators | Data Engineer
4 days ago
india Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...
-
Pacific Data Integrators | Data Engineer
3 weeks ago
india Pacific Data Integrators Full timeJob OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...
-
india OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
india OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
india OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Big Data Engineer: Scalable Solutions Developer
4 weeks ago
India ITI Data Full timeWe are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...
-
Data Unveil | Quality Assurance Engineer
4 weeks ago
india Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...
-
Data Unveil | Quality Assurance Engineer
4 weeks ago
india Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...
-
Data Unveil | Quality Assurance Engineer
4 weeks ago
india Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...
