Datafoundry - Data Engineer - Azure Databricks
2 weeks ago
About Datafoundry AI :
Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI.
We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and results-oriented Data Engineer to join our growing team.
You will play a key role in building and maintaining the data infrastructure that supports our cutting-edge drug discovery platform.
About the Role :
This is an exciting opportunity to work on a mission-critical project with a real-world impact on healthcare. You will leverage your expertise in data engineering to design, develop, and implement scalable data pipelines for data ingestion, transformation, and loading (ETL) of massive datasets (in TBs).
Responsibilities :
- Design and develop efficient ETL pipelines using SQL (PostgreSQL or equivalent) and PL/SQL.
- Utilize Azure Databricks for large-scale data processing and transformation tasks.
- Migrate data from various sources to our data lake and data warehouse.
- Ensure data quality, consistency, and integrity throughout the data lifecycle.
- Collaborate with data scientists and analysts to understand data needs and design solutions.
- Develop and maintain data pipelines that are scalable, maintainable, and secure.
- Automate data processing tasks using scripting languages (e.g., Python, Bash).
- Monitor and optimize data pipelines for performance and efficiency.
- Stay up-to-date with the latest advancements in data engineering technologies and tools.
Qualifications :
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
- 3+ years of experience in data engineering with a strong focus on ETL processes.
- Proficiency in SQL (PostgreSQL or equivalent) and PL/SQL for data manipulation and querying.
- Experience with cloud-based data processing platforms (e.g., Azure Databricks) is a plus.
- Experience with data migration methodologies and tools is a plus.
-
Vishakhapatnam/Vizag/Bangalore/Hyderabad, IN Datafoundry Full timeAbout Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...
-
Datafoundry - Data Engineer - Azure Databricks
2 weeks ago
hyderabad, India Datafoundry Full timeAbout Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...
-
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Vishakhapatnam/Vizag/Bangalore/Hyderabad, IN Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Data Engineer
7 days ago
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...
-
ML Data Engineer
7 days ago
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Datafoundry - Senior Java Engineer - Spring Boot
2 weeks ago
Hyderabad/Vishakhapatnam/Vizag, India Datafoundry Full timeAbout Datafoundry AI : Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
Hyderabad/Vishakhapatnam/Vizag, IN Datafoundry Full timeAbout Datafoundry AI : Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
hyderabad, India Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Data Engineer
3 weeks ago
bangalore, India Datafoundry Full timePosition: Data EngineerExperience: 4-10 yearsLocation – Bangalore / Hyderabad / VisakhapatnamWork Mode – On-site / Work from office (5 working days)About Datafoundry AI:At Datafoundry AI, we're a passionate group of data scientists, product and ML engineers, and domain experts. Our mission is to enable digital transformation to accelerate drug discovery...
-
Data Engineer
3 weeks ago
Bangalore City, India Datafoundry Full timePosition: Data Engineer Experience: 4-10 years Location – Bangalore / Hyderabad / Visakhapatnam Work Mode – On-site / Work from office (5 working days) About Datafoundry AI: At Datafoundry AI, we're a passionate group of data scientists, product and ML engineers, and domain experts. Our mission is to enable digital transformation to accelerate drug...
-
Hyderabad/Vishakhapatnam/Vizag, India Datafoundry Full timeAbout Datafoundry AI :We're Datafoundry a dedicated team of data scientists, life sciences experts, and technology geeks. Our mission is to help and optimize deep learning models for maximum impact. We have the expertise to help you with all aspects of the data-driven business. Who do we think will be a great fit, We are seeking an energetic,...
-
Senior Java Engineer
7 days ago
Hyderabad/Vishakhapatnam/Vizag, India Datafoundry Full timeAbout DatafoundryAI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
Datafoundry - Senior Java Engineer - Spring Boot
2 weeks ago
Hyderabad, India Datafoundry Full timeAbout Datafoundry AI : Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
Bangalore, Karnataka, India Datafoundry Full timePosition: Software Engineer/Senior Software Engineer - Python Backend. Experience Level: 5-10 Years. Location: Bangalore, Hyderabad & Vizag. About Datafoundry AI: We're Datafoundry a dedicated team of data scientists, life sciences experts, and technology geeks. Our mission is to help and optimize deep learning models for maximum impact. We have the...
-
Data Engineer
4 weeks ago
bangalore, India Datafoundry Full timePosition: Data EngineerExperience: 4-10 yearsLocation – Bangalore / Hyderabad / VisakhapatnamWork Mode – On-site / Work from office (5 working days)About Datafoundry AI:At Datafoundry AI, we're a passionate group of data scientists, product and ML engineers, and domain experts. Our mission is to enable digital transformation to accelerate drug discovery...
-
Data Engineer
2 months ago
bangalore, India Datafoundry Full timeJob Role - Data EngineerExperience: 4-7 yearsLocation – Bangalore / Hyderabad / VisakhapatnamWork Mode – On-site / Work from office (5 working days)About Datafoundry AI:We’re Datafoundry AI , a dedicated team of data scientists, life sciences experts, and technology geeks. Our mission is to help and optimize deep learning models for maximum impact. We...
-
Bangalore, India NTT DATA Services Full timeAzure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...
-
bangalore, India NTT DATA Full timeJob Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...
-
hyderabad, India Datafoundry Full timeAbout Datafoundry AI :We're Datafoundry a dedicated team of data scientists, life sciences experts, and technology geeks. Our mission is to help and optimize deep learning models for maximum impact. We have the expertise to help you with all aspects of the data-driven business. Who do we think will be a great fit, We are seeking an energetic, responsible...
