Datafoundry - Data Engineer - Azure Databricks
2 weeks ago
About Datafoundry AI :
Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI.
We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and results-oriented Data Engineer to join our growing team.
You will play a key role in building and maintaining the data infrastructure that supports our cutting-edge drug discovery platform.
About the Role :
This is an exciting opportunity to work on a mission-critical project with a real-world impact on healthcare. You will leverage your expertise in data engineering to design, develop, and implement scalable data pipelines for data ingestion, transformation, and loading (ETL) of massive datasets (in TBs).
Responsibilities :
- Design and develop efficient ETL pipelines using SQL (PostgreSQL or equivalent) and PL/SQL.
- Utilize Azure Databricks for large-scale data processing and transformation tasks.
- Migrate data from various sources to our data lake and data warehouse.
- Ensure data quality, consistency, and integrity throughout the data lifecycle.
- Collaborate with data scientists and analysts to understand data needs and design solutions.
- Develop and maintain data pipelines that are scalable, maintainable, and secure.
- Automate data processing tasks using scripting languages (e.g., Python, Bash).
- Monitor and optimize data pipelines for performance and efficiency.
- Stay up-to-date with the latest advancements in data engineering technologies and tools.
Qualifications :
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
- 3+ years of experience in data engineering with a strong focus on ETL processes.
- Proficiency in SQL (PostgreSQL or equivalent) and PL/SQL for data manipulation and querying.
- Experience with cloud-based data processing platforms (e.g., Azure Databricks) is a plus.
- Experience with data migration methodologies and tools is a plus.
-
Datafoundry - Data Engineer - Azure Databricks
3 weeks ago
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...
-
Vishakhapatnam/Vizag/Bangalore/Hyderabad, IN Datafoundry Full timeAbout Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...
-
hyderabad, India Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Vishakhapatnam/Vizag/Bangalore/Hyderabad, IN Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Data Engineer
1 week ago
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster. We are currently seeking a talented and...
-
Datafoundry - Senior Java Engineer - Spring Boot
2 weeks ago
Hyderabad, India Datafoundry Full timeAbout Datafoundry AI : Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
ML Data Engineer
1 week ago
Vishakhapatnam/Vizag/Bangalore/Hyderabad, India Datafoundry Full timeAbout Datafoundry AI :At Datafoundry AI, we're a committed team of data scientists, life sciences experts, and technology enthusiasts. Our primary goal is to optimize DL and ML models for maximum impact, offering comprehensive support across all facets of the data-driven business. Who are we looking for : We're in search of a dynamic, accountable...
-
Datafoundry - Senior Java Engineer - Spring Boot
3 weeks ago
Hyderabad/Vishakhapatnam/Vizag, India Datafoundry Full timeAbout Datafoundry AI : Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
Hyderabad/Vishakhapatnam/Vizag, IN Datafoundry Full timeAbout Datafoundry AI : Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
hyderabad, India Datafoundry Full timeAbout Datafoundry AI :We're Datafoundry a dedicated team of data scientists, life sciences experts, and technology geeks. Our mission is to help and optimize deep learning models for maximum impact. We have the expertise to help you with all aspects of the data-driven business. Who do we think will be a great fit, We are seeking an energetic, responsible...
-
Hyderabad/Vishakhapatnam/Vizag, India Datafoundry Full timeAbout Datafoundry AI :We're Datafoundry a dedicated team of data scientists, life sciences experts, and technology geeks. Our mission is to help and optimize deep learning models for maximum impact. We have the expertise to help you with all aspects of the data-driven business. Who do we think will be a great fit, We are seeking an energetic,...
-
Senior Java Engineer
1 week ago
Hyderabad/Vishakhapatnam/Vizag, India Datafoundry Full timeAbout DatafoundryAI :Datafoundry AI is a passionate team of data scientists, product and ML engineers, and domain experts dedicated to accelerating drug discovery through the power of AI. We are on a mission to deliver safer and more effective drugs, vaccines, and other healthcare products to patients faster.We are currently seeking talented and innovative...
-
Azure Databricks Data Engineer
4 weeks ago
Hyderabad, India EMentor Enterprises Private Limited Full timeSkills Required: Azure ADFDatabricks with Pyspark PythonData Engineer with Pyspark Databricksskillset 8 yearsof experience Data Engineering with min 5 years hands on experiencein Pyspark for datatransformations.Sound Knowledge on Azure DataBricks Azure DataLake. Soundknowledge in Data Bricks & Logic AppsDelta Lake Azure SQLand Azure blob storage Azure logic...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, India EMentor Enterprises Private Limited Full timeSkills Required: Azure ADFDatabricks with Pyspark PythonData Engineer with Pyspark Databricksskillset 8 yearsof experience Data Engineering with min 5 years hands on experiencein Pyspark for datatransformations.Sound Knowledge on Azure DataBricks Azure DataLake. Soundknowledge in Data Bricks & Logic AppsDelta Lake Azure SQLand Azure blob storage Azure logic...
-
Azure Databricks Data Engineer
1 week ago
Hyderabad, Telangana, India EMentor Enterprises Private Limited Full timeSkills Required: Azure ADFDatabricks with Pyspark PythonData Engineer with Pyspark Databricksskillset 8 yearsof experience Data Engineering with min 5 years hands on experiencein Pyspark for datatransformations.Sound Knowledge on Azure DataBricks Azure DataLake. Soundknowledge in Data Bricks & Logic AppsDelta Lake Azure SQLand Azure blob storage Azure logic...
-
Data Engineer
3 weeks ago
Pune/Hyderabad, India HuQuo Full timeMust-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...
-
Data Engineer
2 months ago
Pune,Hyderabad, India HuQuo Full timeMust-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...
-
Azure Databricks Engineer
1 week ago
Hyderabad, Telangana, India Advitha Tech Solutions Full timeJob Description : Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...
-
Azure Databricks Engineer
3 weeks ago
Hyderabad, India Advitha Tech Solutions Full timeJob Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...
